2023-11-27T17:25:12.619 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-27T17:25:12.619 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467883 --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} --verbose --owner scheduled_yuriw@teuthology --name yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467883/orig.config.yaml 2023-11-27T17:25:12.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-27T17:25:12.790 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467883 branch: wip-yuri10-testing-2023-11-22-1112 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} email: yweinste@redhat.com first_in_suite: false job_id: '7467883' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri10-testing-2023-11-22-1112 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri10-testing-2023-11-22-1112 sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 8541 sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri10-testing-2023-11-22-1112 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL0fZRbIKBxpfaKybS6vLZ4GiOJAw5O+A/Lun4Xlo/9nJ8s78YZI5DduQdd/XA77nG5eCO6HblKMZWdQh3PcEeQ= smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM1H6kZt0IcSxFBAGTyv1GEqQB3lYFDSSjQlvKmCZ2gIvnFnPeYSCOqv5MJ8SUyNtdOao13YcMahNzdpcKjWty0= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJPA8eLnUX9BQLL4M0cXgOkCeVs8XBmckdAmF+1cf8PC3yMHucZqb/Fxp2GgfmOe5SvdSFOiiVJzOpekSG92HMY= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-27_17:14:24 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-27T17:25:12.791 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa; will attempt to use it 2023-11-27T17:25:12.792 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks 2023-11-27T17:25:12.792 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-27T17:25:12.794 INFO:teuthology.task.internal:Checking packages... 2023-11-27T17:25:12.817 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '369173db14b6995b2bd07c60ec5f63d01cf21631' 2023-11-27T17:25:12.817 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-27T17:25:12.817 INFO:teuthology.packaging:ref: None 2023-11-27T17:25:12.817 INFO:teuthology.packaging:tag: None 2023-11-27T17:25:12.817 INFO:teuthology.packaging:branch: wip-yuri10-testing-2023-11-22-1112 2023-11-27T17:25:12.817 INFO:teuthology.packaging:sha1: 369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:25:12.817 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri10-testing-2023-11-22-1112 2023-11-27T17:25:13.047 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7498-g369173db-1jammy 2023-11-27T17:25:13.047 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-27T17:25:13.053 INFO:teuthology.task.internal:no buildpackages task found 2023-11-27T17:25:13.053 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-27T17:25:13.058 INFO:teuthology.task.internal:Saving configuration 2023-11-27T17:25:13.077 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-27T17:25:13.083 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-27T17:25:13.114 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467883', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 17:15:28.374116', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOKGSVONytNY7PmpFU5wJKk7RV9FRnIr7H4Xvb7aDy6L'} 2023-11-27T17:25:13.145 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467883', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 17:15:28.376462', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIL0V/tgzEufdo7NjIuauMVH1Vxm0Qpv77SRo7XeVttch'} 2023-11-27T17:25:13.177 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467883', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-27 17:15:28.375403', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICNs0Hf1EIUsaJq3l9d8A9vKvNkCwpKKSEVzQhN+XCKw'} 2023-11-27T17:25:13.178 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-27T17:25:13.183 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-11-27T17:25:13.183 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-11-27T17:25:13.184 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['client.0'] 2023-11-27T17:25:13.184 INFO:teuthology.run_tasks:Running task console_log... 2023-11-27T17:25:13.364 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f69eb01bb80>, signals=[15]) 2023-11-27T17:25:13.364 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-27T17:25:13.372 INFO:teuthology.task.internal:Opening connections... 2023-11-27T17:25:13.372 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2023-11-27T17:25:13.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:25:13.475 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2023-11-27T17:25:13.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:25:13.556 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2023-11-27T17:25:13.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:25:13.645 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-27T17:25:13.651 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-11-27T17:25:13.658 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-11-27T17:25:13.659 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-11-27T17:25:13.705 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-27T17:25:13.706 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2023-11-27T17:25:13.706 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="22.04" 2023-11-27T17:25:13.706 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-27T17:25:13.706 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=jammy 2023-11-27T17:25:13.706 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2023-11-27T17:25:13.706 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2023-11-27T17:25:13.706 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-27T17:25:13.706 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-27T17:25:13.706 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-27T17:25:13.707 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-27T17:25:13.707 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=jammy 2023-11-27T17:25:13.707 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-11-27T17:25:13.738 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-11-27T17:25:13.744 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-11-27T17:25:13.744 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-11-27T17:25:13.792 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-27T17:25:13.792 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2023-11-27T17:25:13.792 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="22.04" 2023-11-27T17:25:13.793 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-27T17:25:13.793 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=jammy 2023-11-27T17:25:13.793 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2023-11-27T17:25:13.793 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2023-11-27T17:25:13.793 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-27T17:25:13.793 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-27T17:25:13.793 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-27T17:25:13.793 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-27T17:25:13.793 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=jammy 2023-11-27T17:25:13.794 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-11-27T17:25:13.822 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2023-11-27T17:25:13.828 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2023-11-27T17:25:13.828 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2023-11-27T17:25:13.876 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-27T17:25:13.876 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Ubuntu" 2023-11-27T17:25:13.877 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="22.04" 2023-11-27T17:25:13.877 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-27T17:25:13.877 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_CODENAME=jammy 2023-11-27T17:25:13.877 INFO:teuthology.orchestra.run.smithi176.stdout:ID=ubuntu 2023-11-27T17:25:13.877 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE=debian 2023-11-27T17:25:13.877 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-27T17:25:13.877 INFO:teuthology.orchestra.run.smithi176.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-27T17:25:13.877 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-27T17:25:13.877 INFO:teuthology.orchestra.run.smithi176.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-27T17:25:13.877 INFO:teuthology.orchestra.run.smithi176.stdout:UBUNTU_CODENAME=jammy 2023-11-27T17:25:13.877 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2023-11-27T17:25:13.913 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-27T17:25:13.923 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-27T17:25:13.928 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-27T17:25:13.928 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2023-11-27T17:25:13.931 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2023-11-27T17:25:13.933 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2023-11-27T17:25:13.939 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-27T17:25:13.945 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-27T17:25:13.945 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2023-11-27T17:25:13.979 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2023-11-27T17:25:13.982 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2023-11-27T17:25:14.000 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-27T17:25:14.110 INFO:teuthology.run_tasks:Running task kernel... 2023-11-27T17:25:14.125 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-11-27T17:25:14.126 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-11-27T17:25:14.126 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-11-27T17:25:14.126 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T17:25:14.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:25:14.131 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-27T17:25:14.443 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-27T17:25:14.443 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-27T17:25:14.443 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2023-11-27T17:25:14.449 INFO:teuthology.orchestra.run.smithi176.stdout:5.15.0-56-generic 2023-11-27T17:25:14.449 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-27T17:25:14.449 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-27T17:25:14.450 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-11-27T17:25:14.450 DEBUG:teuthology.orchestra.run.smithi176:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-27T17:25:14.503 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-27T17:25:14.661 INFO:teuthology.orchestra.run.smithi176.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-27T17:25:14.661 INFO:teuthology.orchestra.run.smithi176.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-27T17:25:14.661 INFO:teuthology.orchestra.run.smithi176.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-27T17:25:14.661 INFO:teuthology.orchestra.run.smithi176.stderr:hint: 2023-11-27T17:25:14.661 INFO:teuthology.orchestra.run.smithi176.stderr:hint: git config --global init.defaultBranch 2023-11-27T17:25:14.661 INFO:teuthology.orchestra.run.smithi176.stderr:hint: 2023-11-27T17:25:14.661 INFO:teuthology.orchestra.run.smithi176.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-27T17:25:14.661 INFO:teuthology.orchestra.run.smithi176.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-27T17:25:14.662 INFO:teuthology.orchestra.run.smithi176.stderr:hint: 2023-11-27T17:25:14.662 INFO:teuthology.orchestra.run.smithi176.stderr:hint: git branch -m 2023-11-27T17:25:14.662 INFO:teuthology.orchestra.run.smithi176.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-27T17:25:14.664 DEBUG:teuthology.orchestra.run.smithi176:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-27T17:25:14.734 DEBUG:teuthology.orchestra.run.smithi176:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-27T17:25:14.789 DEBUG:teuthology.orchestra.run.smithi176:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-27T17:29:13.535 INFO:teuthology.orchestra.run.smithi176.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-27T17:29:13.535 INFO:teuthology.orchestra.run.smithi176.stderr: * [new branch] main -> origin/main 2023-11-27T17:29:13.566 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190312 -> 20190312 2023-11-27T17:29:13.566 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190416 -> 20190416 2023-11-27T17:29:13.566 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190514 -> 20190514 2023-11-27T17:29:13.566 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190618 -> 20190618 2023-11-27T17:29:13.566 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190717 -> 20190717 2023-11-27T17:29:13.566 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190815 -> 20190815 2023-11-27T17:29:13.567 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20190923 -> 20190923 2023-11-27T17:29:13.567 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20191022 -> 20191022 2023-11-27T17:29:13.567 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20191215 -> 20191215 2023-11-27T17:29:13.569 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200122 -> 20200122 2023-11-27T17:29:13.569 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200316 -> 20200316 2023-11-27T17:29:13.569 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200421 -> 20200421 2023-11-27T17:29:13.570 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200519 -> 20200519 2023-11-27T17:29:13.570 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200619 -> 20200619 2023-11-27T17:29:13.570 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200721 -> 20200721 2023-11-27T17:29:13.570 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200817 -> 20200817 2023-11-27T17:29:13.570 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20200918 -> 20200918 2023-11-27T17:29:13.570 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20201022 -> 20201022 2023-11-27T17:29:13.570 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20201118 -> 20201118 2023-11-27T17:29:13.571 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20201218 -> 20201218 2023-11-27T17:29:13.571 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210208 -> 20210208 2023-11-27T17:29:13.571 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210315 -> 20210315 2023-11-27T17:29:13.571 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210511 -> 20210511 2023-11-27T17:29:13.571 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210716 -> 20210716 2023-11-27T17:29:13.571 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210818 -> 20210818 2023-11-27T17:29:13.571 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20210919 -> 20210919 2023-11-27T17:29:13.571 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20211027 -> 20211027 2023-11-27T17:29:13.571 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20211216 -> 20211216 2023-11-27T17:29:13.571 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220209 -> 20220209 2023-11-27T17:29:13.571 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220310 -> 20220310 2023-11-27T17:29:13.572 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220411 -> 20220411 2023-11-27T17:29:13.573 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220509 -> 20220509 2023-11-27T17:29:13.573 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220610 -> 20220610 2023-11-27T17:29:13.573 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220708 -> 20220708 2023-11-27T17:29:13.574 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220815 -> 20220815 2023-11-27T17:29:13.574 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20220913 -> 20220913 2023-11-27T17:29:13.574 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20221012 -> 20221012 2023-11-27T17:29:13.574 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20221109 -> 20221109 2023-11-27T17:29:13.574 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20221214 -> 20221214 2023-11-27T17:29:13.574 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230117 -> 20230117 2023-11-27T17:29:13.574 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230210 -> 20230210 2023-11-27T17:29:13.574 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230310 -> 20230310 2023-11-27T17:29:13.574 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230404 -> 20230404 2023-11-27T17:29:13.574 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230515 -> 20230515 2023-11-27T17:29:13.574 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230625 -> 20230625 2023-11-27T17:29:13.574 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230804 -> 20230804 2023-11-27T17:29:13.575 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20230919 -> 20230919 2023-11-27T17:29:13.575 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20231030 -> 20231030 2023-11-27T17:29:13.575 INFO:teuthology.orchestra.run.smithi176.stderr: * [new tag] 20231111 -> 20231111 2023-11-27T17:29:17.569 INFO:teuthology.orchestra.run.smithi176.stderr:Updating files: 51% (1664/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 64% (2080/3250) Updating files: 64% (2111/3250) Updating files: 65% (2113/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2650/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-27T17:29:17.573 INFO:teuthology.orchestra.run.smithi176.stdout:HEAD is now at f8c611e7 Merge branch 'ice-edge' into 'main' 2023-11-27T17:29:17.594 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-27T17:29:17.595 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-27T17:29:17.748 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-27T17:29:17.748 DEBUG:teuthology.orchestra.run.smithi176:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-27T17:29:17.752 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi176.front.sepia.ceph.com to complete... 2023-11-27T17:29:19.329 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-27 17:29:19 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-27T17:29:19.329 INFO:teuthology.orchestra.run.smithi176.stderr:FINISHED --2023-11-27 17:29:19-- 2023-11-27T17:29:19.329 INFO:teuthology.orchestra.run.smithi176.stderr:Total wall clock time: 1.5s 2023-11-27T17:29:19.329 INFO:teuthology.orchestra.run.smithi176.stderr:Downloaded: 1 files, 37M in 1.4s (27.4 MB/s) 2023-11-27T17:29:19.332 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-27T17:29:19.332 DEBUG:teuthology.orchestra.run.smithi176:> sudo dpkg -i /tmp/linux-image.deb 2023-11-27T17:29:19.536 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-27T17:29:21.495 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-27T17:29:21.502 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-27T17:29:21.599 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-27T17:29:24.897 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-27T17:29:24.999 INFO:teuthology.orchestra.run.smithi176.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-27T17:29:45.211 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub' 2023-11-27T17:29:45.229 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-27T17:29:45.255 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2023-11-27T17:29:45.558 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-27T17:29:45.578 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-27T17:29:45.829 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-27T17:29:45.836 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-27T17:29:45.899 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-27T17:29:45.905 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-27T17:29:46.057 INFO:teuthology.orchestra.run.smithi176.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-27T17:29:46.057 INFO:teuthology.orchestra.run.smithi176.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-27T17:29:46.057 INFO:teuthology.orchestra.run.smithi176.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-27T17:29:46.098 INFO:teuthology.orchestra.run.smithi176.stderr:done 2023-11-27T17:29:46.274 DEBUG:teuthology.orchestra.run.smithi176:> dpkg-deb -c /tmp/linux-image.deb 2023-11-27T17:29:46.281 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-27T17:29:46.281 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-27T17:29:46.281 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-27T17:29:46.293 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-27T17:29:46.293 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-27T17:29:46.312 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-27T17:29:46.313 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-27T17:29:46.313 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-27T17:29:46.313 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-27T17:29:46.313 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-27T17:29:46.313 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-27T17:29:46.313 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-27T17:29:46.313 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-27T17:29:46.313 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-27T17:29:46.313 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-27T17:29:46.314 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-27T17:29:46.314 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-27T17:29:46.314 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-27T17:29:46.314 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-27T17:29:46.316 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-27T17:29:46.316 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-27T17:29:46.316 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-27T17:29:46.316 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-27T17:29:46.316 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-27T17:29:46.316 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-27T17:29:46.316 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-27T17:29:46.318 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-27T17:29:46.318 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-27T17:29:46.319 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-27T17:29:46.319 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-27T17:29:46.319 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-27T17:29:46.319 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-27T17:29:46.319 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-27T17:29:46.319 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-27T17:29:46.319 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-27T17:29:46.319 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-27T17:29:46.319 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-27T17:29:46.320 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-27T17:29:46.320 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-27T17:29:46.320 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-27T17:29:46.320 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-27T17:29:46.320 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-27T17:29:46.320 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-27T17:29:46.320 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-27T17:29:46.320 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-27T17:29:46.320 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-27T17:29:46.320 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-27T17:29:46.321 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-27T17:29:46.605 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-27T17:29:46.605 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-27T17:29:46.605 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-27T17:29:46.605 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-27T17:29:46.605 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-27T17:29:46.606 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-27T17:29:46.607 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-27T17:29:46.607 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-27T17:29:46.607 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-27T17:29:46.607 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-27T17:29:46.607 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-27T17:29:46.607 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-27T17:29:46.607 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-27T17:29:46.607 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-27T17:29:46.607 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-27T17:29:46.609 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-27T17:29:46.609 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-27T17:29:46.609 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-27T17:29:46.609 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-27T17:29:46.609 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-27T17:29:46.609 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-27T17:29:46.609 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-27T17:29:46.609 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-27T17:29:46.609 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-27T17:29:46.609 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-27T17:29:46.610 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-27T17:29:46.610 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-27T17:29:46.610 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-27T17:29:46.610 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-27T17:29:46.619 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-27T17:29:46.619 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-27T17:29:46.620 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-27T17:29:46.621 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-27T17:29:46.621 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-27T17:29:46.621 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-27T17:29:46.621 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-27T17:29:46.621 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-27T17:29:46.621 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-27T17:29:46.621 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-27T17:29:46.621 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-27T17:29:46.621 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-27T17:29:46.624 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-27T17:29:46.624 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-27T17:29:46.624 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-27T17:29:46.624 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-27T17:29:46.625 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-27T17:29:46.625 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-27T17:29:46.625 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-27T17:29:46.626 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-27T17:29:46.626 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-27T17:29:46.626 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-27T17:29:46.626 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-27T17:29:46.626 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-27T17:29:46.626 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-27T17:29:46.626 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-27T17:29:46.626 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-27T17:29:46.626 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-27T17:29:46.626 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-27T17:29:46.626 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-27T17:29:46.627 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-27T17:29:46.627 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-27T17:29:46.627 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-27T17:29:46.627 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-27T17:29:46.627 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-27T17:29:46.627 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-27T17:29:46.627 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-27T17:29:46.627 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-27T17:29:46.633 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-27T17:29:46.634 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-27T17:29:46.635 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-27T17:29:46.635 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-27T17:29:46.635 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-27T17:29:46.636 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-27T17:29:46.637 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-27T17:29:46.637 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-27T17:29:46.637 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-27T17:29:46.637 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-27T17:29:46.637 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-27T17:29:46.637 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-27T17:29:46.637 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-27T17:29:46.637 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-27T17:29:46.637 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-27T17:29:46.637 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-27T17:29:46.637 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-27T17:29:46.637 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-27T17:29:46.638 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-27T17:29:46.638 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-27T17:29:46.638 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-27T17:29:46.638 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-27T17:29:46.638 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-27T17:29:46.638 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-27T17:29:46.638 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-27T17:29:46.638 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-27T17:29:46.638 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-27T17:29:46.638 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-27T17:29:46.638 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-27T17:29:46.639 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-27T17:29:46.639 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-27T17:29:46.639 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-27T17:29:46.639 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-27T17:29:46.639 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-27T17:29:46.639 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-27T17:29:46.639 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-27T17:29:46.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-27T17:29:46.644 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-27T17:29:46.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-27T17:29:46.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-27T17:29:46.644 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-27T17:29:46.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-27T17:29:46.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-27T17:29:46.644 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-27T17:29:46.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-27T17:29:46.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-27T17:29:46.645 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-27T17:29:46.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-27T17:29:46.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-27T17:29:46.645 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-27T17:29:46.646 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-27T17:29:46.647 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-27T17:29:46.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-27T17:29:46.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-27T17:29:46.649 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-27T17:29:46.649 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-27T17:29:46.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-27T17:29:46.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-27T17:29:46.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-27T17:29:46.650 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-27T17:29:46.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-27T17:29:46.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-27T17:29:46.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-27T17:29:46.650 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-27T17:29:46.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-27T17:29:46.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-27T17:29:46.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-27T17:29:46.651 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-27T17:29:46.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-27T17:29:46.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-27T17:29:46.651 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-27T17:29:46.651 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-27T17:29:46.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-27T17:29:46.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-27T17:29:46.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-27T17:29:46.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-27T17:29:46.653 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-27T17:29:46.653 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-27T17:29:46.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-27T17:29:46.654 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-27T17:29:46.655 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-27T17:29:46.655 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-27T17:29:46.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-27T17:29:46.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-27T17:29:46.655 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-27T17:29:46.655 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-27T17:29:46.655 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-27T17:29:46.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-27T17:29:46.655 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-27T17:29:46.655 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-27T17:29:46.658 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-27T17:29:46.658 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-27T17:29:46.658 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-27T17:29:46.658 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-27T17:29:46.658 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-27T17:29:46.658 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-27T17:29:46.658 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-27T17:29:46.658 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-27T17:29:46.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-27T17:29:46.659 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-27T17:29:46.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-27T17:29:46.659 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-27T17:29:46.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-27T17:29:46.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-27T17:29:46.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-27T17:29:46.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-27T17:29:46.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-27T17:29:46.659 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-27T17:29:46.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-27T17:29:46.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-27T17:29:46.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-27T17:29:46.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-27T17:29:46.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-27T17:29:46.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-27T17:29:46.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-27T17:29:46.661 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-27T17:29:46.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-27T17:29:46.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-27T17:29:46.661 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-27T17:29:46.662 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-27T17:29:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-27T17:29:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-27T17:29:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-27T17:29:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-27T17:29:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-27T17:29:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-27T17:29:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-27T17:29:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-27T17:29:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-27T17:29:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-27T17:29:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-27T17:29:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-27T17:29:46.664 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-27T17:29:46.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-27T17:29:46.665 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-27T17:29:46.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-27T17:29:46.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-27T17:29:46.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-27T17:29:46.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-27T17:29:46.665 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-27T17:29:46.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-27T17:29:46.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-27T17:29:46.666 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-27T17:29:46.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-27T17:29:46.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-27T17:29:46.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-27T17:29:46.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-27T17:29:46.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-27T17:29:46.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-27T17:29:46.671 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-27T17:29:46.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-27T17:29:46.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-27T17:29:46.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-27T17:29:46.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-27T17:29:46.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-27T17:29:46.672 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-27T17:29:46.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-27T17:29:46.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-27T17:29:46.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-27T17:29:46.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-27T17:29:46.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-27T17:29:46.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-27T17:29:46.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-27T17:29:46.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-27T17:29:46.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-27T17:29:46.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-27T17:29:46.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-27T17:29:46.673 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-27T17:29:46.674 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-27T17:29:46.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-27T17:29:46.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-27T17:29:46.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-27T17:29:46.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-27T17:29:46.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-27T17:29:46.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-27T17:29:46.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-27T17:29:46.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-27T17:29:46.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-27T17:29:46.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-27T17:29:46.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-27T17:29:46.675 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-27T17:29:46.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-27T17:29:46.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-27T17:29:46.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-27T17:29:46.676 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-27T17:29:46.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-27T17:29:46.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-27T17:29:46.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-27T17:29:46.677 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-27T17:29:46.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-27T17:29:46.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-27T17:29:46.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-27T17:29:46.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-27T17:29:46.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-27T17:29:46.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-27T17:29:46.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-27T17:29:46.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-27T17:29:46.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-27T17:29:46.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-27T17:29:46.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-27T17:29:46.678 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-27T17:29:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-27T17:29:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-27T17:29:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-27T17:29:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-27T17:29:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-27T17:29:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-27T17:29:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-27T17:29:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-27T17:29:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-27T17:29:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-27T17:29:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-27T17:29:46.679 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-27T17:29:46.680 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-27T17:29:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-27T17:29:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-27T17:29:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-27T17:29:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-27T17:29:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-27T17:29:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-27T17:29:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-27T17:29:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-27T17:29:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-27T17:29:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-27T17:29:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-27T17:29:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-27T17:29:46.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-27T17:29:46.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-27T17:29:46.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-27T17:29:46.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-27T17:29:46.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-27T17:29:46.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-27T17:29:46.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-27T17:29:46.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-27T17:29:46.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-27T17:29:46.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-27T17:29:46.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-27T17:29:46.682 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-27T17:29:46.683 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-27T17:29:46.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-27T17:29:46.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-27T17:29:46.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-27T17:29:46.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-27T17:29:46.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-27T17:29:46.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-27T17:29:46.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-27T17:29:46.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-27T17:29:46.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-27T17:29:46.684 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-27T17:29:46.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-27T17:29:46.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-27T17:29:46.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-27T17:29:46.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-27T17:29:46.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-27T17:29:46.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-27T17:29:46.685 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-27T17:29:46.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-27T17:29:46.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-27T17:29:46.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-27T17:29:46.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-27T17:29:46.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-27T17:29:46.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-27T17:29:46.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-27T17:29:46.686 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-27T17:29:46.687 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-27T17:29:46.688 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-27T17:29:46.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-27T17:29:46.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-27T17:29:46.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-27T17:29:46.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-27T17:29:46.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-27T17:29:46.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-27T17:29:46.689 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-27T17:29:46.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-27T17:29:46.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-27T17:29:46.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-27T17:29:46.689 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-27T17:29:46.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-27T17:29:46.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-27T17:29:46.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-27T17:29:46.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-27T17:29:46.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-27T17:29:46.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-27T17:29:46.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-27T17:29:46.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-27T17:29:46.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-27T17:29:46.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-27T17:29:46.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-27T17:29:46.690 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-27T17:29:46.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-27T17:29:46.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-27T17:29:46.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-27T17:29:46.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-27T17:29:46.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-27T17:29:46.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-27T17:29:46.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-27T17:29:46.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-27T17:29:46.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-27T17:29:46.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-27T17:29:46.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-27T17:29:46.691 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-27T17:29:46.692 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-27T17:29:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-27T17:29:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-27T17:29:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-27T17:29:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-27T17:29:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-27T17:29:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-27T17:29:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-27T17:29:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-27T17:29:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-27T17:29:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-27T17:29:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-27T17:29:46.693 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-27T17:29:46.694 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-27T17:29:46.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-27T17:29:46.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-27T17:29:46.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-27T17:29:46.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-27T17:29:46.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-27T17:29:46.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-27T17:29:46.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-27T17:29:46.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-27T17:29:46.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-27T17:29:46.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-27T17:29:46.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-27T17:29:46.695 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-27T17:29:46.696 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-27T17:29:46.697 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-27T17:29:46.698 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-27T17:29:46.698 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-27T17:29:46.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-27T17:29:46.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-27T17:29:46.698 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-27T17:29:46.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-27T17:29:46.699 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-27T17:29:46.702 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-27T17:29:46.702 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-27T17:29:46.702 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-27T17:29:46.702 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-27T17:29:46.702 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-27T17:29:46.703 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-27T17:29:46.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-27T17:29:46.703 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-27T17:29:46.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-27T17:29:46.703 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-27T17:29:46.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-27T17:29:46.703 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-27T17:29:46.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-27T17:29:46.703 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-27T17:29:46.703 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-27T17:29:46.704 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-27T17:29:46.704 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-27T17:29:46.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-27T17:29:46.704 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-27T17:29:46.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-27T17:29:46.704 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-27T17:29:46.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-27T17:29:46.704 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-27T17:29:46.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-27T17:29:46.704 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-27T17:29:46.704 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-27T17:29:46.704 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-27T17:29:46.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-27T17:29:46.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-27T17:29:46.705 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-27T17:29:46.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-27T17:29:46.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-27T17:29:46.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-27T17:29:46.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-27T17:29:46.705 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-27T17:29:46.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-27T17:29:46.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-27T17:29:46.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-27T17:29:46.705 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-27T17:29:46.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-27T17:29:46.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-27T17:29:46.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-27T17:29:46.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-27T17:29:46.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-27T17:29:46.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-27T17:29:46.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-27T17:29:46.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-27T17:29:46.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-27T17:29:46.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-27T17:29:46.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-27T17:29:46.706 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-27T17:29:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-27T17:29:46.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-27T17:29:46.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-27T17:29:46.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-27T17:29:46.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-27T17:29:46.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-27T17:29:46.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-27T17:29:46.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-27T17:29:46.708 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-27T17:29:46.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-27T17:29:46.708 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-27T17:29:46.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-27T17:29:46.708 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-27T17:29:46.709 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-27T17:29:46.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-27T17:29:46.710 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-27T17:29:46.711 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-27T17:29:46.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-27T17:29:46.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-27T17:29:46.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-27T17:29:46.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-27T17:29:46.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-27T17:29:46.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-27T17:29:46.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-27T17:29:46.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-27T17:29:46.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-27T17:29:46.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-27T17:29:46.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-27T17:29:46.712 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-27T17:29:46.713 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-27T17:29:46.714 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-27T17:29:46.715 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-27T17:29:46.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-27T17:29:46.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-27T17:29:46.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-27T17:29:46.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-27T17:29:46.716 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-27T17:29:46.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-27T17:29:46.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-27T17:29:46.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-27T17:29:46.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-27T17:29:46.716 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-27T17:29:46.716 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-27T17:29:46.717 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-27T17:29:46.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-27T17:29:46.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-27T17:29:46.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-27T17:29:46.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-27T17:29:46.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-27T17:29:46.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-27T17:29:46.717 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-27T17:29:46.718 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-27T17:29:46.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-27T17:29:46.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-27T17:29:46.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-27T17:29:46.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-27T17:29:46.718 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-27T17:29:46.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-27T17:29:46.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-27T17:29:46.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-27T17:29:46.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-27T17:29:46.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-27T17:29:46.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-27T17:29:46.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-27T17:29:46.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-27T17:29:46.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-27T17:29:46.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-27T17:29:46.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-27T17:29:46.719 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-27T17:29:46.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-27T17:29:46.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-27T17:29:46.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-27T17:29:46.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-27T17:29:46.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-27T17:29:46.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-27T17:29:46.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-27T17:29:46.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-27T17:29:46.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-27T17:29:46.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-27T17:29:46.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-27T17:29:46.720 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-27T17:29:46.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-27T17:29:46.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-27T17:29:46.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-27T17:29:46.721 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-27T17:29:46.721 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-27T17:29:46.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-27T17:29:46.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-27T17:29:46.722 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-27T17:29:46.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-27T17:29:46.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-27T17:29:46.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-27T17:29:46.722 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-27T17:29:46.722 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-27T17:29:46.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-27T17:29:46.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-27T17:29:46.723 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-27T17:29:46.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-27T17:29:46.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-27T17:29:46.723 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-27T17:29:46.725 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-27T17:29:46.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-27T17:29:46.725 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-27T17:29:46.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-27T17:29:46.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-27T17:29:46.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-27T17:29:46.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-27T17:29:46.725 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-27T17:29:46.725 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-27T17:29:46.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-27T17:29:46.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-27T17:29:46.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-27T17:29:46.726 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-27T17:29:46.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-27T17:29:46.726 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-27T17:29:46.727 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-27T17:29:46.728 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-27T17:29:46.729 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-27T17:29:46.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-27T17:29:46.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-27T17:29:46.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-27T17:29:46.729 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-27T17:29:46.729 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-27T17:29:46.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-27T17:29:46.729 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-27T17:29:46.738 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-27T17:29:46.738 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-27T17:29:46.738 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-27T17:29:46.738 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-27T17:29:46.738 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-27T17:29:46.738 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-27T17:29:46.738 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-27T17:29:46.738 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-27T17:29:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-27T17:29:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-27T17:29:46.741 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-27T17:29:46.742 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-27T17:29:46.742 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-27T17:29:46.742 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-27T17:29:46.742 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-27T17:29:46.742 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-27T17:29:46.742 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-27T17:29:46.742 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-27T17:29:46.742 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-27T17:29:46.742 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-27T17:29:46.742 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-27T17:29:46.742 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-27T17:29:46.742 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-27T17:29:46.743 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-27T17:29:46.743 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-27T17:29:46.743 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-27T17:29:46.743 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-27T17:29:46.744 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-27T17:29:46.744 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-27T17:29:46.744 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-27T17:29:46.744 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-27T17:29:46.749 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-27T17:29:46.749 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-27T17:29:46.749 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-27T17:29:46.749 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-27T17:29:46.750 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-27T17:29:46.751 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-27T17:29:46.752 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-27T17:29:46.753 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-27T17:29:46.754 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-27T17:29:46.755 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-27T17:29:46.755 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-27T17:29:46.755 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-27T17:29:46.755 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-27T17:29:46.755 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-27T17:29:46.755 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-27T17:29:46.755 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-27T17:29:46.755 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-27T17:29:46.756 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-27T17:29:46.756 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-27T17:29:46.756 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-27T17:29:46.757 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-27T17:29:46.757 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-27T17:29:46.758 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-27T17:29:46.758 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-27T17:29:46.758 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-27T17:29:46.758 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-27T17:29:46.762 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-27T17:29:46.763 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-27T17:29:46.763 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-27T17:29:46.763 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-27T17:29:46.764 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-27T17:29:46.764 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-27T17:29:46.764 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-27T17:29:46.764 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-27T17:29:46.765 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-27T17:29:46.765 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-27T17:29:46.766 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-27T17:29:46.766 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-27T17:29:46.766 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-27T17:29:46.767 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-27T17:29:46.767 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-27T17:29:46.767 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-27T17:29:46.768 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-27T17:29:46.768 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-27T17:29:46.768 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-27T17:29:46.769 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-27T17:29:46.769 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-27T17:29:46.769 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-27T17:29:46.769 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-27T17:29:46.769 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-27T17:29:46.770 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-27T17:29:46.770 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-27T17:29:46.770 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-27T17:29:46.771 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-27T17:29:46.771 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-27T17:29:46.771 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-27T17:29:46.771 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-27T17:29:46.771 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-27T17:29:46.772 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-27T17:29:46.772 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-27T17:29:46.772 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-27T17:29:46.773 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-27T17:29:46.773 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-27T17:29:46.773 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-27T17:29:46.773 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-27T17:29:46.774 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-27T17:29:46.774 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-27T17:29:46.774 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-27T17:29:46.775 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-27T17:29:46.775 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-27T17:29:46.775 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-27T17:29:46.775 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-27T17:29:46.776 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-27T17:29:46.776 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-27T17:29:46.776 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-27T17:29:46.776 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-27T17:29:46.776 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-27T17:29:46.777 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-27T17:29:46.777 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-27T17:29:46.777 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-27T17:29:46.778 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-27T17:29:46.778 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-27T17:29:46.778 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-27T17:29:46.779 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-27T17:29:46.779 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-27T17:29:46.779 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-27T17:29:46.779 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-27T17:29:46.780 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-27T17:29:46.780 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-27T17:29:46.781 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-27T17:29:46.781 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-27T17:29:46.781 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-27T17:29:46.781 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-27T17:29:46.782 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-27T17:29:46.782 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-27T17:29:46.783 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-27T17:29:46.783 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-27T17:29:46.783 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-27T17:29:46.783 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-27T17:29:46.784 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-27T17:29:46.784 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-27T17:29:46.784 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-27T17:29:46.784 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-27T17:29:46.785 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-27T17:29:46.785 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-27T17:29:46.785 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-27T17:29:46.785 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-27T17:29:46.786 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-27T17:29:46.786 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-27T17:29:46.786 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-27T17:29:46.786 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-27T17:29:46.787 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-27T17:29:46.787 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-27T17:29:46.787 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-27T17:29:46.787 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-27T17:29:46.788 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-27T17:29:46.788 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-27T17:29:46.788 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-27T17:29:46.789 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-27T17:29:46.789 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-27T17:29:46.789 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-27T17:29:46.790 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-27T17:29:46.790 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-27T17:29:46.790 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-27T17:29:46.790 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-27T17:29:46.791 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-27T17:29:46.791 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-27T17:29:46.791 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-27T17:29:46.791 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-27T17:29:46.792 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-27T17:29:46.792 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-27T17:29:46.793 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-27T17:29:46.793 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-27T17:29:46.793 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-27T17:29:46.793 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-27T17:29:46.794 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-27T17:29:46.798 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-27T17:29:46.798 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-27T17:29:46.798 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-27T17:29:46.798 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-27T17:29:46.799 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-27T17:29:46.805 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-27T17:29:46.805 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-27T17:29:46.805 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-27T17:29:46.805 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-27T17:29:46.806 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-27T17:29:46.806 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-27T17:29:46.806 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-27T17:29:46.806 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-27T17:29:46.807 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-27T17:29:46.807 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-27T17:29:46.810 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-27T17:29:46.810 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-27T17:29:46.810 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-27T17:29:46.810 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-27T17:29:46.811 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-27T17:29:46.811 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-27T17:29:46.811 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-27T17:29:46.811 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-27T17:29:46.813 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-27T17:29:46.825 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-27T17:29:46.825 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-27T17:29:46.825 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-27T17:29:46.825 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-27T17:29:46.825 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-27T17:29:46.825 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-27T17:29:46.825 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-27T17:29:46.825 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-27T17:29:46.826 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-27T17:29:46.826 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-27T17:29:46.827 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-27T17:29:46.828 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-27T17:29:46.828 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-27T17:29:46.828 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-27T17:29:46.828 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-27T17:29:46.828 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-27T17:29:46.828 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-27T17:29:46.828 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-27T17:29:46.828 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-27T17:29:46.828 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-27T17:29:46.828 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-27T17:29:46.829 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-27T17:29:46.829 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-27T17:29:46.829 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-27T17:29:46.829 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-27T17:29:46.829 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-27T17:29:46.829 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-27T17:29:46.829 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-27T17:29:46.829 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-27T17:29:46.829 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-27T17:29:46.829 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-27T17:29:46.829 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-27T17:29:46.829 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-27T17:29:46.830 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-27T17:29:46.830 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-27T17:29:46.830 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-27T17:29:46.830 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-27T17:29:46.830 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-27T17:29:46.830 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-27T17:29:46.830 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-27T17:29:46.830 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-27T17:29:46.830 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-27T17:29:46.830 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-27T17:29:46.830 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-27T17:29:46.830 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-27T17:29:46.831 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-27T17:29:46.831 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-27T17:29:46.831 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-27T17:29:46.831 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-27T17:29:46.831 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-27T17:29:46.831 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-27T17:29:46.831 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-27T17:29:46.831 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-27T17:29:46.831 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-27T17:29:46.831 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-27T17:29:46.832 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-27T17:29:46.832 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-27T17:29:46.832 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-27T17:29:46.832 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-27T17:29:46.832 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-27T17:29:46.832 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-27T17:29:46.832 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-27T17:29:46.832 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-27T17:29:46.833 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-27T17:29:46.833 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-27T17:29:46.833 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-27T17:29:46.833 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-27T17:29:46.833 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-27T17:29:46.833 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-27T17:29:46.833 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-27T17:29:46.833 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-27T17:29:46.833 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-27T17:29:46.833 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-27T17:29:46.833 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-27T17:29:46.834 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-27T17:29:46.834 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-27T17:29:46.834 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-27T17:29:46.834 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-27T17:29:46.834 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-27T17:29:46.834 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-27T17:29:46.834 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-27T17:29:46.835 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-27T17:29:46.835 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-27T17:29:46.835 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-27T17:29:46.835 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-27T17:29:46.835 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-27T17:29:46.835 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-27T17:29:46.835 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-27T17:29:46.835 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-27T17:29:46.835 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-27T17:29:46.835 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-27T17:29:46.836 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-27T17:29:46.836 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-27T17:29:46.836 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-27T17:29:46.836 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-27T17:29:46.836 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-27T17:29:46.836 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-27T17:29:46.836 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-27T17:29:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-27T17:29:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-27T17:29:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-27T17:29:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-27T17:29:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-27T17:29:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-27T17:29:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-27T17:29:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-27T17:29:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-27T17:29:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-27T17:29:46.837 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-27T17:29:46.838 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-27T17:29:46.838 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-27T17:29:46.838 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-27T17:29:46.838 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-27T17:29:46.838 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-27T17:29:46.838 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-27T17:29:46.838 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-27T17:29:46.838 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-27T17:29:46.838 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-27T17:29:46.838 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-27T17:29:46.839 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-27T17:29:46.839 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-27T17:29:46.839 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-27T17:29:46.840 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-27T17:29:46.840 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-27T17:29:46.840 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-27T17:29:46.840 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-27T17:29:46.840 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-27T17:29:46.840 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-27T17:29:46.840 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-27T17:29:46.840 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-27T17:29:46.840 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-27T17:29:46.840 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-27T17:29:46.840 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-27T17:29:46.841 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-27T17:29:46.841 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-27T17:29:46.841 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-27T17:29:46.841 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-27T17:29:46.841 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-27T17:29:46.841 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-27T17:29:46.841 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-27T17:29:46.841 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-27T17:29:46.841 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-27T17:29:46.841 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-27T17:29:46.841 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-27T17:29:46.842 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-27T17:29:46.842 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-27T17:29:46.842 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-27T17:29:46.842 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-27T17:29:46.842 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-27T17:29:46.842 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-27T17:29:46.842 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-27T17:29:46.842 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-27T17:29:46.842 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-27T17:29:46.842 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-27T17:29:46.843 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-27T17:29:46.843 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-27T17:29:46.843 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-27T17:29:46.843 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-27T17:29:46.843 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-27T17:29:46.843 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-27T17:29:46.843 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-27T17:29:46.843 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-27T17:29:46.843 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-27T17:29:46.843 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-27T17:29:46.843 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-27T17:29:46.843 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-27T17:29:46.844 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-27T17:29:46.845 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-27T17:29:46.845 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-27T17:29:46.845 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-27T17:29:46.845 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-27T17:29:46.845 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-27T17:29:46.845 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-27T17:29:46.845 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-27T17:29:46.845 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-27T17:29:46.845 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-27T17:29:46.845 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-27T17:29:46.845 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-27T17:29:46.845 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-27T17:29:46.846 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-27T17:29:46.846 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-27T17:29:46.846 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-27T17:29:46.846 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-27T17:29:46.846 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-27T17:29:46.846 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-27T17:29:46.846 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-27T17:29:46.846 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-27T17:29:46.846 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-27T17:29:46.846 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-27T17:29:46.846 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-27T17:29:46.847 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-27T17:29:46.848 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-27T17:29:46.848 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-27T17:29:46.848 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-27T17:29:46.848 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-27T17:29:46.848 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-27T17:29:46.848 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-27T17:29:46.848 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-27T17:29:46.848 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-27T17:29:46.849 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-27T17:29:46.849 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-27T17:29:46.849 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-27T17:29:46.849 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-27T17:29:46.849 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-27T17:29:46.849 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-27T17:29:46.849 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-27T17:29:46.849 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-27T17:29:46.849 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-27T17:29:46.849 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-27T17:29:46.849 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-27T17:29:46.850 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-27T17:29:46.850 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-27T17:29:46.850 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-27T17:29:46.850 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-27T17:29:46.850 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-27T17:29:46.850 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-27T17:29:46.850 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-27T17:29:46.850 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-27T17:29:46.850 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-27T17:29:46.850 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-27T17:29:46.850 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-27T17:29:46.851 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-27T17:29:46.852 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-27T17:29:46.852 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-27T17:29:46.852 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-27T17:29:46.852 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-27T17:29:46.852 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-27T17:29:46.852 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-27T17:29:46.852 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-27T17:29:46.852 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-27T17:29:46.853 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-27T17:29:46.853 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-27T17:29:46.853 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-27T17:29:46.853 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-27T17:29:46.853 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-27T17:29:46.853 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-27T17:29:46.853 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-27T17:29:46.853 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-27T17:29:46.853 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-27T17:29:46.853 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-27T17:29:46.854 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-27T17:29:46.854 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-27T17:29:46.854 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-27T17:29:46.854 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-27T17:29:46.854 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-27T17:29:46.854 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-27T17:29:46.854 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-27T17:29:46.854 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-27T17:29:46.854 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-27T17:29:46.854 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-27T17:29:46.854 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-27T17:29:46.855 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-27T17:29:46.855 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-27T17:29:46.855 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-27T17:29:46.855 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-27T17:29:46.855 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-27T17:29:46.855 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-27T17:29:46.855 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-27T17:29:46.855 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-27T17:29:46.855 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-27T17:29:46.855 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-27T17:29:46.855 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-27T17:29:46.855 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-27T17:29:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-27T17:29:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-27T17:29:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-27T17:29:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-27T17:29:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-27T17:29:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-27T17:29:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-27T17:29:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-27T17:29:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-27T17:29:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-27T17:29:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-27T17:29:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-27T17:29:46.857 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-27T17:29:46.857 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-27T17:29:46.857 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-27T17:29:46.857 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-27T17:29:46.857 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-27T17:29:46.857 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-27T17:29:46.857 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-27T17:29:46.858 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-27T17:29:46.858 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-27T17:29:46.858 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-27T17:29:46.858 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-27T17:29:46.858 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-27T17:29:46.858 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-27T17:29:46.858 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-27T17:29:46.859 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-27T17:29:46.860 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-27T17:29:46.861 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-27T17:29:46.861 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-27T17:29:46.861 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-27T17:29:46.861 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-27T17:29:46.861 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-27T17:29:46.861 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-27T17:29:46.861 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-27T17:29:46.861 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-27T17:29:46.861 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-27T17:29:46.861 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-27T17:29:46.861 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-27T17:29:46.861 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-27T17:29:46.862 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-27T17:29:46.862 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-27T17:29:46.862 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-27T17:29:46.862 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-27T17:29:46.862 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-27T17:29:46.862 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-27T17:29:46.862 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-27T17:29:46.862 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-27T17:29:46.862 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-27T17:29:46.862 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-27T17:29:46.862 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-27T17:29:46.862 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-27T17:29:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-27T17:29:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-27T17:29:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-27T17:29:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-27T17:29:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-27T17:29:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-27T17:29:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-27T17:29:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-27T17:29:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-27T17:29:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-27T17:29:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-27T17:29:46.863 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-27T17:29:46.864 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-27T17:29:46.864 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-27T17:29:46.864 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-27T17:29:46.864 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-27T17:29:46.865 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-27T17:29:46.865 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-27T17:29:46.865 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-27T17:29:46.865 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-27T17:29:46.865 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-27T17:29:46.865 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-27T17:29:46.865 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-27T17:29:46.865 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-27T17:29:46.865 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-27T17:29:46.865 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-27T17:29:46.865 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-27T17:29:46.865 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-27T17:29:46.866 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-27T17:29:46.866 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-27T17:29:46.866 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-27T17:29:46.866 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-27T17:29:46.866 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-27T17:29:46.866 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-27T17:29:46.866 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-27T17:29:46.866 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-27T17:29:46.866 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-27T17:29:46.866 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-27T17:29:46.866 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-27T17:29:46.867 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-27T17:29:46.867 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-27T17:29:46.867 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-27T17:29:46.867 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-27T17:29:46.867 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-27T17:29:46.867 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-27T17:29:46.867 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-27T17:29:46.867 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-27T17:29:46.867 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-27T17:29:46.867 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-27T17:29:46.867 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-27T17:29:46.868 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-27T17:29:46.868 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-27T17:29:46.868 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-27T17:29:46.868 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-27T17:29:46.868 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-27T17:29:46.868 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-27T17:29:46.868 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-27T17:29:46.869 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-27T17:29:46.869 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-27T17:29:46.869 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-27T17:29:46.869 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-27T17:29:46.869 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-27T17:29:46.869 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-27T17:29:46.869 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-27T17:29:46.869 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-27T17:29:46.869 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-27T17:29:46.869 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-27T17:29:46.869 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-27T17:29:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-27T17:29:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-27T17:29:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-27T17:29:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-27T17:29:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-27T17:29:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-27T17:29:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-27T17:29:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-27T17:29:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-27T17:29:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-27T17:29:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-27T17:29:46.870 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-27T17:29:46.871 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-27T17:29:46.872 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-27T17:29:46.872 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-27T17:29:46.872 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-27T17:29:46.872 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-27T17:29:46.872 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-27T17:29:46.872 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-27T17:29:46.872 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-27T17:29:46.872 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-27T17:29:46.872 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-27T17:29:46.872 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-27T17:29:46.872 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-27T17:29:46.872 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-27T17:29:46.873 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-27T17:29:46.874 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-27T17:29:46.874 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-27T17:29:46.874 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-27T17:29:46.874 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-27T17:29:46.874 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-27T17:29:46.874 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-27T17:29:46.874 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-27T17:29:46.874 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-27T17:29:46.874 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-27T17:29:46.874 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-27T17:29:46.875 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-27T17:29:46.875 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-27T17:29:46.875 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-27T17:29:46.875 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-27T17:29:46.875 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-27T17:29:46.875 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-27T17:29:46.875 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-27T17:29:46.875 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-27T17:29:46.875 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-27T17:29:46.878 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-27T17:29:46.878 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-27T17:29:46.879 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-27T17:29:46.879 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-27T17:29:46.880 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-27T17:29:46.880 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-27T17:29:46.880 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-27T17:29:46.881 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-27T17:29:46.881 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-27T17:29:46.881 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-27T17:29:46.881 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-27T17:29:46.882 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-27T17:29:46.882 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-27T17:29:46.882 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-27T17:29:46.882 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-27T17:29:46.883 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-27T17:29:46.883 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-27T17:29:46.883 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-27T17:29:46.883 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-27T17:29:46.884 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-27T17:29:46.884 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-27T17:29:46.884 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-27T17:29:46.884 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-27T17:29:46.885 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-27T17:29:46.885 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-27T17:29:46.885 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-27T17:29:46.885 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-27T17:29:46.886 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-27T17:29:46.886 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-27T17:29:46.886 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-27T17:29:46.886 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-27T17:29:46.887 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-27T17:29:46.887 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-27T17:29:46.887 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-27T17:29:46.887 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-27T17:29:46.888 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-27T17:29:46.888 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-27T17:29:46.888 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-27T17:29:46.888 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-27T17:29:46.889 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-27T17:29:46.889 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-27T17:29:46.889 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-27T17:29:46.889 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-27T17:29:46.890 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-27T17:29:46.890 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-27T17:29:46.891 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-27T17:29:46.891 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-27T17:29:46.891 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-27T17:29:46.891 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-27T17:29:46.892 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-27T17:29:46.892 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-27T17:29:46.892 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-27T17:29:46.892 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-27T17:29:46.893 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-27T17:29:46.893 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-27T17:29:46.893 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-27T17:29:46.893 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-27T17:29:46.894 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-27T17:29:46.894 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-27T17:29:46.894 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-27T17:29:46.894 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-27T17:29:46.895 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-27T17:29:46.895 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-27T17:29:46.895 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-27T17:29:46.895 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-27T17:29:46.896 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-27T17:29:46.896 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-27T17:29:46.896 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-27T17:29:46.896 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-27T17:29:46.897 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-27T17:29:46.897 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-27T17:29:46.897 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-27T17:29:46.897 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-27T17:29:46.898 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-27T17:29:46.898 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-27T17:29:46.898 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-27T17:29:46.898 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-27T17:29:46.899 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-27T17:29:46.899 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-27T17:29:46.899 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-27T17:29:46.899 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-27T17:29:46.899 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-27T17:29:46.900 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-27T17:29:46.900 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-27T17:29:46.900 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-27T17:29:46.901 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-27T17:29:46.901 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-27T17:29:46.901 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-27T17:29:46.902 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-27T17:29:46.902 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-27T17:29:46.902 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-27T17:29:46.902 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-27T17:29:46.903 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-27T17:29:46.903 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-27T17:29:46.903 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-27T17:29:46.903 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-27T17:29:46.904 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-27T17:29:46.904 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-27T17:29:46.904 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-27T17:29:46.904 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-27T17:29:46.905 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-27T17:29:46.905 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-27T17:29:46.905 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-27T17:29:46.905 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-27T17:29:46.906 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-27T17:29:46.906 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-27T17:29:46.906 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-27T17:29:46.906 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-27T17:29:46.907 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-27T17:29:46.907 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-27T17:29:46.907 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-27T17:29:46.907 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-27T17:29:46.908 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-27T17:29:46.908 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-27T17:29:46.908 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-27T17:29:46.908 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-27T17:29:46.909 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-27T17:29:46.909 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-27T17:29:46.909 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-27T17:29:46.909 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-27T17:29:46.910 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-27T17:29:46.910 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-27T17:29:46.910 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-27T17:29:46.910 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-27T17:29:46.911 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-27T17:29:46.911 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-27T17:29:46.912 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-27T17:29:46.912 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-27T17:29:46.912 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-27T17:29:46.912 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-27T17:29:46.913 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-27T17:29:46.913 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-27T17:29:46.913 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-27T17:29:46.913 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-27T17:29:46.914 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-27T17:29:46.914 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-27T17:29:46.914 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-27T17:29:46.914 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-27T17:29:46.915 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-27T17:29:46.915 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-27T17:29:46.915 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-27T17:29:46.915 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-27T17:29:46.916 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-27T17:29:46.916 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-27T17:29:46.916 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-27T17:29:46.916 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-27T17:29:46.917 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-27T17:29:46.917 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-27T17:29:46.917 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-27T17:29:46.917 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-27T17:29:46.917 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-27T17:29:46.918 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-27T17:29:46.918 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-27T17:29:46.918 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-27T17:29:46.918 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-27T17:29:46.919 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-27T17:29:46.919 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-27T17:29:46.919 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-27T17:29:46.919 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-27T17:29:46.920 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-27T17:29:46.920 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-27T17:29:46.920 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-27T17:29:46.920 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-27T17:29:46.921 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-27T17:29:46.921 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-27T17:29:46.921 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-27T17:29:46.922 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-27T17:29:46.922 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-27T17:29:46.922 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-27T17:29:46.923 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-27T17:29:46.923 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-27T17:29:46.923 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-27T17:29:46.923 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-27T17:29:46.924 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-27T17:29:46.924 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-27T17:29:46.924 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-27T17:29:46.924 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-27T17:29:46.925 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-27T17:29:46.925 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-27T17:29:46.925 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-27T17:29:46.925 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-27T17:29:46.926 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-27T17:29:46.926 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-27T17:29:46.926 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-27T17:29:46.926 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-27T17:29:46.927 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-27T17:29:46.927 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-27T17:29:46.927 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-27T17:29:46.927 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-27T17:29:46.928 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-27T17:29:46.928 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-27T17:29:46.928 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-27T17:29:46.928 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-27T17:29:46.929 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-27T17:29:46.929 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-27T17:29:46.929 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-27T17:29:46.929 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-27T17:29:46.930 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-27T17:29:46.930 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-27T17:29:46.930 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-27T17:29:46.930 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-27T17:29:46.931 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-27T17:29:46.931 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-27T17:29:46.931 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-27T17:29:46.931 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-27T17:29:46.932 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-27T17:29:46.932 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-27T17:29:46.932 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-27T17:29:46.933 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-27T17:29:46.933 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-27T17:29:46.933 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-27T17:29:46.934 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-27T17:29:46.934 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-27T17:29:46.934 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-27T17:29:46.934 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-27T17:29:46.935 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-27T17:29:46.935 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-27T17:29:46.935 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-27T17:29:46.935 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-27T17:29:46.936 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-27T17:29:46.936 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-27T17:29:46.936 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-27T17:29:46.936 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-27T17:29:46.937 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-27T17:29:46.937 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-27T17:29:46.937 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-27T17:29:46.937 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-27T17:29:46.937 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-27T17:29:46.938 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-27T17:29:46.938 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-27T17:29:46.938 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-27T17:29:46.939 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-27T17:29:46.939 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-27T17:29:46.939 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-27T17:29:46.939 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-27T17:29:46.940 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-27T17:29:46.940 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-27T17:29:46.940 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-27T17:29:46.940 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-27T17:29:46.941 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-27T17:29:46.941 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-27T17:29:46.941 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-27T17:29:46.941 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-27T17:29:46.942 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-27T17:29:46.942 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-27T17:29:46.942 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-27T17:29:46.943 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-27T17:29:46.943 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-27T17:29:46.944 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-27T17:29:46.944 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-27T17:29:46.946 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-27T17:29:46.946 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-27T17:29:46.946 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-27T17:29:46.946 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-27T17:29:46.946 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-27T17:29:46.947 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-27T17:29:46.947 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-27T17:29:46.947 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-27T17:29:46.947 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-27T17:29:46.947 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-27T17:29:46.947 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-27T17:29:46.947 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-27T17:29:46.947 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-27T17:29:46.947 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-27T17:29:46.947 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-27T17:29:46.947 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-27T17:29:46.948 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-27T17:29:46.948 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-27T17:29:46.948 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-27T17:29:46.948 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-27T17:29:46.948 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-27T17:29:46.948 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-27T17:29:46.949 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-27T17:29:46.949 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-27T17:29:46.949 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-27T17:29:46.949 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-27T17:29:46.949 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-27T17:29:46.949 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-27T17:29:46.949 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-27T17:29:46.949 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-27T17:29:46.949 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-27T17:29:46.949 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-27T17:29:46.950 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-27T17:29:46.950 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-27T17:29:46.950 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-27T17:29:46.950 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-27T17:29:46.950 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-27T17:29:46.950 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-27T17:29:46.950 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-27T17:29:46.950 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-27T17:29:46.950 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-27T17:29:46.950 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-27T17:29:46.950 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-27T17:29:46.950 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-27T17:29:46.951 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-27T17:29:46.951 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-27T17:29:46.952 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-27T17:29:46.952 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-27T17:29:46.952 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-27T17:29:46.952 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-27T17:29:46.952 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-27T17:29:46.952 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-27T17:29:46.952 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-27T17:29:46.952 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-27T17:29:46.953 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-27T17:29:46.953 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-27T17:29:46.953 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-27T17:29:46.953 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-27T17:29:46.953 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-27T17:29:46.953 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-27T17:29:46.953 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-27T17:29:46.953 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-27T17:29:46.953 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-27T17:29:46.953 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-27T17:29:46.954 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-27T17:29:46.955 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-27T17:29:46.956 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-27T17:29:46.957 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-27T17:29:46.957 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-27T17:29:46.957 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-27T17:29:46.957 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-27T17:29:46.957 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-27T17:29:46.957 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-27T17:29:46.957 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-27T17:29:46.957 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-27T17:29:46.957 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-27T17:29:46.957 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-27T17:29:46.958 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-27T17:29:46.958 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-27T17:29:46.958 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-27T17:29:46.958 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-27T17:29:46.958 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-27T17:29:46.958 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-27T17:29:46.958 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-27T17:29:46.958 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-27T17:29:46.958 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-27T17:29:46.958 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-27T17:29:46.959 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-27T17:29:46.959 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-27T17:29:46.959 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-27T17:29:46.959 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-27T17:29:46.959 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-27T17:29:46.959 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-27T17:29:46.959 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-27T17:29:46.959 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-27T17:29:46.959 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-27T17:29:46.959 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-27T17:29:46.959 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-27T17:29:46.960 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-27T17:29:46.961 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-27T17:29:46.961 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-27T17:29:46.961 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-27T17:29:46.961 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-27T17:29:46.961 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-27T17:29:46.961 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-27T17:29:46.961 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-27T17:29:46.961 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-27T17:29:46.961 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-27T17:29:46.962 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-27T17:29:46.962 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-27T17:29:46.962 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-27T17:29:46.962 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-27T17:29:46.962 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-27T17:29:46.962 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-27T17:29:46.962 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-27T17:29:46.962 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-27T17:29:46.962 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-27T17:29:46.963 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-27T17:29:46.963 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-27T17:29:46.963 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-27T17:29:46.963 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-27T17:29:46.963 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-27T17:29:46.963 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-27T17:29:46.963 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-27T17:29:46.963 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-27T17:29:46.963 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-27T17:29:46.964 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-27T17:29:46.964 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-27T17:29:46.964 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-27T17:29:46.964 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-27T17:29:46.964 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-27T17:29:46.964 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-27T17:29:46.964 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-27T17:29:46.964 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-27T17:29:46.964 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-27T17:29:46.964 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-27T17:29:46.964 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-27T17:29:46.964 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-27T17:29:46.965 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-27T17:29:46.966 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-27T17:29:46.966 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-27T17:29:46.966 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-27T17:29:46.966 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-27T17:29:46.966 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-27T17:29:46.966 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-27T17:29:46.966 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-27T17:29:46.966 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-27T17:29:46.966 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-27T17:29:46.967 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-27T17:29:46.967 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-27T17:29:46.967 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-27T17:29:46.967 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-27T17:29:46.967 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-27T17:29:46.967 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-27T17:29:46.967 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-27T17:29:46.967 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-27T17:29:46.967 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-27T17:29:46.967 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-27T17:29:46.968 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-27T17:29:46.968 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-27T17:29:46.968 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-27T17:29:46.968 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-27T17:29:46.968 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-27T17:29:46.968 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-27T17:29:46.968 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-27T17:29:46.969 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-27T17:29:46.969 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-27T17:29:46.969 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-27T17:29:46.969 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-27T17:29:46.969 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-27T17:29:46.969 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-27T17:29:46.969 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-27T17:29:46.969 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-27T17:29:46.969 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-27T17:29:46.969 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-27T17:29:46.969 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-27T17:29:46.970 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-27T17:29:46.970 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-27T17:29:46.970 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-27T17:29:46.970 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-27T17:29:46.970 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-27T17:29:46.970 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-27T17:29:46.970 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-27T17:29:46.971 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-27T17:29:46.972 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-27T17:29:46.973 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-27T17:29:46.973 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-27T17:29:46.973 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-27T17:29:46.973 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-27T17:29:46.973 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-27T17:29:46.973 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-27T17:29:46.974 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-27T17:29:46.974 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-27T17:29:46.974 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-27T17:29:46.974 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-27T17:29:46.974 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-27T17:29:46.974 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-27T17:29:46.974 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-27T17:29:46.974 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-27T17:29:46.974 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-27T17:29:46.974 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-27T17:29:46.974 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-27T17:29:46.975 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-27T17:29:46.975 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-27T17:29:46.975 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-27T17:29:46.975 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-27T17:29:46.975 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-27T17:29:46.975 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-27T17:29:46.975 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-27T17:29:46.975 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-27T17:29:46.975 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-27T17:29:46.975 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-27T17:29:46.975 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-27T17:29:46.975 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-27T17:29:46.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-27T17:29:46.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-27T17:29:46.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-27T17:29:46.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-27T17:29:46.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-27T17:29:46.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-27T17:29:46.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-27T17:29:46.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-27T17:29:46.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-27T17:29:46.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-27T17:29:46.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-27T17:29:46.976 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-27T17:29:46.977 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-27T17:29:46.978 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-27T17:29:46.978 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-27T17:29:46.986 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-27T17:29:46.986 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-27T17:29:46.986 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-27T17:29:46.986 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-27T17:29:46.986 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-27T17:29:46.986 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-27T17:29:46.986 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-27T17:29:46.986 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-27T17:29:46.987 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-27T17:29:46.987 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-27T17:29:46.988 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-27T17:29:46.988 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-27T17:29:46.989 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-27T17:29:46.989 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-27T17:29:46.989 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-27T17:29:46.989 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-27T17:29:46.989 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-27T17:29:46.990 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-27T17:29:46.990 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-27T17:29:46.990 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-27T17:29:46.990 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-27T17:29:46.990 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-27T17:29:46.990 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-27T17:29:46.990 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-27T17:29:46.990 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-27T17:29:46.990 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-27T17:29:46.990 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-27T17:29:46.990 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-27T17:29:46.990 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-27T17:29:46.991 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-27T17:29:46.992 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-27T17:29:46.992 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-27T17:29:46.992 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-27T17:29:46.992 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-27T17:29:46.992 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-27T17:29:46.992 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-27T17:29:46.992 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-27T17:29:46.992 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-27T17:29:46.992 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-27T17:29:46.992 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-27T17:29:46.992 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-27T17:29:46.993 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-27T17:29:46.994 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-27T17:29:46.994 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-27T17:29:46.994 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-27T17:29:46.994 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-27T17:29:46.994 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-27T17:29:46.994 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-27T17:29:46.994 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-27T17:29:46.994 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-27T17:29:46.994 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-27T17:29:46.994 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-27T17:29:46.995 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-27T17:29:46.995 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-27T17:29:46.995 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-27T17:29:46.995 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-27T17:29:46.995 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-27T17:29:46.995 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-27T17:29:46.995 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-27T17:29:46.995 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-27T17:29:46.995 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-27T17:29:46.995 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-27T17:29:46.995 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-27T17:29:46.996 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-27T17:29:46.997 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-27T17:29:46.998 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-27T17:29:46.998 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-27T17:29:46.998 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-27T17:29:46.998 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-27T17:29:46.998 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-27T17:29:46.998 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-27T17:29:46.998 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-27T17:29:46.998 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-27T17:29:46.998 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-27T17:29:46.999 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-27T17:29:46.999 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-27T17:29:46.999 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-27T17:29:46.999 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-27T17:29:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-27T17:29:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-27T17:29:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-27T17:29:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-27T17:29:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-27T17:29:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-27T17:29:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-27T17:29:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-27T17:29:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-27T17:29:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-27T17:29:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-27T17:29:47.000 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-27T17:29:47.001 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-27T17:29:47.002 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-27T17:29:47.002 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-27T17:29:47.002 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-27T17:29:47.002 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-27T17:29:47.002 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-27T17:29:47.002 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-27T17:29:47.002 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-27T17:29:47.002 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-27T17:29:47.002 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-27T17:29:47.002 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-27T17:29:47.002 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-27T17:29:47.002 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-27T17:29:47.003 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-27T17:29:47.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-27T17:29:47.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-27T17:29:47.004 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-27T17:29:47.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-27T17:29:47.004 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-27T17:29:47.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-27T17:29:47.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-27T17:29:47.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-27T17:29:47.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-27T17:29:47.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-27T17:29:47.004 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-27T17:29:47.004 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-27T17:29:47.005 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-27T17:29:47.006 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-27T17:29:47.006 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-27T17:29:47.006 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-27T17:29:47.006 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-27T17:29:47.006 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-27T17:29:47.006 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-27T17:29:47.006 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-27T17:29:47.006 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-27T17:29:47.006 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-27T17:29:47.006 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-27T17:29:47.006 INFO:teuthology.orchestra.run.smithi176.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-27T17:29:47.006 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-27T17:29:47.007 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-27T17:29:47.007 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-27T17:29:47.008 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-27T17:29:47.008 DEBUG:teuthology.orchestra.run.smithi176:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-27T17:29:47.018 INFO:teuthology.orchestra.run.smithi176.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-27T17:29:47.021 INFO:teuthology.orchestra.run.smithi176.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-27T17:29:47.021 INFO:teuthology.orchestra.run.smithi176.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-27T17:29:47.022 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-27T17:29:47.022 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-27T17:29:47.022 DEBUG:teuthology.orchestra.run.smithi176:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-27T17:29:47.069 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi176.front.sepia.ceph.com to complete... 2023-11-27T17:29:47.467 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub' 2023-11-27T17:29:47.468 INFO:teuthology.orchestra.run.smithi176.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-27T17:29:47.495 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2023-11-27T17:29:47.703 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-27T17:29:47.709 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-27T17:29:47.925 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-27T17:29:47.930 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-27T17:29:47.973 INFO:teuthology.orchestra.run.smithi176.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-27T17:29:47.978 INFO:teuthology.orchestra.run.smithi176.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-27T17:29:48.100 INFO:teuthology.orchestra.run.smithi176.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-27T17:29:48.100 INFO:teuthology.orchestra.run.smithi176.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-27T17:29:48.101 INFO:teuthology.orchestra.run.smithi176.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-27T17:29:48.119 INFO:teuthology.orchestra.run.smithi176.stderr:done 2023-11-27T17:30:19.208 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-27T17:30:19.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-27T17:30:19.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:30:37.538 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-11-27T17:30:46.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-27T17:30:46.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:30:49.602 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-11-27T17:31:01.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-27T17:31:01.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:31:20.036 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-11-27T17:31:35.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-27T17:31:35.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:31:35.423 DEBUG:teuthology.orchestra.run.smithi176:> true 2023-11-27T17:31:36.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-27T17:31:36.679 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-27T17:31:36.679 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2023-11-27T17:31:36.687 INFO:teuthology.orchestra.run.smithi176.stdout:6.6.0-g8247bbb5b470 2023-11-27T17:31:36.688 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-27T17:31:36.688 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-27T17:31:36.688 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-27T17:31:37.689 DEBUG:teuthology.parallel:result is None 2023-11-27T17:31:37.690 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-27T17:31:37.697 INFO:teuthology.task.internal:Creating test directory... 2023-11-27T17:31:37.697 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T17:31:37.700 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T17:31:37.704 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-27T17:31:37.714 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-27T17:31:37.722 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-27T17:31:37.734 INFO:teuthology.task.internal:Creating archive directory... 2023-11-27T17:31:37.734 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T17:31:37.753 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T17:31:37.755 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-27T17:31:37.784 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-27T17:31:37.790 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-27T17:31:37.791 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T17:31:37.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:31:37.826 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-27T17:31:37.835 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:31:37.837 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T17:31:37.873 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T17:31:37.881 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-27T17:31:37.914 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:31:37.921 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:31:37.926 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:31:37.932 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:31:38.322 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:31:38.339 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-27T17:31:38.342 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-27T17:31:38.356 INFO:teuthology.task.internal:Configuring sudo... 2023-11-27T17:31:38.357 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T17:31:38.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T17:31:38.362 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-27T17:31:38.385 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-27T17:31:38.403 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-27T17:31:38.404 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T17:31:38.415 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T17:31:38.421 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-27T17:31:38.439 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T17:31:38.468 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T17:31:38.515 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:31:38.515 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T17:31:38.581 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T17:31:38.588 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T17:31:38.636 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:31:38.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T17:31:38.707 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-27T17:31:38.716 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-27T17:31:38.773 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:31:38.773 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-27T17:31:38.851 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2023-11-27T17:31:38.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2023-11-27T17:31:38.861 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2023-11-27T17:31:38.983 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-27T17:31:38.993 INFO:teuthology.task.internal:Starting timer... 2023-11-27T17:31:38.993 INFO:teuthology.run_tasks:Running task pcp... 2023-11-27T17:31:39.007 INFO:teuthology.run_tasks:Running task selinux... 2023-11-27T17:31:39.018 DEBUG:teuthology.task.selinux:Excluding smithi031: OS 'ubuntu' does not support SELinux 2023-11-27T17:31:39.018 DEBUG:teuthology.task.selinux:Excluding smithi081: OS 'ubuntu' does not support SELinux 2023-11-27T17:31:39.018 DEBUG:teuthology.task.selinux:Excluding smithi176: OS 'ubuntu' does not support SELinux 2023-11-27T17:31:39.019 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-27T17:31:39.019 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-27T17:31:39.020 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-27T17:31:39.020 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-27T17:31:39.030 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-27T17:31:39.030 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-27T17:31:39.117 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-27T17:31:39.118 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi081.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-27T17:47:47.554 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2023-11-27T17:47:49.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-27T17:47:49.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:47:49.963 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-11-27T17:47:50.070 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-11-27T17:47:50.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-11-27T17:47:50.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:47:50.144 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-11-27T17:47:50.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-11-27T17:47:50.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-27T17:47:50.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-27T17:47:50.333 DEBUG:teuthology.orchestra.run.smithi176:> true 2023-11-27T17:47:50.445 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-27T17:47:50.446 INFO:teuthology.run_tasks:Running task clock... 2023-11-27T17:47:50.455 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-27T17:47:50.456 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T17:47:50.456 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T17:47:50.458 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T17:47:50.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T17:47:50.461 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-27T17:47:50.461 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-27T17:47:50.485 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-27T17:47:50.486 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: Command line: ntpd -gq 2023-11-27T17:47:50.486 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: ---------------------------------------------------- 2023-11-27T17:47:50.486 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: ntp-4 is maintained by Network Time Foundation, 2023-11-27T17:47:50.486 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-27T17:47:50.486 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: corporation. Support and training for ntp-4 are 2023-11-27T17:47:50.486 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: available at https://www.nwtime.org/support 2023-11-27T17:47:50.486 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: ---------------------------------------------------- 2023-11-27T17:47:50.487 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: proto: precision = 0.047 usec (-24) 2023-11-27T17:47:50.487 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: basedate set to 2022-02-04 2023-11-27T17:47:50.487 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: gps base set to 2022-02-06 (week 2196) 2023-11-27T17:47:50.487 INFO:teuthology.orchestra.run.smithi081.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-27T17:47:50.488 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-27T17:47:50.488 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: restrict ::: KOD does nothing without LIMITED. 2023-11-27T17:47:50.488 INFO:teuthology.orchestra.run.smithi081.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-27T17:47:50.489 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: Listen and drop on 0 v6wildcard [::]:123 2023-11-27T17:47:50.489 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-27T17:47:50.489 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: Listen normally on 2 lo 127.0.0.1:123 2023-11-27T17:47:50.489 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: Listen normally on 3 enp3s0f1 172.21.15.81:123 2023-11-27T17:47:50.489 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: Listen normally on 4 lo [::1]:123 2023-11-27T17:47:50.490 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d753%5]:123 2023-11-27T17:47:50.490 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:50 ntpd[28679]: Listening on routing socket on fd #22 for interface updates 2023-11-27T17:47:50.492 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-27T17:47:50.492 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: Command line: ntpd -gq 2023-11-27T17:47:50.492 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: ---------------------------------------------------- 2023-11-27T17:47:50.492 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: ntp-4 is maintained by Network Time Foundation, 2023-11-27T17:47:50.492 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-27T17:47:50.492 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: corporation. Support and training for ntp-4 are 2023-11-27T17:47:50.492 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: available at https://www.nwtime.org/support 2023-11-27T17:47:50.492 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: ---------------------------------------------------- 2023-11-27T17:47:50.492 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: proto: precision = 0.050 usec (-24) 2023-11-27T17:47:50.493 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: basedate set to 2022-02-04 2023-11-27T17:47:50.493 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: gps base set to 2022-02-06 (week 2196) 2023-11-27T17:47:50.493 INFO:teuthology.orchestra.run.smithi031.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-27T17:47:50.493 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-27T17:47:50.493 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: restrict ::: KOD does nothing without LIMITED. 2023-11-27T17:47:50.494 INFO:teuthology.orchestra.run.smithi031.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-27T17:47:50.495 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: Listen and drop on 0 v6wildcard [::]:123 2023-11-27T17:47:50.495 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-27T17:47:50.495 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: Listen normally on 2 lo 127.0.0.1:123 2023-11-27T17:47:50.495 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: Listen normally on 3 ens1f0 172.21.15.31:123 2023-11-27T17:47:50.495 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: Listen normally on 4 lo [::1]:123 2023-11-27T17:47:50.495 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:caba%4]:123 2023-11-27T17:47:50.495 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:50 ntpd[28620]: Listening on routing socket on fd #22 for interface updates 2023-11-27T17:47:50.525 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-27T17:47:50.525 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: Command line: ntpd -gq 2023-11-27T17:47:50.525 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: ---------------------------------------------------- 2023-11-27T17:47:50.526 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: ntp-4 is maintained by Network Time Foundation, 2023-11-27T17:47:50.526 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-27T17:47:50.526 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: corporation. Support and training for ntp-4 are 2023-11-27T17:47:50.526 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: available at https://www.nwtime.org/support 2023-11-27T17:47:50.526 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: ---------------------------------------------------- 2023-11-27T17:47:50.527 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: proto: precision = 0.041 usec (-24) 2023-11-27T17:47:50.527 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: basedate set to 2022-02-04 2023-11-27T17:47:50.527 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: gps base set to 2022-02-06 (week 2196) 2023-11-27T17:47:50.527 INFO:teuthology.orchestra.run.smithi176.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-27T17:47:50.527 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-27T17:47:50.528 INFO:teuthology.orchestra.run.smithi176.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-27T17:47:50.529 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: restrict ::: KOD does nothing without LIMITED. 2023-11-27T17:47:50.529 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: Listen and drop on 0 v6wildcard [::]:123 2023-11-27T17:47:50.529 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-27T17:47:50.529 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: Listen normally on 2 lo 127.0.0.1:123 2023-11-27T17:47:50.529 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: Listen normally on 3 enp3s0f1 172.21.15.176:123 2023-11-27T17:47:50.529 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: Listen normally on 4 lo [::1]:123 2023-11-27T17:47:50.529 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f61%5]:123 2023-11-27T17:47:50.529 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:50 ntpd[27976]: Listening on routing socket on fd #22 for interface updates 2023-11-27T17:47:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:51.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:51.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:51.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:51.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:51.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:51.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:51.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:51 ntpd[28679]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:51.488 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:51 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:51.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:51 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:52.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:52 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:52.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:52 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:52.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:52 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:52.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:52 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:52.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:52 ntpd[28620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:52.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:52 ntpd[28620]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:52.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:52 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:52.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:52 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:52.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:52 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:52.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:52 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:52.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:52 ntpd[27976]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:52.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:52 ntpd[27976]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:53 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:53 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:53 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:53 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:53 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:53 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:53 ntpd[28679]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:53 ntpd[28679]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:53 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:53 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:53 ntpd[28679]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:53 ntpd[28679]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:53 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:53 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:53 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:53 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:53 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:53 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:53 ntpd[28620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:53 ntpd[28620]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:53 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:53 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:53 ntpd[28620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:53 ntpd[28620]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:53.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:53 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:53.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:53 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:53.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:53 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:53.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:53 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:53.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:53 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:53.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:53 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:53.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:53 ntpd[27976]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:53.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:53 ntpd[27976]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:53.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:53 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:53.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:53 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:53.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:53 ntpd[27976]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:53.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:53 ntpd[27976]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:54.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:54 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:54.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:54 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:54.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:54 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:54.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:54 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:54.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:54 ntpd[28620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:54.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:54 ntpd[28620]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:54.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:54 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:54.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:54 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:54.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:54 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:54.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:54 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:54.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:54 ntpd[27976]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:54.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:54 ntpd[27976]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:55.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:55.489 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:55 ntpd[28679]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:55 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:55 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:55 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:55 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:55 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:55 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:55 ntpd[28620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:55.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:55 ntpd[28620]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:55.491 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:55 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.491 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:55 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.491 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:55 ntpd[28620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:55.491 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:55 ntpd[28620]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:55.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:55.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:55.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:55.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:55.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:55.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:55 ntpd[27976]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:56.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:56 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:56.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:56 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:56.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:56 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:56.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:56 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:56.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:56 ntpd[28620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:56.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:56 ntpd[28620]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:56.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:56 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:56.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:56 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:56.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:56 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:56.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:56 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:56.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:56 ntpd[27976]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:56.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:56 ntpd[27976]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:57.486 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:57 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:57.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:57 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:57.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:57 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:57.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:57 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:57.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:57 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:57.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:57 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:57.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:57 ntpd[28679]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:57.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:57 ntpd[28679]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:57.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:57 ntpd[28679]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:57.487 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:57 ntpd[28679]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:57.488 INFO:teuthology.orchestra.run.smithi081.stdout:27 Nov 17:47:57 ntpd[28679]: ntpd: time slew -0.005112 s 2023-11-27T17:47:57.488 INFO:teuthology.orchestra.run.smithi081.stdout:ntpd: time slew -0.005112s 2023-11-27T17:47:57.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:57 ntpd[28679]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-27T17:47:57.488 INFO:teuthology.orchestra.run.smithi081.stderr:27 Nov 17:47:57 ntpd[28679]: can't open /var/log/ntpstats/loopstats.20231127: Permission denied 2023-11-27T17:47:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:57 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:57 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:57 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:57.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:57 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:57 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:57 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:57 ntpd[28620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:57 ntpd[28620]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:57 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:57 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:57 ntpd[28620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:57.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:57 ntpd[28620]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:57.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:57 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:57.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:57 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:57.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:57 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:57.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:57 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:57.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:57 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:57.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:57 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:57.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:57 ntpd[27976]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:57.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:57 ntpd[27976]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:57.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:57 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:57.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:57 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:57.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:57 ntpd[27976]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:57.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:57 ntpd[27976]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:57.583 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2023-11-27T17:47:57.583 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2023-11-27T17:47:57.583 INFO:teuthology.orchestra.run.smithi081.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:47:57.583 INFO:teuthology.orchestra.run.smithi081.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:47:57.583 INFO:teuthology.orchestra.run.smithi081.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:47:57.584 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:47:58.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:58 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:58.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:58 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:58.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:58 ntpd[28620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:58.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:58 ntpd[28620]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:58.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:58 ntpd[28620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:58.489 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:58 ntpd[28620]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:58.490 INFO:teuthology.orchestra.run.smithi031.stdout:27 Nov 17:47:58 ntpd[28620]: ntpd: time slew -0.006626 s 2023-11-27T17:47:58.490 INFO:teuthology.orchestra.run.smithi031.stdout:ntpd: time slew -0.006626s 2023-11-27T17:47:58.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:58 ntpd[28620]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-27T17:47:58.490 INFO:teuthology.orchestra.run.smithi031.stderr:27 Nov 17:47:58 ntpd[28620]: can't open /var/log/ntpstats/loopstats.20231127: Permission denied 2023-11-27T17:47:58.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:58 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:58.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:58 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:58.526 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:58 ntpd[27976]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-27T17:47:58.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:58 ntpd[27976]: can't open /var/log/ntpstats/rawstats.20231127: Permission denied 2023-11-27T17:47:58.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:58 ntpd[27976]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-27T17:47:58.527 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:58 ntpd[27976]: can't open /var/log/ntpstats/peerstats.20231127: Permission denied 2023-11-27T17:47:58.527 INFO:teuthology.orchestra.run.smithi176.stdout:27 Nov 17:47:58 ntpd[27976]: ntpd: time slew -0.003323 s 2023-11-27T17:47:58.527 INFO:teuthology.orchestra.run.smithi176.stdout:ntpd: time slew -0.003323s 2023-11-27T17:47:58.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:58 ntpd[27976]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-27T17:47:58.528 INFO:teuthology.orchestra.run.smithi176.stderr:27 Nov 17:47:58 ntpd[27976]: can't open /var/log/ntpstats/loopstats.20231127: Permission denied 2023-11-27T17:47:58.555 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2023-11-27T17:47:58.555 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2023-11-27T17:47:58.555 INFO:teuthology.orchestra.run.smithi031.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:47:58.555 INFO:teuthology.orchestra.run.smithi031.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:47:58.555 INFO:teuthology.orchestra.run.smithi031.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:47:58.555 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:47:58.777 INFO:teuthology.orchestra.run.smithi176.stdout: remote refid st t when poll reach delay offset jitter 2023-11-27T17:47:58.777 INFO:teuthology.orchestra.run.smithi176.stdout:============================================================================== 2023-11-27T17:47:58.777 INFO:teuthology.orchestra.run.smithi176.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:47:58.777 INFO:teuthology.orchestra.run.smithi176.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:47:58.777 INFO:teuthology.orchestra.run.smithi176.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:47:58.777 INFO:teuthology.orchestra.run.smithi176.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-27T17:47:58.778 INFO:teuthology.run_tasks:Running task install... 2023-11-27T17:47:58.787 DEBUG:teuthology.task.install:project ceph 2023-11-27T17:47:58.787 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}} 2023-11-27T17:47:58.787 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'} 2023-11-27T17:47:58.787 INFO:teuthology.task.install:Using flavor: default 2023-11-27T17:47:58.793 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-27T17:47:58.793 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-27T17:47:58.793 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-key list | grep Ceph 2023-11-27T17:47:58.794 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-key list | grep Ceph 2023-11-27T17:47:58.794 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-key list | grep Ceph 2023-11-27T17:47:58.858 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-27T17:47:58.861 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-27T17:47:58.886 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-27T17:47:58.887 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph.com (release key) 2023-11-27T17:47:58.887 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-27T17:47:58.888 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-27T17:47:58.888 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:47:58.892 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-27T17:47:58.892 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph.com (release key) 2023-11-27T17:47:58.892 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-27T17:47:58.893 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-27T17:47:58.893 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:47:58.930 INFO:teuthology.orchestra.run.smithi176.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-27T17:47:58.983 INFO:teuthology.orchestra.run.smithi176.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-27T17:47:58.983 INFO:teuthology.orchestra.run.smithi176.stdout:uid [ unknown] Ceph.com (release key) 2023-11-27T17:47:58.984 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-27T17:47:58.984 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-27T17:47:58.984 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:47:59.026 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default/ 2023-11-27T17:47:59.026 INFO:teuthology.task.install.deb:Package version is 18.0.0-7498-g369173db-1jammy 2023-11-27T17:47:59.032 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default/ 2023-11-27T17:47:59.032 INFO:teuthology.task.install.deb:Package version is 18.0.0-7498-g369173db-1jammy 2023-11-27T17:47:59.247 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default/ 2023-11-27T17:47:59.247 INFO:teuthology.task.install.deb:Package version is 18.0.0-7498-g369173db-1jammy 2023-11-27T17:47:59.368 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:47:59.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-27T17:47:59.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2023-11-27T17:47:59.466 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:47:59.467 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-27T17:47:59.481 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2023-11-27T17:47:59.575 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-27T17:47:59.586 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:47:59.586 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-27T17:47:59.607 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get update 2023-11-27T17:47:59.648 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-27T17:47:59.655 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-27T17:47:59.658 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-27T17:47:59.667 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-27T17:47:59.675 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-27T17:47:59.749 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-27T17:47:59.808 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy InRelease 2023-11-27T17:47:59.831 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-27T17:47:59.883 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-27T17:47:59.924 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-27T17:47:59.924 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-27T17:47:59.957 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-27T17:47:59.994 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-27T17:48:00.011 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy InRelease 2023-11-27T17:48:00.030 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2023-11-27T17:48:00.052 INFO:teuthology.orchestra.run.smithi176.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy InRelease 2023-11-27T17:48:00.076 INFO:teuthology.orchestra.run.smithi176.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-27T17:48:00.112 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-27T17:48:00.113 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-27T17:48:00.125 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-27T17:48:00.199 INFO:teuthology.orchestra.run.smithi176.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-27T17:48:00.221 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-27T17:48:00.276 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-27T17:48:00.285 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 28.5 kB in 1s (40.3 kB/s) 2023-11-27T17:48:00.331 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-27T17:48:00.435 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2023-11-27T17:48:00.541 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 28.5 kB in 1s (40.1 kB/s) 2023-11-27T17:48:00.548 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,400 B] 2023-11-27T17:48:00.644 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 28.5 kB in 1s (29.8 kB/s) 2023-11-27T17:48:01.226 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-11-27T17:48:01.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7498-g369173db-1jammy cephadm=18.0.0-7498-g369173db-1jammy ceph-mds=18.0.0-7498-g369173db-1jammy ceph-mgr=18.0.0-7498-g369173db-1jammy ceph-common=18.0.0-7498-g369173db-1jammy ceph-fuse=18.0.0-7498-g369173db-1jammy ceph-test=18.0.0-7498-g369173db-1jammy ceph-volume=18.0.0-7498-g369173db-1jammy radosgw=18.0.0-7498-g369173db-1jammy python3-rados=18.0.0-7498-g369173db-1jammy python3-rgw=18.0.0-7498-g369173db-1jammy python3-cephfs=18.0.0-7498-g369173db-1jammy python3-rbd=18.0.0-7498-g369173db-1jammy libcephfs2=18.0.0-7498-g369173db-1jammy libcephfs-dev=18.0.0-7498-g369173db-1jammy librados2=18.0.0-7498-g369173db-1jammy librbd1=18.0.0-7498-g369173db-1jammy rbd-fuse=18.0.0-7498-g369173db-1jammy python3-cephfs=18.0.0-7498-g369173db-1jammy cephfs-shell=18.0.0-7498-g369173db-1jammy cephfs-top=18.0.0-7498-g369173db-1jammy cephfs-mirror=18.0.0-7498-g369173db-1jammy 2023-11-27T17:48:01.301 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-11-27T17:48:01.483 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-11-27T17:48:01.484 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-11-27T17:48:01.492 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2023-11-27T17:48:01.510 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7498-g369173db-1jammy cephadm=18.0.0-7498-g369173db-1jammy ceph-mds=18.0.0-7498-g369173db-1jammy ceph-mgr=18.0.0-7498-g369173db-1jammy ceph-common=18.0.0-7498-g369173db-1jammy ceph-fuse=18.0.0-7498-g369173db-1jammy ceph-test=18.0.0-7498-g369173db-1jammy ceph-volume=18.0.0-7498-g369173db-1jammy radosgw=18.0.0-7498-g369173db-1jammy python3-rados=18.0.0-7498-g369173db-1jammy python3-rgw=18.0.0-7498-g369173db-1jammy python3-cephfs=18.0.0-7498-g369173db-1jammy python3-rbd=18.0.0-7498-g369173db-1jammy libcephfs2=18.0.0-7498-g369173db-1jammy libcephfs-dev=18.0.0-7498-g369173db-1jammy librados2=18.0.0-7498-g369173db-1jammy librbd1=18.0.0-7498-g369173db-1jammy rbd-fuse=18.0.0-7498-g369173db-1jammy python3-cephfs=18.0.0-7498-g369173db-1jammy cephfs-shell=18.0.0-7498-g369173db-1jammy cephfs-top=18.0.0-7498-g369173db-1jammy cephfs-mirror=18.0.0-7498-g369173db-1jammy 2023-11-27T17:48:01.575 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-11-27T17:48:01.584 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2023-11-27T17:48:01.590 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7498-g369173db-1jammy cephadm=18.0.0-7498-g369173db-1jammy ceph-mds=18.0.0-7498-g369173db-1jammy ceph-mgr=18.0.0-7498-g369173db-1jammy ceph-common=18.0.0-7498-g369173db-1jammy ceph-fuse=18.0.0-7498-g369173db-1jammy ceph-test=18.0.0-7498-g369173db-1jammy ceph-volume=18.0.0-7498-g369173db-1jammy radosgw=18.0.0-7498-g369173db-1jammy python3-rados=18.0.0-7498-g369173db-1jammy python3-rgw=18.0.0-7498-g369173db-1jammy python3-cephfs=18.0.0-7498-g369173db-1jammy python3-rbd=18.0.0-7498-g369173db-1jammy libcephfs2=18.0.0-7498-g369173db-1jammy libcephfs-dev=18.0.0-7498-g369173db-1jammy librados2=18.0.0-7498-g369173db-1jammy librbd1=18.0.0-7498-g369173db-1jammy rbd-fuse=18.0.0-7498-g369173db-1jammy python3-cephfs=18.0.0-7498-g369173db-1jammy cephfs-shell=18.0.0-7498-g369173db-1jammy cephfs-top=18.0.0-7498-g369173db-1jammy cephfs-mirror=18.0.0-7498-g369173db-1jammy 2023-11-27T17:48:01.652 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-11-27T17:48:01.654 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:48:01.654 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T17:48:01.654 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T17:48:01.654 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T17:48:01.655 INFO:teuthology.orchestra.run.smithi081.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-27T17:48:01.655 INFO:teuthology.orchestra.run.smithi081.stdout: python2.7-minimal 2023-11-27T17:48:01.655 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:48:01.655 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2023-11-27T17:48:01.656 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-27T17:48:01.656 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-27T17:48:01.656 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-27T17:48:01.656 INFO:teuthology.orchestra.run.smithi081.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-27T17:48:01.657 INFO:teuthology.orchestra.run.smithi081.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-27T17:48:01.657 INFO:teuthology.orchestra.run.smithi081.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-27T17:48:01.657 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-27T17:48:01.657 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-27T17:48:01.657 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-27T17:48:01.657 INFO:teuthology.orchestra.run.smithi081.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-27T17:48:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-27T17:48:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-27T17:48:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-27T17:48:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-27T17:48:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-27T17:48:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-27T17:48:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-27T17:48:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-27T17:48:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-27T17:48:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-27T17:48:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-27T17:48:01.658 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-27T17:48:01.659 INFO:teuthology.orchestra.run.smithi081.stdout: socat xmlstarlet 2023-11-27T17:48:01.659 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2023-11-27T17:48:01.659 INFO:teuthology.orchestra.run.smithi081.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-27T17:48:01.659 INFO:teuthology.orchestra.run.smithi081.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-27T17:48:01.659 INFO:teuthology.orchestra.run.smithi081.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-27T17:48:01.659 INFO:teuthology.orchestra.run.smithi081.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-27T17:48:01.659 INFO:teuthology.orchestra.run.smithi081.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-27T17:48:01.659 INFO:teuthology.orchestra.run.smithi081.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-27T17:48:01.659 INFO:teuthology.orchestra.run.smithi081.stdout: python3-watchdog 2023-11-27T17:48:01.660 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2023-11-27T17:48:01.660 INFO:teuthology.orchestra.run.smithi081.stdout: btrfs-tools 2023-11-27T17:48:01.750 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2023-11-27T17:48:01.751 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2023-11-27T17:48:01.760 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2023-11-27T17:48:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-27T17:48:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-27T17:48:01.760 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-27T17:48:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-27T17:48:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-27T17:48:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-27T17:48:01.761 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-27T17:48:01.762 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-27T17:48:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-27T17:48:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-27T17:48:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-27T17:48:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-27T17:48:01.763 INFO:teuthology.orchestra.run.smithi081.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-27T17:48:01.836 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2023-11-27T17:48:01.837 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2023-11-27T17:48:01.878 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 114 newly installed, 0 to remove and 264 not upgraded. 2023-11-27T17:48:01.878 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 186 MB of archives. 2023-11-27T17:48:01.878 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-27T17:48:01.878 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-27T17:48:01.905 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:48:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T17:48:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T17:48:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T17:48:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-27T17:48:01.906 INFO:teuthology.orchestra.run.smithi176.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-27T17:48:01.907 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:48:01.907 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2023-11-27T17:48:01.907 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-27T17:48:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-27T17:48:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-27T17:48:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-27T17:48:01.908 INFO:teuthology.orchestra.run.smithi176.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-27T17:48:01.909 INFO:teuthology.orchestra.run.smithi176.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-27T17:48:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-27T17:48:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-27T17:48:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-27T17:48:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: socat xmlstarlet 2023-11-27T17:48:01.910 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2023-11-27T17:48:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-27T17:48:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-27T17:48:01.910 INFO:teuthology.orchestra.run.smithi176.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-27T17:48:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-27T17:48:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-27T17:48:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-27T17:48:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: python3-watchdog 2023-11-27T17:48:01.911 INFO:teuthology.orchestra.run.smithi176.stdout:Recommended packages: 2023-11-27T17:48:01.911 INFO:teuthology.orchestra.run.smithi176.stdout: btrfs-tools 2023-11-27T17:48:01.918 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-27T17:48:01.937 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-27T17:48:02.013 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:48:02.013 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T17:48:02.013 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T17:48:02.013 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T17:48:02.014 INFO:teuthology.orchestra.run.smithi031.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-27T17:48:02.014 INFO:teuthology.orchestra.run.smithi031.stdout: python2.7-minimal 2023-11-27T17:48:02.014 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:48:02.014 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2023-11-27T17:48:02.014 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-27T17:48:02.014 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-27T17:48:02.015 INFO:teuthology.orchestra.run.smithi031.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-27T17:48:02.015 INFO:teuthology.orchestra.run.smithi031.stdout: libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common python3-certifi python3-cheroot python3-cherrypy3 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cmd2 python3-colorama python3-google-auth python3-idna 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pyperclip 2023-11-27T17:48:02.016 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytest python3-repoze.lru python3-requests python3-requests-oauthlib 2023-11-27T17:48:02.017 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-27T17:48:02.017 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-27T17:48:02.017 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-27T17:48:02.017 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-27T17:48:02.017 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-27T17:48:02.017 INFO:teuthology.orchestra.run.smithi031.stdout: socat xmlstarlet 2023-11-27T17:48:02.017 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2023-11-27T17:48:02.018 INFO:teuthology.orchestra.run.smithi031.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-11-27T17:48:02.018 INFO:teuthology.orchestra.run.smithi031.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-11-27T17:48:02.018 INFO:teuthology.orchestra.run.smithi031.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-11-27T17:48:02.018 INFO:teuthology.orchestra.run.smithi031.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-11-27T17:48:02.018 INFO:teuthology.orchestra.run.smithi031.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-11-27T17:48:02.018 INFO:teuthology.orchestra.run.smithi031.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-11-27T17:48:02.018 INFO:teuthology.orchestra.run.smithi031.stdout: python3-watchdog 2023-11-27T17:48:02.018 INFO:teuthology.orchestra.run.smithi031.stdout:Recommended packages: 2023-11-27T17:48:02.018 INFO:teuthology.orchestra.run.smithi031.stdout: btrfs-tools 2023-11-27T17:48:02.050 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2023-11-27T17:48:02.051 INFO:teuthology.orchestra.run.smithi176.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-27T17:48:02.051 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-27T17:48:02.051 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-27T17:48:02.051 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-27T17:48:02.052 INFO:teuthology.orchestra.run.smithi176.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-27T17:48:02.052 INFO:teuthology.orchestra.run.smithi176.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-27T17:48:02.052 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-27T17:48:02.052 INFO:teuthology.orchestra.run.smithi176.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-27T17:48:02.052 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-27T17:48:02.052 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-27T17:48:02.053 INFO:teuthology.orchestra.run.smithi176.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-27T17:48:02.054 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-27T17:48:02.054 INFO:teuthology.orchestra.run.smithi176.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-27T17:48:02.114 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-27T17:48:02.126 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2023-11-27T17:48:02.126 INFO:teuthology.orchestra.run.smithi031.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-27T17:48:02.126 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-27T17:48:02.126 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-27T17:48:02.126 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-27T17:48:02.127 INFO:teuthology.orchestra.run.smithi031.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liboath0 libonig5 libpcre2-16-0 2023-11-27T17:48:02.127 INFO:teuthology.orchestra.run.smithi031.stdout: libqt5core5a libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 2023-11-27T17:48:02.127 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-11-27T17:48:02.127 INFO:teuthology.orchestra.run.smithi031.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-27T17:48:02.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-27T17:48:02.127 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-certifi 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth python3-idna python3-iniconfig python3-jaraco.classes 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip python3-pytest python3-rados python3-rbd 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2023-11-27T17:48:02.128 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2023-11-27T17:48:02.129 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2023-11-27T17:48:02.129 INFO:teuthology.orchestra.run.smithi031.stdout: radosgw rbd-fuse socat xmlstarlet 2023-11-27T17:48:02.132 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7498-g369173db-1jammy [3,468 kB] 2023-11-27T17:48:02.142 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-27T17:48:02.155 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-27T17:48:02.175 INFO:teuthology.orchestra.run.smithi176.stdout:0 upgraded, 114 newly installed, 0 to remove and 264 not upgraded. 2023-11-27T17:48:02.175 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 186 MB of archives. 2023-11-27T17:48:02.176 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-27T17:48:02.176 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-27T17:48:02.211 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-27T17:48:02.234 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-27T17:48:02.256 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-27T17:48:02.371 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-27T17:48:02.376 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-27T17:48:02.398 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-27T17:48:02.402 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7498-g369173db-1jammy [3,468 kB] 2023-11-27T17:48:02.406 INFO:teuthology.orchestra.run.smithi031.stdout:0 upgraded, 114 newly installed, 0 to remove and 264 not upgraded. 2023-11-27T17:48:02.406 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 186 MB of archives. 2023-11-27T17:48:02.406 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 829 MB of additional disk space will be used. 2023-11-27T17:48:02.406 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-27T17:48:02.449 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-27T17:48:02.455 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-27T17:48:02.457 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-27T17:48:02.468 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-27T17:48:02.469 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-27T17:48:02.471 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-27T17:48:02.472 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-27T17:48:02.473 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-27T17:48:02.475 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-27T17:48:02.476 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-27T17:48:02.476 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-27T17:48:02.487 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7498-g369173db-1jammy [3,468 kB] 2023-11-27T17:48:02.488 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-27T17:48:02.491 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-27T17:48:02.494 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-27T17:48:02.495 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-27T17:48:02.534 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-27T17:48:02.539 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-27T17:48:02.540 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-27T17:48:02.546 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-27T17:48:02.547 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-27T17:48:02.548 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-27T17:48:02.549 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-27T17:48:02.551 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-27T17:48:02.552 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-27T17:48:02.594 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-27T17:48:02.660 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-27T17:48:02.692 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-27T17:48:02.695 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-27T17:48:02.698 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-27T17:48:02.698 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-27T17:48:02.709 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-27T17:48:02.709 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-27T17:48:02.710 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-27T17:48:02.711 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-27T17:48:02.714 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-27T17:48:02.732 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-27T17:48:02.734 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-27T17:48:02.736 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-27T17:48:02.744 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-27T17:48:02.748 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-27T17:48:02.750 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-27T17:48:02.751 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-27T17:48:02.752 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-27T17:48:02.753 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-27T17:48:02.754 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-27T17:48:02.754 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-27T17:48:02.764 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-27T17:48:02.765 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-27T17:48:02.765 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-27T17:48:02.766 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-27T17:48:02.766 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-27T17:48:02.767 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-27T17:48:02.770 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-27T17:48:02.771 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-27T17:48:02.776 INFO:teuthology.orchestra.run.smithi081.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-27T17:48:02.791 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-27T17:48:02.795 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-27T17:48:02.796 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-27T17:48:02.796 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-27T17:48:02.797 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-27T17:48:02.798 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-27T17:48:02.821 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-27T17:48:02.822 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-27T17:48:02.823 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-27T17:48:02.824 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-27T17:48:02.831 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-27T17:48:02.845 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-27T17:48:02.850 INFO:teuthology.orchestra.run.smithi081.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-27T17:48:02.851 INFO:teuthology.orchestra.run.smithi081.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-27T17:48:02.852 INFO:teuthology.orchestra.run.smithi081.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-27T17:48:02.853 INFO:teuthology.orchestra.run.smithi081.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-27T17:48:02.853 INFO:teuthology.orchestra.run.smithi081.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-27T17:48:02.854 INFO:teuthology.orchestra.run.smithi081.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-27T17:48:02.860 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-27T17:48:02.870 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-27T17:48:02.870 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-27T17:48:02.873 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-27T17:48:02.873 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-27T17:48:02.873 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-27T17:48:02.892 INFO:teuthology.orchestra.run.smithi081.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-27T17:48:02.895 INFO:teuthology.orchestra.run.smithi081.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-27T17:48:02.896 INFO:teuthology.orchestra.run.smithi081.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-27T17:48:02.896 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-27T17:48:02.920 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-27T17:48:02.921 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-27T17:48:02.922 INFO:teuthology.orchestra.run.smithi176.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-27T17:48:02.923 INFO:teuthology.orchestra.run.smithi176.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-27T17:48:02.990 INFO:teuthology.orchestra.run.smithi081.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-27T17:48:02.990 INFO:teuthology.orchestra.run.smithi081.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-27T17:48:02.992 INFO:teuthology.orchestra.run.smithi081.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-27T17:48:02.993 INFO:teuthology.orchestra.run.smithi081.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-27T17:48:02.994 INFO:teuthology.orchestra.run.smithi081.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-27T17:48:02.995 INFO:teuthology.orchestra.run.smithi081.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-27T17:48:02.996 INFO:teuthology.orchestra.run.smithi081.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-27T17:48:02.997 INFO:teuthology.orchestra.run.smithi081.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-27T17:48:02.998 INFO:teuthology.orchestra.run.smithi176.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-27T17:48:02.999 INFO:teuthology.orchestra.run.smithi176.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-27T17:48:03.001 INFO:teuthology.orchestra.run.smithi176.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-27T17:48:03.003 INFO:teuthology.orchestra.run.smithi081.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-27T17:48:03.029 INFO:teuthology.orchestra.run.smithi081.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-27T17:48:03.057 INFO:teuthology.orchestra.run.smithi081.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-27T17:48:03.058 INFO:teuthology.orchestra.run.smithi081.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-27T17:48:03.064 INFO:teuthology.orchestra.run.smithi081.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-27T17:48:03.068 INFO:teuthology.orchestra.run.smithi081.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-27T17:48:03.068 INFO:teuthology.orchestra.run.smithi081.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-27T17:48:03.070 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-27T17:48:03.071 INFO:teuthology.orchestra.run.smithi176.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-27T17:48:03.072 INFO:teuthology.orchestra.run.smithi176.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-27T17:48:03.073 INFO:teuthology.orchestra.run.smithi176.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-27T17:48:03.079 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-27T17:48:03.108 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-27T17:48:03.116 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-27T17:48:03.131 INFO:teuthology.orchestra.run.smithi176.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-27T17:48:03.131 INFO:teuthology.orchestra.run.smithi176.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-27T17:48:03.133 INFO:teuthology.orchestra.run.smithi176.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-27T17:48:03.160 INFO:teuthology.orchestra.run.smithi176.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-27T17:48:03.162 INFO:teuthology.orchestra.run.smithi176.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-27T17:48:03.163 INFO:teuthology.orchestra.run.smithi176.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-27T17:48:03.180 INFO:teuthology.orchestra.run.smithi176.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-27T17:48:03.180 INFO:teuthology.orchestra.run.smithi176.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-27T17:48:03.181 INFO:teuthology.orchestra.run.smithi176.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-27T17:48:03.187 INFO:teuthology.orchestra.run.smithi081.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-27T17:48:03.188 INFO:teuthology.orchestra.run.smithi176.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-27T17:48:03.189 INFO:teuthology.orchestra.run.smithi176.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-27T17:48:03.189 INFO:teuthology.orchestra.run.smithi176.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-27T17:48:03.190 INFO:teuthology.orchestra.run.smithi176.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-27T17:48:03.191 INFO:teuthology.orchestra.run.smithi176.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-27T17:48:03.195 INFO:teuthology.orchestra.run.smithi176.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-27T17:48:03.215 INFO:teuthology.orchestra.run.smithi176.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-27T17:48:03.215 INFO:teuthology.orchestra.run.smithi081.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-27T17:48:03.215 INFO:teuthology.orchestra.run.smithi081.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-27T17:48:03.217 INFO:teuthology.orchestra.run.smithi176.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-27T17:48:03.218 INFO:teuthology.orchestra.run.smithi176.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-27T17:48:03.222 INFO:teuthology.orchestra.run.smithi176.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-27T17:48:03.244 INFO:teuthology.orchestra.run.smithi081.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-27T17:48:03.245 INFO:teuthology.orchestra.run.smithi081.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-27T17:48:03.249 INFO:teuthology.orchestra.run.smithi081.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-27T17:48:03.251 INFO:teuthology.orchestra.run.smithi081.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-27T17:48:03.252 INFO:teuthology.orchestra.run.smithi176.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-27T17:48:03.253 INFO:teuthology.orchestra.run.smithi176.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-27T17:48:03.261 INFO:teuthology.orchestra.run.smithi176.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-27T17:48:03.266 INFO:teuthology.orchestra.run.smithi176.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-27T17:48:03.267 INFO:teuthology.orchestra.run.smithi176.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-27T17:48:03.268 INFO:teuthology.orchestra.run.smithi176.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-27T17:48:03.281 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-27T17:48:03.306 INFO:teuthology.orchestra.run.smithi081.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-27T17:48:03.307 INFO:teuthology.orchestra.run.smithi081.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-27T17:48:03.307 INFO:teuthology.orchestra.run.smithi081.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-27T17:48:03.362 INFO:teuthology.orchestra.run.smithi081.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-27T17:48:03.363 INFO:teuthology.orchestra.run.smithi081.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-27T17:48:03.371 INFO:teuthology.orchestra.run.smithi176.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-27T17:48:03.435 INFO:teuthology.orchestra.run.smithi176.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-27T17:48:03.436 INFO:teuthology.orchestra.run.smithi176.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-27T17:48:03.459 INFO:teuthology.orchestra.run.smithi176.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-27T17:48:03.460 INFO:teuthology.orchestra.run.smithi176.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-27T17:48:03.460 INFO:teuthology.orchestra.run.smithi176.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-27T17:48:03.462 INFO:teuthology.orchestra.run.smithi176.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-27T17:48:03.463 INFO:teuthology.orchestra.run.smithi176.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-27T17:48:03.850 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-27T17:48:03.854 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-27T17:48:03.855 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-27T17:48:03.861 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-27T17:48:03.862 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-27T17:48:03.863 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-27T17:48:03.864 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-27T17:48:03.865 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-27T17:48:03.866 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-27T17:48:03.931 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-27T17:48:04.115 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-27T17:48:04.317 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-27T17:48:04.346 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-27T17:48:04.370 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-27T17:48:04.474 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-27T17:48:04.488 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-27T17:48:04.495 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-27T17:48:04.548 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-27T17:48:04.575 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-27T17:48:04.584 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-27T17:48:04.699 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-27T17:48:04.863 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-27T17:48:04.936 INFO:teuthology.orchestra.run.smithi081.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7498-g369173db-1jammy [3,111 kB] 2023-11-27T17:48:05.047 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-27T17:48:05.097 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-27T17:48:05.229 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-27T17:48:05.321 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-27T17:48:05.339 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-27T17:48:05.368 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-27T17:48:05.381 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-27T17:48:05.422 INFO:teuthology.orchestra.run.smithi031.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-27T17:48:05.430 INFO:teuthology.orchestra.run.smithi031.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-27T17:48:05.458 INFO:teuthology.orchestra.run.smithi031.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-27T17:48:05.500 INFO:teuthology.orchestra.run.smithi031.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7498-g369173db-1jammy [3,111 kB] 2023-11-27T17:48:05.676 INFO:teuthology.orchestra.run.smithi176.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7498-g369173db-1jammy [3,111 kB] 2023-11-27T17:48:05.845 INFO:teuthology.orchestra.run.smithi031.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-27T17:48:06.162 INFO:teuthology.orchestra.run.smithi031.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-27T17:48:06.249 INFO:teuthology.orchestra.run.smithi031.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-27T17:48:06.275 INFO:teuthology.orchestra.run.smithi031.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-27T17:48:06.284 INFO:teuthology.orchestra.run.smithi031.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-27T17:48:06.335 INFO:teuthology.orchestra.run.smithi031.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-27T17:48:06.587 INFO:teuthology.orchestra.run.smithi031.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-27T17:48:06.596 INFO:teuthology.orchestra.run.smithi031.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-27T17:48:06.597 INFO:teuthology.orchestra.run.smithi031.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-27T17:48:06.662 INFO:teuthology.orchestra.run.smithi031.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-27T17:48:06.663 INFO:teuthology.orchestra.run.smithi031.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-27T17:48:06.828 INFO:teuthology.orchestra.run.smithi031.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-27T17:48:07.034 INFO:teuthology.orchestra.run.smithi031.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-27T17:48:07.088 INFO:teuthology.orchestra.run.smithi031.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-27T17:48:07.158 INFO:teuthology.orchestra.run.smithi031.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-27T17:48:07.189 INFO:teuthology.orchestra.run.smithi031.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-27T17:48:07.225 INFO:teuthology.orchestra.run.smithi031.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-27T17:48:07.380 INFO:teuthology.orchestra.run.smithi031.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-27T17:48:07.420 INFO:teuthology.orchestra.run.smithi031.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-27T17:48:07.442 INFO:teuthology.orchestra.run.smithi031.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-27T17:48:07.451 INFO:teuthology.orchestra.run.smithi031.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-27T17:48:07.452 INFO:teuthology.orchestra.run.smithi081.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7498-g369173db-1jammy [691 kB] 2023-11-27T17:48:07.491 INFO:teuthology.orchestra.run.smithi031.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-27T17:48:07.566 INFO:teuthology.orchestra.run.smithi031.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7498-g369173db-1jammy [691 kB] 2023-11-27T17:48:07.679 INFO:teuthology.orchestra.run.smithi031.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-27T17:48:07.857 INFO:teuthology.orchestra.run.smithi031.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-27T17:48:08.000 INFO:teuthology.orchestra.run.smithi081.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7498-g369173db-1jammy [356 kB] 2023-11-27T17:48:08.009 INFO:teuthology.orchestra.run.smithi031.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7498-g369173db-1jammy [356 kB] 2023-11-27T17:48:08.197 INFO:teuthology.orchestra.run.smithi031.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-27T17:48:08.239 INFO:teuthology.orchestra.run.smithi031.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7498-g369173db-1jammy [32.8 kB] 2023-11-27T17:48:08.250 INFO:teuthology.orchestra.run.smithi031.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7498-g369173db-1jammy [180 kB] 2023-11-27T17:48:08.258 INFO:teuthology.orchestra.run.smithi031.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-27T17:48:08.259 INFO:teuthology.orchestra.run.smithi031.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-27T17:48:08.265 INFO:teuthology.orchestra.run.smithi081.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7498-g369173db-1jammy [32.8 kB] 2023-11-27T17:48:08.267 INFO:teuthology.orchestra.run.smithi031.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-27T17:48:08.269 INFO:teuthology.orchestra.run.smithi031.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-27T17:48:08.288 INFO:teuthology.orchestra.run.smithi031.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-27T17:48:08.295 INFO:teuthology.orchestra.run.smithi031.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-27T17:48:08.327 INFO:teuthology.orchestra.run.smithi081.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7498-g369173db-1jammy [180 kB] 2023-11-27T17:48:08.356 INFO:teuthology.orchestra.run.smithi031.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-27T17:48:08.357 INFO:teuthology.orchestra.run.smithi031.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-27T17:48:08.387 INFO:teuthology.orchestra.run.smithi031.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7498-g369173db-1jammy [63.5 kB] 2023-11-27T17:48:08.405 INFO:teuthology.orchestra.run.smithi031.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7498-g369173db-1jammy [329 kB] 2023-11-27T17:48:08.497 INFO:teuthology.orchestra.run.smithi081.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7498-g369173db-1jammy [63.5 kB] 2023-11-27T17:48:08.522 INFO:teuthology.orchestra.run.smithi031.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-27T17:48:08.558 INFO:teuthology.orchestra.run.smithi081.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7498-g369173db-1jammy [329 kB] 2023-11-27T17:48:08.623 INFO:teuthology.orchestra.run.smithi031.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7498-g369173db-1jammy [6,224 kB] 2023-11-27T17:48:08.765 INFO:teuthology.orchestra.run.smithi176.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7498-g369173db-1jammy [691 kB] 2023-11-27T17:48:08.943 INFO:teuthology.orchestra.run.smithi081.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7498-g369173db-1jammy [6,224 kB] 2023-11-27T17:48:08.956 INFO:teuthology.orchestra.run.smithi031.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-27T17:48:08.971 INFO:teuthology.orchestra.run.smithi031.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-27T17:48:09.369 INFO:teuthology.orchestra.run.smithi176.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7498-g369173db-1jammy [356 kB] 2023-11-27T17:48:09.678 INFO:teuthology.orchestra.run.smithi176.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7498-g369173db-1jammy [32.8 kB] 2023-11-27T17:48:09.716 INFO:teuthology.orchestra.run.smithi176.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7498-g369173db-1jammy [180 kB] 2023-11-27T17:48:09.862 INFO:teuthology.orchestra.run.smithi176.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7498-g369173db-1jammy [63.5 kB] 2023-11-27T17:48:09.931 INFO:teuthology.orchestra.run.smithi176.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7498-g369173db-1jammy [329 kB] 2023-11-27T17:48:10.230 INFO:teuthology.orchestra.run.smithi176.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7498-g369173db-1jammy [6,224 kB] 2023-11-27T17:48:12.682 INFO:teuthology.orchestra.run.smithi031.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7498-g369173db-1jammy [112 kB] 2023-11-27T17:48:12.765 INFO:teuthology.orchestra.run.smithi031.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7498-g369173db-1jammy [439 kB] 2023-11-27T17:48:13.064 INFO:teuthology.orchestra.run.smithi031.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7498-g369173db-1jammy [22.6 MB] 2023-11-27T17:48:16.582 INFO:teuthology.orchestra.run.smithi176.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7498-g369173db-1jammy [112 kB] 2023-11-27T17:48:16.658 INFO:teuthology.orchestra.run.smithi176.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7498-g369173db-1jammy [439 kB] 2023-11-27T17:48:17.037 INFO:teuthology.orchestra.run.smithi176.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7498-g369173db-1jammy [22.6 MB] 2023-11-27T17:48:19.526 INFO:teuthology.orchestra.run.smithi081.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7498-g369173db-1jammy [112 kB] 2023-11-27T17:48:19.749 INFO:teuthology.orchestra.run.smithi081.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7498-g369173db-1jammy [439 kB] 2023-11-27T17:48:20.575 INFO:teuthology.orchestra.run.smithi081.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7498-g369173db-1jammy [22.6 MB] 2023-11-27T17:48:30.967 INFO:teuthology.orchestra.run.smithi031.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7498-g369173db-1jammy [6,900 kB] 2023-11-27T17:48:36.026 INFO:teuthology.orchestra.run.smithi031.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7498-g369173db-1jammy [238 kB] 2023-11-27T17:48:36.174 INFO:teuthology.orchestra.run.smithi031.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7498-g369173db-1jammy [124 kB] 2023-11-27T17:48:36.249 INFO:teuthology.orchestra.run.smithi031.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7498-g369173db-1jammy [1,495 kB] 2023-11-27T17:48:37.233 INFO:teuthology.orchestra.run.smithi031.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7498-g369173db-1jammy [9,956 kB] 2023-11-27T17:48:42.483 INFO:teuthology.orchestra.run.smithi176.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7498-g369173db-1jammy [6,900 kB] 2023-11-27T17:48:42.732 INFO:teuthology.orchestra.run.smithi031.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7498-g369173db-1jammy [31.8 MB] 2023-11-27T17:48:44.550 INFO:teuthology.orchestra.run.smithi081.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7498-g369173db-1jammy [6,900 kB] 2023-11-27T17:48:47.036 INFO:teuthology.orchestra.run.smithi176.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7498-g369173db-1jammy [238 kB] 2023-11-27T17:48:47.227 INFO:teuthology.orchestra.run.smithi176.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7498-g369173db-1jammy [124 kB] 2023-11-27T17:48:47.331 INFO:teuthology.orchestra.run.smithi176.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7498-g369173db-1jammy [1,495 kB] 2023-11-27T17:48:48.042 INFO:teuthology.orchestra.run.smithi081.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7498-g369173db-1jammy [238 kB] 2023-11-27T17:48:48.138 INFO:teuthology.orchestra.run.smithi081.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7498-g369173db-1jammy [124 kB] 2023-11-27T17:48:48.201 INFO:teuthology.orchestra.run.smithi081.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7498-g369173db-1jammy [1,495 kB] 2023-11-27T17:48:48.428 INFO:teuthology.orchestra.run.smithi176.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7498-g369173db-1jammy [9,956 kB] 2023-11-27T17:48:48.926 INFO:teuthology.orchestra.run.smithi081.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7498-g369173db-1jammy [9,956 kB] 2023-11-27T17:48:55.570 INFO:teuthology.orchestra.run.smithi081.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7498-g369173db-1jammy [31.8 MB] 2023-11-27T17:48:56.121 INFO:teuthology.orchestra.run.smithi176.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7498-g369173db-1jammy [31.8 MB] 2023-11-27T17:49:00.798 INFO:teuthology.orchestra.run.smithi031.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7498-g369173db-1jammy [14.0 kB] 2023-11-27T17:49:00.799 INFO:teuthology.orchestra.run.smithi031.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7498-g369173db-1jammy [839 kB] 2023-11-27T17:49:01.071 INFO:teuthology.orchestra.run.smithi031.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7498-g369173db-1jammy [2,143 kB] 2023-11-27T17:49:01.866 INFO:teuthology.orchestra.run.smithi031.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7498-g369173db-1jammy [803 kB] 2023-11-27T17:49:02.098 INFO:teuthology.orchestra.run.smithi031.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7498-g369173db-1jammy [139 kB] 2023-11-27T17:49:02.163 INFO:teuthology.orchestra.run.smithi031.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7498-g369173db-1jammy [1,900 kB] 2023-11-27T17:49:02.767 INFO:teuthology.orchestra.run.smithi031.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7498-g369173db-1jammy [8,625 kB] 2023-11-27T17:49:04.943 INFO:teuthology.orchestra.run.smithi031.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7498-g369173db-1jammy [14.2 kB] 2023-11-27T17:49:04.943 INFO:teuthology.orchestra.run.smithi031.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7498-g369173db-1jammy [48.6 MB] 2023-11-27T17:49:06.318 INFO:teuthology.orchestra.run.smithi081.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7498-g369173db-1jammy [14.0 kB] 2023-11-27T17:49:06.319 INFO:teuthology.orchestra.run.smithi081.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7498-g369173db-1jammy [839 kB] 2023-11-27T17:49:06.531 INFO:teuthology.orchestra.run.smithi081.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7498-g369173db-1jammy [2,143 kB] 2023-11-27T17:49:07.577 INFO:teuthology.orchestra.run.smithi081.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7498-g369173db-1jammy [803 kB] 2023-11-27T17:49:07.968 INFO:teuthology.orchestra.run.smithi081.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7498-g369173db-1jammy [139 kB] 2023-11-27T17:49:08.045 INFO:teuthology.orchestra.run.smithi081.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7498-g369173db-1jammy [1,900 kB] 2023-11-27T17:49:08.855 INFO:teuthology.orchestra.run.smithi081.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7498-g369173db-1jammy [8,625 kB] 2023-11-27T17:49:12.306 INFO:teuthology.orchestra.run.smithi176.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7498-g369173db-1jammy [14.0 kB] 2023-11-27T17:49:12.306 INFO:teuthology.orchestra.run.smithi176.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7498-g369173db-1jammy [839 kB] 2023-11-27T17:49:12.653 INFO:teuthology.orchestra.run.smithi081.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7498-g369173db-1jammy [14.2 kB] 2023-11-27T17:49:12.653 INFO:teuthology.orchestra.run.smithi081.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7498-g369173db-1jammy [48.6 MB] 2023-11-27T17:49:12.709 INFO:teuthology.orchestra.run.smithi176.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7498-g369173db-1jammy [2,143 kB] 2023-11-27T17:49:13.690 INFO:teuthology.orchestra.run.smithi176.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7498-g369173db-1jammy [803 kB] 2023-11-27T17:49:14.049 INFO:teuthology.orchestra.run.smithi176.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7498-g369173db-1jammy [139 kB] 2023-11-27T17:49:14.107 INFO:teuthology.orchestra.run.smithi176.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7498-g369173db-1jammy [1,900 kB] 2023-11-27T17:49:14.869 INFO:teuthology.orchestra.run.smithi176.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7498-g369173db-1jammy [8,625 kB] 2023-11-27T17:49:17.920 INFO:teuthology.orchestra.run.smithi176.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7498-g369173db-1jammy [14.2 kB] 2023-11-27T17:49:17.920 INFO:teuthology.orchestra.run.smithi176.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7498-g369173db-1jammy [48.6 MB] 2023-11-27T17:49:30.834 INFO:teuthology.orchestra.run.smithi031.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7498-g369173db-1jammy [121 kB] 2023-11-27T17:49:30.835 INFO:teuthology.orchestra.run.smithi031.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7498-g369173db-1jammy [226 kB] 2023-11-27T17:49:30.919 INFO:teuthology.orchestra.run.smithi031.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7498-g369173db-1jammy [34.0 kB] 2023-11-27T17:49:30.920 INFO:teuthology.orchestra.run.smithi031.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7498-g369173db-1jammy [23.4 kB] 2023-11-27T17:49:30.959 INFO:teuthology.orchestra.run.smithi031.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7498-g369173db-1jammy [38.3 kB] 2023-11-27T17:49:30.972 INFO:teuthology.orchestra.run.smithi031.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7498-g369173db-1jammy [12.3 MB] 2023-11-27T17:49:39.209 INFO:teuthology.orchestra.run.smithi031.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7498-g369173db-1jammy [91.1 kB] 2023-11-27T17:49:39.644 INFO:teuthology.orchestra.run.smithi176.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7498-g369173db-1jammy [121 kB] 2023-11-27T17:49:39.718 INFO:teuthology.orchestra.run.smithi176.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7498-g369173db-1jammy [226 kB] 2023-11-27T17:49:39.801 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 186 MB in 1min 37s (1,913 kB/s) 2023-11-27T17:49:39.827 INFO:teuthology.orchestra.run.smithi176.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7498-g369173db-1jammy [34.0 kB] 2023-11-27T17:49:39.847 INFO:teuthology.orchestra.run.smithi176.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7498-g369173db-1jammy [23.4 kB] 2023-11-27T17:49:39.866 INFO:teuthology.orchestra.run.smithi176.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7498-g369173db-1jammy [38.3 kB] 2023-11-27T17:49:39.877 INFO:teuthology.orchestra.run.smithi176.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7498-g369173db-1jammy [12.3 MB] 2023-11-27T17:49:39.951 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-27T17:49:40.029 INFO:teuthology.orchestra.run.smithi081.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7498-g369173db-1jammy [121 kB] 2023-11-27T17:49:40.032 INFO:teuthology.orchestra.run.smithi081.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7498-g369173db-1jammy [226 kB] 2023-11-27T17:49:40.039 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2023-11-27T17:49:40.043 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-27T17:49:40.083 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-27T17:49:40.084 INFO:teuthology.orchestra.run.smithi081.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7498-g369173db-1jammy [34.0 kB] 2023-11-27T17:49:40.086 INFO:teuthology.orchestra.run.smithi081.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7498-g369173db-1jammy [23.4 kB] 2023-11-27T17:49:40.087 INFO:teuthology.orchestra.run.smithi081.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7498-g369173db-1jammy [38.3 kB] 2023-11-27T17:49:40.088 INFO:teuthology.orchestra.run.smithi081.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7498-g369173db-1jammy [12.3 MB] 2023-11-27T17:49:40.452 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-27T17:49:40.473 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-27T17:49:40.502 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-27T17:49:40.746 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cmd2. 2023-11-27T17:49:40.767 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-27T17:49:40.804 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-27T17:49:41.124 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-27T17:49:41.144 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-27T17:49:41.224 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-27T17:49:41.552 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-27T17:49:41.573 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-27T17:49:41.610 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-27T17:49:41.947 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-27T17:49:41.968 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-27T17:49:42.005 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T17:49:42.358 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-27T17:49:42.379 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T17:49:42.416 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:49:42.778 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-27T17:49:42.799 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T17:49:42.836 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:49:43.172 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-27T17:49:43.193 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T17:49:43.230 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:49:43.583 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-27T17:49:43.604 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-27T17:49:43.642 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-27T17:49:43.970 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librados2. 2023-11-27T17:49:43.990 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../010-librados2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:44.027 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librados2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:44.497 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librbd1. 2023-11-27T17:49:44.517 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../011-librbd1_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:44.555 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librbd1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:44.983 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs2. 2023-11-27T17:49:45.003 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:45.041 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:45.276 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rados. 2023-11-27T17:49:45.289 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:45.326 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rados (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:45.449 INFO:teuthology.orchestra.run.smithi081.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7498-g369173db-1jammy [91.1 kB] 2023-11-27T17:49:45.629 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-27T17:49:45.650 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:49:45.687 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-argparse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:45.940 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cephfs. 2023-11-27T17:49:45.952 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:45.960 INFO:teuthology.orchestra.run.smithi176.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-11-22-1112/369173db14b6995b2bd07c60ec5f63d01cf21631/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7498-g369173db-1jammy [91.1 kB] 2023-11-27T17:49:45.990 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cephfs (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:46.033 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 186 MB in 1min 44s (1,791 kB/s) 2023-11-27T17:49:46.172 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-27T17:49:46.253 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2023-11-27T17:49:46.258 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-27T17:49:46.292 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-27T17:49:46.303 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-27T17:49:46.313 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:49:46.350 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:46.565 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 186 MB in 1min 44s (1,787 kB/s) 2023-11-27T17:49:46.581 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-27T17:49:46.593 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-27T17:49:46.623 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-27T17:49:46.661 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-prettytable. 2023-11-27T17:49:46.674 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-27T17:49:46.711 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-27T17:49:46.716 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-27T17:49:46.785 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-27T17:49:46.788 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-27T17:49:46.856 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-27T17:49:46.922 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rbd. 2023-11-27T17:49:46.934 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:46.964 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:46.967 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cmd2. 2023-11-27T17:49:46.988 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-27T17:49:47.025 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-27T17:49:47.117 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-27T17:49:47.131 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-27T17:49:47.167 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-27T17:49:47.291 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-27T17:49:47.312 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-27T17:49:47.350 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-27T17:49:47.387 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-27T17:49:47.408 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-27T17:49:47.503 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cmd2. 2023-11-27T17:49:47.517 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-27T17:49:47.521 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-27T17:49:47.562 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-27T17:49:47.678 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librgw2. 2023-11-27T17:49:47.698 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../020-librgw2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:47.736 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librgw2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:47.866 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-27T17:49:47.887 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-27T17:49:47.906 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-27T17:49:47.920 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-27T17:49:47.924 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-27T17:49:48.007 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-27T17:49:48.246 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rgw. 2023-11-27T17:49:48.259 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:48.294 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-27T17:49:48.296 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:48.315 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-27T17:49:48.343 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-27T17:49:48.352 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T17:49:48.358 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-27T17:49:48.401 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-27T17:49:48.557 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-27T17:49:48.569 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-27T17:49:48.599 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-27T17:49:48.729 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-27T17:49:48.744 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-27T17:49:48.779 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T17:49:48.848 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-27T17:49:48.869 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T17:49:48.914 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:49:48.943 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libradosstriper1. 2023-11-27T17:49:48.964 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:49.001 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libradosstriper1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:49.174 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-27T17:49:49.190 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T17:49:49.241 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:49:49.309 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-27T17:49:49.330 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T17:49:49.359 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:49:49.455 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-common. 2023-11-27T17:49:49.475 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:49.513 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:49.636 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-27T17:49:49.651 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T17:49:49.694 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:49:49.771 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-27T17:49:49.792 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T17:49:49.829 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:49:50.039 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-27T17:49:50.054 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-27T17:49:50.097 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:49:50.217 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-27T17:49:50.238 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-27T17:49:50.290 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-27T17:49:50.400 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-27T17:49:50.414 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-27T17:49:50.458 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-27T17:49:50.593 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librados2. 2023-11-27T17:49:50.614 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../010-librados2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:50.643 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librados2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:50.778 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librados2. 2023-11-27T17:49:50.792 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../010-librados2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:50.836 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librados2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:50.918 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-base. 2023-11-27T17:49:50.938 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:50.993 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-base (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:51.289 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librbd1. 2023-11-27T17:49:51.303 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../011-librbd1_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:51.347 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librbd1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:51.355 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librbd1. 2023-11-27T17:49:51.376 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../011-librbd1_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:51.413 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librbd1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:51.680 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-27T17:49:51.702 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-27T17:49:51.739 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-27T17:49:51.875 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcephfs2. 2023-11-27T17:49:51.890 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:51.908 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs2. 2023-11-27T17:49:51.925 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcephfs2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:51.928 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:51.966 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:51.991 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cheroot. 2023-11-27T17:49:52.004 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-27T17:49:52.041 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-27T17:49:52.227 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rados. 2023-11-27T17:49:52.242 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:52.252 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rados. 2023-11-27T17:49:52.273 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:52.285 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rados (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:52.310 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rados (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:52.352 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-27T17:49:52.373 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-27T17:49:52.410 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-27T17:49:52.596 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-27T17:49:52.611 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:49:52.646 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-27T17:49:52.663 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-ceph-argparse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:52.667 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:49:52.705 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-argparse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:52.713 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-27T17:49:52.734 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-27T17:49:52.771 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-27T17:49:52.915 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cephfs. 2023-11-27T17:49:52.930 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:52.973 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cephfs (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:52.991 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cephfs. 2023-11-27T17:49:53.011 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:53.049 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cephfs (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:53.074 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-27T17:49:53.095 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-27T17:49:53.132 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-27T17:49:53.235 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-27T17:49:53.249 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:49:53.284 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:53.368 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-27T17:49:53.389 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:49:53.401 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempora. 2023-11-27T17:49:53.422 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-27T17:49:53.426 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:53.451 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-27T17:49:53.579 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-prettytable. 2023-11-27T17:49:53.594 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-27T17:49:53.629 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-27T17:49:53.754 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-portend. 2023-11-27T17:49:53.763 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-prettytable. 2023-11-27T17:49:53.775 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-27T17:49:53.776 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-27T17:49:53.812 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-27T17:49:53.813 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-27T17:49:53.873 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rbd. 2023-11-27T17:49:53.888 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:53.923 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:54.083 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rbd. 2023-11-27T17:49:54.104 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:54.115 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-27T17:49:54.136 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-27T17:49:54.141 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:54.173 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-27T17:49:54.268 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-27T17:49:54.282 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-27T17:49:54.326 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-27T17:49:54.459 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-27T17:49:54.480 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-27T17:49:54.502 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-27T17:49:54.517 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-27T17:49:54.523 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-27T17:49:54.560 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-27T17:49:54.670 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package librgw2. 2023-11-27T17:49:54.685 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../020-librgw2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:54.728 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking librgw2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:54.879 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-natsort. 2023-11-27T17:49:54.900 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-27T17:49:54.930 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librgw2. 2023-11-27T17:49:54.937 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-27T17:49:54.951 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../020-librgw2_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:54.988 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librgw2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:55.198 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rgw. 2023-11-27T17:49:55.212 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:55.223 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-logutils. 2023-11-27T17:49:55.236 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-27T17:49:55.247 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:55.273 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-27T17:49:55.491 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rgw. 2023-11-27T17:49:55.503 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../021-python3-rgw_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:55.532 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:55.542 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-27T17:49:55.559 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-27T17:49:55.564 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-27T17:49:55.574 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-27T17:49:55.601 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-27T17:49:55.617 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-27T17:49:55.910 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-27T17:49:55.929 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-mako. 2023-11-27T17:49:55.931 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../022-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-27T17:49:55.950 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-27T17:49:55.953 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libradosstriper1. 2023-11-27T17:49:55.968 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:55.969 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-27T17:49:55.987 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-27T17:49:56.011 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libradosstriper1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:56.315 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-27T17:49:56.330 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libradosstriper1. 2023-11-27T17:49:56.336 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-27T17:49:56.350 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../023-libradosstriper1_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:56.373 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-27T17:49:56.388 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libradosstriper1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:56.440 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-common. 2023-11-27T17:49:56.454 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:56.498 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:56.676 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-27T17:49:56.697 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-27T17:49:56.734 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-27T17:49:56.808 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-common. 2023-11-27T17:49:56.829 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../024-ceph-common_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:56.867 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:57.003 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webob. 2023-11-27T17:49:57.016 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-27T17:49:57.045 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-27T17:49:57.356 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-waitress. 2023-11-27T17:49:57.377 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-27T17:49:57.417 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-27T17:49:57.553 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-base. 2023-11-27T17:49:57.568 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:57.612 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-base (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:57.725 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempita. 2023-11-27T17:49:57.746 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-27T17:49:57.783 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-27T17:49:58.095 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-paste. 2023-11-27T17:49:58.115 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-27T17:49:58.153 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-27T17:49:58.231 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-base. 2023-11-27T17:49:58.252 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../025-ceph-base_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:49:58.291 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-27T17:49:58.298 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-base (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:49:58.305 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-27T17:49:58.349 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-27T17:49:58.481 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-27T17:49:58.501 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-27T17:49:58.539 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-27T17:49:58.635 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cheroot. 2023-11-27T17:49:58.650 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-27T17:49:58.694 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-27T17:49:58.841 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-27T17:49:58.862 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-27T17:49:58.900 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-27T17:49:59.005 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-27T17:49:59.020 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-27T17:49:59.055 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-27T17:49:59.060 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-27T17:49:59.081 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../026-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-27T17:49:59.119 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-27T17:49:59.203 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webtest. 2023-11-27T17:49:59.223 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-27T17:49:59.261 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-27T17:49:59.374 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-27T17:49:59.389 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-27T17:49:59.413 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cheroot. 2023-11-27T17:49:59.432 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-27T17:49:59.434 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../027-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-27T17:49:59.500 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-27T17:49:59.572 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pecan. 2023-11-27T17:49:59.593 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-27T17:49:59.630 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-27T17:49:59.718 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-27T17:49:59.733 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-27T17:49:59.777 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-27T17:49:59.841 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-27T17:49:59.853 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../028-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-27T17:49:59.891 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-27T17:49:59.993 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-certifi. 2023-11-27T17:50:00.017 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-27T17:50:00.059 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-27T17:50:00.062 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-tempora. 2023-11-27T17:50:00.078 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-27T17:50:00.121 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-27T17:50:00.177 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-27T17:50:00.189 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../029-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-27T17:50:00.219 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-27T17:50:00.407 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-portend. 2023-11-27T17:50:00.422 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-27T17:50:00.457 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-27T17:50:00.530 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-27T17:50:00.551 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../030-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-27T17:50:00.589 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-idna. 2023-11-27T17:50:00.611 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-27T17:50:00.622 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-27T17:50:00.647 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-27T17:50:00.777 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-27T17:50:00.792 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-27T17:50:00.835 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-27T17:50:00.908 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempora. 2023-11-27T17:50:00.929 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../031-python3-tempora_4.1.2-1_all.deb ... 2023-11-27T17:50:00.959 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-urllib3. 2023-11-27T17:50:00.966 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-27T17:50:00.980 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-27T17:50:01.017 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-27T17:50:01.138 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-27T17:50:01.152 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-27T17:50:01.196 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-27T17:50:01.286 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-portend. 2023-11-27T17:50:01.307 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../032-python3-portend_3.0.0-1_all.deb ... 2023-11-27T17:50:01.344 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-27T17:50:01.345 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests. 2023-11-27T17:50:01.366 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-27T17:50:01.403 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-27T17:50:01.516 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-natsort. 2023-11-27T17:50:01.531 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-27T17:50:01.566 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-27T17:50:01.589 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-27T17:50:01.610 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../033-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-27T17:50:01.639 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-27T17:50:01.715 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-27T17:50:01.736 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-27T17:50:01.773 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-27T17:50:01.894 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-logutils. 2023-11-27T17:50:01.910 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-27T17:50:01.942 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-27T17:50:01.952 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-27T17:50:01.962 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../034-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-27T17:50:02.000 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-27T17:50:02.068 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-27T17:50:02.080 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:02.142 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:02.238 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-27T17:50:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-27T17:50:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-openssl. 2023-11-27T17:50:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-27T17:50:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-27T17:50:05.579 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr. 2023-11-27T17:50:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mon. 2023-11-27T17:50:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mon (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-osd. 2023-11-27T17:50:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:05.580 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-osd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:05.582 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-natsort. 2023-11-27T17:50:05.582 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../035-python3-natsort_8.0.2-1_all.deb ... 2023-11-27T17:50:05.582 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-27T17:50:05.582 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-logutils. 2023-11-27T17:50:05.585 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../036-python3-logutils_0.3.3-8_all.deb ... 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-mako. 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-27T17:50:05.586 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-27T17:50:05.587 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webob. 2023-11-27T17:50:05.587 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-27T17:50:05.587 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-27T17:50:05.587 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-waitress. 2023-11-27T17:50:05.587 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-27T17:50:05.587 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-27T17:50:05.587 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempita. 2023-11-27T17:50:05.587 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-27T17:50:05.587 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../037-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-mako. 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../038-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../039-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../040-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webob. 2023-11-27T17:50:05.588 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../041-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-waitress. 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../042-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-tempita. 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../043-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-paste. 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-27T17:50:05.589 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-27T17:50:05.621 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-27T17:50:05.621 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-27T17:50:05.621 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-27T17:50:05.621 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-27T17:50:05.655 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-paste. 2023-11-27T17:50:05.676 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../044-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-27T17:50:05.713 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-27T17:50:05.916 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-webtest. 2023-11-27T17:50:05.931 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-27T17:50:05.974 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-27T17:50:06.108 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-27T17:50:06.129 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../045-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-27T17:50:06.166 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-27T17:50:06.286 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pecan. 2023-11-27T17:50:06.301 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-27T17:50:06.345 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-27T17:50:06.436 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-27T17:50:06.456 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../046-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-27T17:50:06.494 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-27T17:50:06.732 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-certifi. 2023-11-27T17:50:06.747 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-27T17:50:06.771 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph. 2023-11-27T17:50:06.784 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../060-ceph_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:06.790 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-27T17:50:06.806 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webtest. 2023-11-27T17:50:06.821 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:06.826 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../047-python3-webtest_2.0.35-1_all.deb ... 2023-11-27T17:50:06.864 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-27T17:50:07.110 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-idna. 2023-11-27T17:50:07.115 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-fuse. 2023-11-27T17:50:07.125 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-27T17:50:07.137 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:07.159 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-27T17:50:07.173 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:07.209 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pecan. 2023-11-27T17:50:07.229 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../048-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-27T17:50:07.267 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-27T17:50:07.420 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-urllib3. 2023-11-27T17:50:07.435 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-27T17:50:07.479 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-27T17:50:07.519 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mds. 2023-11-27T17:50:07.540 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:07.576 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mds (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:07.622 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-certifi. 2023-11-27T17:50:07.643 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../049-python3-certifi_2020.6.20-1_all.deb ... 2023-11-27T17:50:07.697 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-27T17:50:07.807 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-requests. 2023-11-27T17:50:07.822 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-27T17:50:07.865 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-27T17:50:07.955 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephadm. 2023-11-27T17:50:07.976 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../063-cephadm_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:08.013 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:08.033 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-idna. 2023-11-27T17:50:08.054 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../050-python3-idna_3.3-1_all.deb ... 2023-11-27T17:50:08.091 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-27T17:50:08.185 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-27T17:50:08.200 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-27T17:50:08.243 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-27T17:50:08.299 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-27T17:50:08.321 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-27T17:50:08.357 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-27T17:50:08.427 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-urllib3. 2023-11-27T17:50:08.449 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../051-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-27T17:50:08.477 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-27T17:50:08.504 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-27T17:50:08.519 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:08.562 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:08.694 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-27T17:50:08.712 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-27T17:50:08.752 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-27T17:50:08.814 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests. 2023-11-27T17:50:08.835 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../052-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-27T17:50:08.872 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-27T17:50:08.961 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-27T17:50:08.975 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:09.019 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:09.176 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-27T17:50:09.196 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../053-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-27T17:50:09.234 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-27T17:50:09.330 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-openssl. 2023-11-27T17:50:09.345 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-27T17:50:09.388 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-27T17:50:09.537 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-27T17:50:09.549 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../054-ceph-mgr-modules-core_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:09.578 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:09.708 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr. 2023-11-27T17:50:09.722 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:09.757 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-babel. 2023-11-27T17:50:09.774 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:09.779 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-27T17:50:09.823 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-27T17:50:09.984 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-27T17:50:10.004 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../055-libsqlite3-mod-ceph_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:10.042 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:10.136 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mon. 2023-11-27T17:50:10.143 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jinja2. 2023-11-27T17:50:10.150 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:10.165 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-27T17:50:10.185 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mon (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:10.210 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-27T17:50:10.311 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-openssl. 2023-11-27T17:50:10.323 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../056-python3-openssl_21.0.0-1_all.deb ... 2023-11-27T17:50:10.378 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-27T17:50:10.731 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr. 2023-11-27T17:50:10.752 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../057-ceph-mgr_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:10.789 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:10.939 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-osd. 2023-11-27T17:50:10.953 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:10.964 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-27T17:50:10.985 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:10.997 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-osd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:11.030 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:11.217 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mon. 2023-11-27T17:50:11.238 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../058-ceph-mon_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:11.275 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mon (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:11.367 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-27T17:50:11.389 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-27T17:50:11.425 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-27T17:50:11.728 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-27T17:50:11.749 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-27T17:50:11.786 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-27T17:50:12.056 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-routes. 2023-11-27T17:50:12.077 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-27T17:50:12.106 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-27T17:50:12.229 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-osd. 2023-11-27T17:50:12.250 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../059-ceph-osd_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:12.252 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph. 2023-11-27T17:50:12.268 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../060-ceph_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:12.279 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-osd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:12.384 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:12.476 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-27T17:50:12.497 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:12.542 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:12.711 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-fuse. 2023-11-27T17:50:12.726 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:12.761 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:12.921 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-27T17:50:12.942 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-27T17:50:12.987 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-27T17:50:13.114 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mds. 2023-11-27T17:50:13.129 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:13.172 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mds (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:13.508 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-joblib. 2023-11-27T17:50:13.529 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-27T17:50:13.534 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephadm. 2023-11-27T17:50:13.549 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../063-cephadm_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:13.574 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-27T17:50:13.592 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:13.928 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-27T17:50:13.943 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-27T17:50:13.944 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-27T17:50:13.966 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-27T17:50:13.987 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-27T17:50:14.011 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-27T17:50:14.241 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph. 2023-11-27T17:50:14.253 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../060-ceph_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:14.272 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-27T17:50:14.287 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-27T17:50:14.297 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn. 2023-11-27T17:50:14.319 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:14.319 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-27T17:50:14.330 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-27T17:50:14.364 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-27T17:50:14.602 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-fuse. 2023-11-27T17:50:14.614 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../061-ceph-fuse_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:14.643 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:15.047 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mds. 2023-11-27T17:50:15.059 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../062-ceph-mds_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:15.064 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-27T17:50:15.086 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:15.097 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mds (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:15.122 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:15.243 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-babel. 2023-11-27T17:50:15.258 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-27T17:50:15.302 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-27T17:50:15.542 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephadm. 2023-11-27T17:50:15.563 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../063-cephadm_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:15.600 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:15.621 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-jinja2. 2023-11-27T17:50:15.635 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-27T17:50:15.680 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-27T17:50:15.845 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-27T17:50:15.856 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../064-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-27T17:50:15.886 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-27T17:50:16.016 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-27T17:50:16.026 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cachetools. 2023-11-27T17:50:16.030 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:16.047 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-27T17:50:16.092 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-27T17:50:16.099 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:16.223 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-27T17:50:16.235 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../065-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-27T17:50:16.273 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-27T17:50:16.387 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-27T17:50:16.409 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-27T17:50:16.427 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-27T17:50:16.442 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-27T17:50:16.453 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-27T17:50:16.486 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-27T17:50:16.788 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-27T17:50:16.790 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-27T17:50:16.803 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-27T17:50:16.812 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-27T17:50:16.847 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-27T17:50:16.857 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-27T17:50:17.142 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-routes. 2023-11-27T17:50:17.156 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-27T17:50:17.168 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rsa. 2023-11-27T17:50:17.190 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-27T17:50:17.191 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-27T17:50:17.234 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-27T17:50:17.512 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-babel. 2023-11-27T17:50:17.533 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../066-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-27T17:50:17.553 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-27T17:50:17.555 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-google-auth. 2023-11-27T17:50:17.567 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:17.576 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-27T17:50:17.578 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-27T17:50:17.602 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:17.621 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-27T17:50:17.957 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jinja2. 2023-11-27T17:50:17.978 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../067-python3-jinja2_3.0.3-1_all.deb ... 2023-11-27T17:50:18.006 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-27T17:50:18.015 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-27T17:50:18.019 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-27T17:50:18.026 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-27T17:50:18.048 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-27T17:50:18.064 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-27T17:50:18.093 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-27T17:50:18.371 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-websocket. 2023-11-27T17:50:18.383 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-27T17:50:18.385 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-27T17:50:18.406 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../068-ceph-mgr-cephadm_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:18.412 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-27T17:50:18.460 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:18.576 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-joblib. 2023-11-27T17:50:18.590 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-27T17:50:18.634 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-27T17:50:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-27T17:50:18.729 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-27T17:50:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-27T17:50:18.830 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-27T17:50:18.851 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../069-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-27T17:50:18.896 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-27T17:50:18.996 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-27T17:50:19.009 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-27T17:50:19.054 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-27T17:50:19.208 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-27T17:50:19.229 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../070-python3-repoze.lru_0.7-2_all.deb ... 2023-11-27T17:50:19.266 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-27T17:50:19.349 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-sklearn. 2023-11-27T17:50:19.362 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-27T17:50:19.407 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-27T17:50:19.413 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-27T17:50:19.435 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:19.479 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:19.644 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-routes. 2023-11-27T17:50:19.666 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../071-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-27T17:50:19.719 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-27T17:50:19.724 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-27T17:50:19.745 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-27T17:50:19.782 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-27T17:50:20.007 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-27T17:50:20.021 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:20.057 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:20.119 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-27T17:50:20.139 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-27T17:50:20.140 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-27T17:50:20.161 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:20.185 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-27T17:50:20.214 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:20.429 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package jq. 2023-11-27T17:50:20.442 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-27T17:50:20.479 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-27T17:50:20.676 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-27T17:50:20.688 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../073-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-27T17:50:20.699 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package socat. 2023-11-27T17:50:20.711 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-27T17:50:20.726 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-27T17:50:20.740 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-27T17:50:20.985 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-cachetools. 2023-11-27T17:50:21.000 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-27T17:50:21.010 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package xmlstarlet. 2023-11-27T17:50:21.023 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-27T17:50:21.043 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-27T17:50:21.051 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-27T17:50:21.331 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-joblib. 2023-11-27T17:50:21.346 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-27T17:50:21.351 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../074-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-27T17:50:21.362 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-27T17:50:21.396 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-27T17:50:21.403 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-27T17:50:21.414 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-test. 2023-11-27T17:50:21.428 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:21.464 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-test (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:21.732 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-27T17:50:21.748 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-27T17:50:21.790 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-27T17:50:21.800 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-27T17:50:21.821 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../075-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-27T17:50:21.858 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-27T17:50:22.135 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-rsa. 2023-11-27T17:50:22.150 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-27T17:50:22.193 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-27T17:50:22.245 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn. 2023-11-27T17:50:22.266 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../076-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-27T17:50:22.311 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-27T17:50:22.655 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-google-auth. 2023-11-27T17:50:22.670 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-27T17:50:22.713 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-27T17:50:23.101 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-27T17:50:23.104 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-27T17:50:23.116 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-27T17:50:23.126 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:23.158 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-27T17:50:23.203 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:23.487 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-websocket. 2023-11-27T17:50:23.502 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-27T17:50:23.545 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-27T17:50:23.840 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-27T17:50:23.856 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-27T17:50:23.897 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-27T17:50:23.968 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-volume. 2023-11-27T17:50:23.990 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:24.035 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-volume (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:24.224 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cachetools. 2023-11-27T17:50:24.245 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../078-python3-cachetools_5.0.0-1_all.deb ... 2023-11-27T17:50:24.290 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-27T17:50:24.431 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-27T17:50:24.453 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:24.497 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:24.620 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-27T17:50:24.626 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-27T17:50:24.634 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:24.648 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-27T17:50:24.670 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:24.693 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-27T17:50:24.776 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-colorama. 2023-11-27T17:50:24.798 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-27T17:50:24.833 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-27T17:50:24.972 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-27T17:50:24.987 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-27T17:50:25.030 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-27T17:50:25.063 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-27T17:50:25.085 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-27T17:50:25.086 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-shell. 2023-11-27T17:50:25.099 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:25.130 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-27T17:50:25.136 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-shell (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:25.375 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-27T17:50:25.390 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-27T17:50:25.397 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-top. 2023-11-27T17:50:25.411 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:25.447 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-top (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:25.458 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-27T17:50:25.476 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rsa. 2023-11-27T17:50:25.498 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../081-python3-rsa_4.8-1_all.deb ... 2023-11-27T17:50:25.543 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-27T17:50:25.683 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-27T17:50:25.696 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:25.733 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs-dev (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:25.744 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package jq. 2023-11-27T17:50:25.759 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-27T17:50:25.802 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-27T17:50:25.838 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-google-auth. 2023-11-27T17:50:25.860 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-3_all.deb ... 2023-11-27T17:50:25.905 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-27T17:50:26.055 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package socat. 2023-11-27T17:50:26.070 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package nvme-cli. 2023-11-27T17:50:26.070 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-27T17:50:26.091 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-27T17:50:26.105 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-27T17:50:26.128 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-27T17:50:26.375 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package xmlstarlet. 2023-11-27T17:50:26.385 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-27T17:50:26.390 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-27T17:50:26.407 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../083-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-27T17:50:26.433 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-27T17:50:26.452 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-27T17:50:26.675 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-27T17:50:26.688 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-27T17:50:26.724 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-27T17:50:26.788 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-websocket. 2023-11-27T17:50:26.792 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-test. 2023-11-27T17:50:26.806 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:26.809 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../084-python3-websocket_1.2.3-1_all.deb ... 2023-11-27T17:50:26.845 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-test (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:26.854 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-27T17:50:27.094 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-27T17:50:27.116 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-27T17:50:27.160 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-27T17:50:27.250 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-27T17:50:27.271 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../085-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-27T17:50:27.463 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastescript. 2023-11-27T17:50:27.485 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-27T17:50:27.516 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-27T17:50:27.530 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-27T17:50:27.867 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pluggy. 2023-11-27T17:50:27.889 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-27T17:50:27.933 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-27T17:50:28.230 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-27T17:50:28.245 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-psutil. 2023-11-27T17:50:28.253 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../086-ceph-mgr-k8sevents_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:28.266 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-27T17:50:28.311 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-27T17:50:28.313 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:28.600 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-27T17:50:28.622 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../087-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-27T17:50:28.656 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-py. 2023-11-27T17:50:28.657 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ceph-volume. 2023-11-27T17:50:28.666 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-27T17:50:28.672 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:28.677 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-27T17:50:28.715 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ceph-volume (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:28.722 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-27T17:50:29.034 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pygments. 2023-11-27T17:50:29.045 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-27T17:50:29.056 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-27T17:50:29.061 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-27T17:50:29.066 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../088-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-27T17:50:29.076 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:29.100 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-27T17:50:29.111 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-27T17:50:29.119 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:29.405 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package jq. 2023-11-27T17:50:29.418 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../089-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-27T17:50:29.439 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-colorama. 2023-11-27T17:50:29.455 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-27T17:50:29.455 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-27T17:50:29.497 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-27T17:50:29.555 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-27T17:50:29.577 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-27T17:50:29.621 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-27T17:50:29.700 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package socat. 2023-11-27T17:50:29.712 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../090-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-27T17:50:29.742 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-27T17:50:29.791 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-shell. 2023-11-27T17:50:29.807 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:29.850 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-shell (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:29.883 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-toml. 2023-11-27T17:50:29.905 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-27T17:50:29.941 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-27T17:50:30.045 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package xmlstarlet. 2023-11-27T17:50:30.057 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../091-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-27T17:50:30.086 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package cephfs-top. 2023-11-27T17:50:30.094 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-27T17:50:30.101 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:30.144 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking cephfs-top (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:30.236 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pytest. 2023-11-27T17:50:30.258 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-27T17:50:30.302 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-27T17:50:30.397 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-27T17:50:30.412 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:30.455 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcephfs-dev (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:30.483 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-test. 2023-11-27T17:50:30.504 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../092-ceph-test_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:30.549 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-test (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:30.606 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplejson. 2023-11-27T17:50:30.628 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-27T17:50:30.672 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-27T17:50:30.916 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package nvme-cli. 2023-11-27T17:50:30.931 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-27T17:50:30.950 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-27T17:50:30.969 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-27T17:50:30.974 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-27T17:50:31.000 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-27T17:50:31.321 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-27T17:50:31.335 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-27T17:50:31.379 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-27T17:50:31.713 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package radosgw. 2023-11-27T17:50:31.735 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../112-radosgw_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:31.779 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking radosgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:31.790 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-27T17:50:31.804 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-27T17:50:31.848 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-27T17:50:32.193 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pastescript. 2023-11-27T17:50:32.208 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-27T17:50:32.251 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-27T17:50:32.549 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package rbd-fuse. 2023-11-27T17:50:32.554 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pluggy. 2023-11-27T17:50:32.562 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:32.569 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-27T17:50:32.599 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking rbd-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:32.612 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-27T17:50:32.893 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-27T17:50:32.903 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-volume. 2023-11-27T17:50:32.907 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-psutil. 2023-11-27T17:50:32.922 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-27T17:50:32.925 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../093-ceph-volume_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:32.965 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-27T17:50:32.970 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-volume (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:33.154 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-27T17:50:33.271 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-27T17:50:33.326 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-py. 2023-11-27T17:50:33.342 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-27T17:50:33.349 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-27T17:50:33.371 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../094-cephfs-mirror_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:33.384 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-27T17:50:33.416 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:33.528 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-27T17:50:33.713 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pygments. 2023-11-27T17:50:33.728 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-27T17:50:33.761 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-colorama. 2023-11-27T17:50:33.771 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-27T17:50:33.783 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../095-python3-colorama_0.4.4-1_all.deb ... 2023-11-27T17:50:33.827 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-27T17:50:33.923 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-27T17:50:34.089 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-shell. 2023-11-27T17:50:34.110 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../096-cephfs-shell_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:34.155 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-shell (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:34.166 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-27T17:50:34.180 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-27T17:50:34.216 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-27T17:50:34.377 INFO:teuthology.orchestra.run.smithi031.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-27T17:50:34.424 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephfs-top. 2023-11-27T17:50:34.437 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../097-cephfs-top_18.0.0-7498-g369173db-1jammy_all.deb ... 2023-11-27T17:50:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephfs-top (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:34.552 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-toml. 2023-11-27T17:50:34.566 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-27T17:50:34.610 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-27T17:50:34.624 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:34.761 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-27T17:50:34.782 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../098-libcephfs-dev_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:34.827 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs-dev (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:34.888 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-pytest. 2023-11-27T17:50:34.902 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-27T17:50:34.937 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-27T17:50:35.184 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user cephadm....done 2023-11-27T17:50:35.205 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package nvme-cli. 2023-11-27T17:50:35.227 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../099-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-27T17:50:35.274 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package python3-simplejson. 2023-11-27T17:50:35.288 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-27T17:50:35.297 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-27T17:50:35.332 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-27T17:50:35.338 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-27T17:50:35.606 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-27T17:50:35.635 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-27T17:50:35.644 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-27T17:50:35.650 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-27T17:50:35.665 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../100-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-27T17:50:35.693 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-27T17:50:35.710 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-27T17:50:35.849 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-27T17:50:35.958 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-27T17:50:36.180 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-27T17:50:36.201 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../101-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-27T17:50:36.247 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-27T17:50:36.276 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-27T17:50:36.364 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package radosgw. 2023-11-27T17:50:36.378 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../112-radosgw_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:36.413 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking radosgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:36.535 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-27T17:50:36.574 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastescript. 2023-11-27T17:50:36.596 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../102-python3-pastescript_2.0.2-4_all.deb ... 2023-11-27T17:50:36.641 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-27T17:50:36.662 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-27T17:50:36.966 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package rbd-fuse. 2023-11-27T17:50:36.970 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pluggy. 2023-11-27T17:50:36.981 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:36.991 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../103-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-27T17:50:37.013 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-27T17:50:37.024 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking rbd-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:37.036 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-27T17:50:37.308 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-27T17:50:37.356 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-psutil. 2023-11-27T17:50:37.377 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../104-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-27T17:50:37.382 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-27T17:50:37.444 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-27T17:50:37.571 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-27T17:50:37.650 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-27T17:50:37.697 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-27T17:50:37.784 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-py. 2023-11-27T17:50:37.806 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../105-python3-py_1.10.0-1_all.deb ... 2023-11-27T17:50:37.850 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-27T17:50:37.909 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-27T17:50:38.185 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-27T17:50:38.195 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pygments. 2023-11-27T17:50:38.217 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../106-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-27T17:50:38.239 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-27T17:50:38.262 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-27T17:50:38.437 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-27T17:50:38.651 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-27T17:50:38.758 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-27T17:50:38.771 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-27T17:50:38.780 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-27T17:50:38.824 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-27T17:50:39.055 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-argparse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:39.161 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-toml. 2023-11-27T17:50:39.183 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../108-python3-toml_0.10.2-1_all.deb ... 2023-11-27T17:50:39.219 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-27T17:50:39.264 INFO:teuthology.orchestra.run.smithi176.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-27T17:50:39.307 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-27T17:50:39.311 INFO:teuthology.orchestra.run.smithi176.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-27T17:50:39.356 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:39.433 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-27T17:50:39.505 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pytest. 2023-11-27T17:50:39.527 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../109-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-27T17:50:39.571 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-27T17:50:39.700 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-27T17:50:39.885 INFO:teuthology.orchestra.run.smithi176.stdout:Adding system user cephadm....done 2023-11-27T17:50:39.909 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplejson. 2023-11-27T17:50:39.931 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../110-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-27T17:50:39.960 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T17:50:39.975 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-27T17:50:40.046 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-27T17:50:40.086 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-27T17:50:40.278 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-27T17:50:40.290 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../111-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-27T17:50:40.329 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-27T17:50:40.372 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-27T17:50:40.471 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-27T17:50:40.605 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-27T17:50:40.623 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-27T17:50:40.749 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-27T17:50:40.856 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-27T17:50:41.001 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-27T17:50:41.107 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-27T17:50:41.124 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package radosgw. 2023-11-27T17:50:41.145 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../112-radosgw_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:41.190 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking radosgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:41.268 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-27T17:50:41.394 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-27T17:50:41.409 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-27T17:50:41.712 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-27T17:50:42.010 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package rbd-fuse. 2023-11-27T17:50:42.023 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../113-rbd-fuse_18.0.0-7498-g369173db-1jammy_amd64.deb ... 2023-11-27T17:50:42.060 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking rbd-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:42.089 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-27T17:50:42.102 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-27T17:50:42.348 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-27T17:50:42.370 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-27T17:50:42.378 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-27T17:50:42.496 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-27T17:50:42.616 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-27T17:50:42.631 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-27T17:50:42.648 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-27T17:50:42.774 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-27T17:50:42.932 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-27T17:50:42.934 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-27T17:50:43.071 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-27T17:50:43.193 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-27T17:50:43.383 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-27T17:50:43.409 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-27T17:50:43.469 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-27T17:50:43.651 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-27T17:50:43.729 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-ceph-argparse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:43.916 INFO:teuthology.orchestra.run.smithi081.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-27T17:50:43.996 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-27T17:50:44.043 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:44.044 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-27T17:50:44.105 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-27T17:50:44.337 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-27T17:50:44.365 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-27T17:50:44.628 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user cephadm....done 2023-11-27T17:50:44.632 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T17:50:44.647 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-27T17:50:44.758 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-27T17:50:44.774 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-27T17:50:44.998 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-27T17:50:45.094 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-27T17:50:45.110 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-27T17:50:45.236 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-27T17:50:45.249 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-27T17:50:45.352 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-27T17:50:45.375 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:45.470 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-27T17:50:45.512 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-27T17:50:45.676 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-idna (3.3-1) ... 2023-11-27T17:50:45.730 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-27T17:50:45.788 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-27T17:50:45.997 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-27T17:50:46.011 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-27T17:50:46.097 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-27T17:50:46.123 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-27T17:50:46.459 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-27T17:50:46.811 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-27T17:50:46.816 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-27T17:50:47.062 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-27T17:50:47.075 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-27T17:50:47.193 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-27T17:50:47.218 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:50:47.320 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-27T17:50:47.322 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-27T17:50:47.352 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-27T17:50:47.606 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-27T17:50:47.612 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-27T17:50:47.637 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-27T17:50:47.721 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-27T17:50:47.831 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-27T17:50:47.865 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-27T17:50:48.038 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-27T17:50:48.132 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-27T17:50:48.281 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-27T17:50:48.392 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-27T17:50:48.475 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-27T17:50:48.651 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:50:48.682 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-27T17:50:48.743 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-argparse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:48.819 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-27T17:50:48.993 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-27T17:50:49.002 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-27T17:50:49.137 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-27T17:50:49.137 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-27T17:50:49.301 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-27T17:50:49.371 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-27T17:50:49.396 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-27T17:50:49.639 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-27T17:50:49.661 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-27T17:50:49.706 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T17:50:49.832 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-27T17:50:49.890 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-27T17:50:49.921 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-27T17:50:50.046 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:50.133 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-27T17:50:50.200 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-27T17:50:50.326 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-27T17:50:50.348 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-idna (3.3-1) ... 2023-11-27T17:50:50.392 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-27T17:50:50.518 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-27T17:50:50.602 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-27T17:50:50.691 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-27T17:50:50.802 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-27T17:50:50.845 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-27T17:50:50.920 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-27T17:50:51.171 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-27T17:50:51.213 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-27T17:50:51.531 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-27T17:50:51.790 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-27T17:50:51.823 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-27T17:50:51.913 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:50:52.047 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-27T17:50:52.091 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-27T17:50:52.209 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-27T17:50:52.259 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-27T17:50:52.323 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-27T17:50:52.385 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-27T17:50:52.449 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-27T17:50:52.476 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-27T17:50:52.583 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-27T17:50:52.602 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-27T17:50:52.669 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-27T17:50:52.885 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-27T17:50:53.012 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-27T17:50:53.070 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-27T17:50:53.152 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-27T17:50:53.255 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-27T17:50:53.330 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-27T17:50:53.420 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:50:53.522 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:50:53.546 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-27T17:50:53.632 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-27T17:50:53.698 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-27T17:50:53.856 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-27T17:50:53.958 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-27T17:50:54.024 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-27T17:50:54.115 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-27T17:50:54.284 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-27T17:50:54.368 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-27T17:50:54.385 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-27T17:50:54.560 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-27T17:50:54.653 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-27T17:50:54.686 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-27T17:50:54.727 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-27T17:50:54.912 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-27T17:50:54.954 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-27T17:50:54.970 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-27T17:50:55.088 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:55.171 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-27T17:50:55.222 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-27T17:50:55.306 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-27T17:50:55.381 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-idna (3.3-1) ... 2023-11-27T17:50:55.490 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-27T17:50:55.590 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-27T17:50:55.731 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-27T17:50:55.740 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-27T17:50:55.883 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-27T17:50:56.026 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-27T17:50:56.176 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-27T17:50:56.344 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-27T17:50:56.578 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-27T17:50:56.603 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-27T17:50:56.687 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librados2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:56.788 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librgw2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:56.905 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:50:56.906 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:57.007 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-27T17:50:57.039 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-27T17:50:57.176 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:57.289 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-27T17:50:57.348 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-27T17:50:57.415 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-27T17:50:57.474 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-27T17:50:57.610 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libradosstriper1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:57.642 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-27T17:50:57.736 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-27T17:50:57.800 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-27T17:50:57.935 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-27T17:50:58.037 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librbd1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:58.101 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-27T17:50:58.138 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-modules-core (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:58.264 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:58.278 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-27T17:50:58.377 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:50:58.483 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-27T17:50:58.483 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-27T17:50:58.494 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-27T17:50:58.521 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:50:58.647 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-27T17:50:58.821 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-27T17:50:59.015 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-27T17:50:59.049 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs-dev (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:59.130 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-27T17:50:59.175 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rados (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:59.283 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-27T17:50:59.301 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-top (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:50:59.406 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-27T17:50:59.427 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-27T17:50:59.532 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-27T17:50:59.559 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-27T17:50:59.808 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-27T17:50:59.819 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-27T17:51:00.053 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-27T17:51:00.067 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-27T17:51:00.296 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-27T17:51:00.336 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-27T17:51:00.455 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-27T17:51:00.698 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:00.720 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-27T17:51:00.740 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-27T17:51:00.824 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up rbd-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:00.891 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-27T17:51:00.950 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:01.005 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-27T17:51:01.076 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cephfs (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:01.202 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-shell (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:01.226 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-27T17:51:01.328 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:01.357 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-27T17:51:01.482 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librados2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:01.527 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-27T17:51:01.609 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librgw2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:01.761 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-27T17:51:01.776 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:01.845 INFO:teuthology.orchestra.run.smithi031.stdout:Adding group ceph....done 2023-11-27T17:51:01.971 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcephfs2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:02.097 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libradosstriper1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:02.149 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-27T17:51:02.222 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user ceph....done 2023-11-27T17:51:02.223 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-27T17:51:02.399 INFO:teuthology.orchestra.run.smithi031.stdout:Setting system user ceph properties....done 2023-11-27T17:51:02.413 INFO:teuthology.orchestra.run.smithi031.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-27T17:51:02.439 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-27T17:51:02.524 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up librbd1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:02.555 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-27T17:51:02.598 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-27T17:51:02.650 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-modules-core (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:02.776 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:02.900 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-27T17:51:02.992 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-27T17:51:03.020 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-27T17:51:03.020 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-27T17:51:03.285 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-27T17:51:03.446 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:03.519 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-27T17:51:03.658 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-27T17:51:03.659 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-27T17:51:03.661 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcephfs-dev (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:03.679 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-27T17:51:03.779 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rados (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:03.880 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-top (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:03.996 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-27T17:51:04.031 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-27T17:51:04.180 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-test (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:04.315 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-27T17:51:04.315 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up radosgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:04.599 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-27T17:51:04.758 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-27T17:51:04.828 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-27T17:51:04.828 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-27T17:51:05.051 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-27T17:51:05.302 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-27T17:51:05.310 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:05.333 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-base (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:05.436 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up rbd-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:05.553 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-27T17:51:05.562 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-rgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:05.688 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up python3-cephfs (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:05.697 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-27T17:51:05.814 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-shell (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:05.931 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:05.946 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-27T17:51:06.201 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mds (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:06.239 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-27T17:51:06.447 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-27T17:51:06.447 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-27T17:51:06.477 INFO:teuthology.orchestra.run.smithi176.stdout:Adding group ceph....done 2023-11-27T17:51:06.633 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-27T17:51:06.760 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librados2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:06.869 INFO:teuthology.orchestra.run.smithi176.stdout:Adding system user ceph....done 2023-11-27T17:51:06.902 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librgw2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:06.961 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:07.020 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:07.064 INFO:teuthology.orchestra.run.smithi176.stdout:Setting system user ceph properties....done 2023-11-27T17:51:07.082 INFO:teuthology.orchestra.run.smithi176.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-27T17:51:07.157 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-27T17:51:07.157 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-27T17:51:07.224 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-27T17:51:07.232 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs2 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:07.408 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libradosstriper1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:07.559 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-27T17:51:07.639 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-27T17:51:07.712 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-osd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librbd1 (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:07.978 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-modules-core (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:08.064 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-27T17:51:08.065 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-27T17:51:08.113 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:08.308 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up cephfs-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:08.345 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-27T17:51:08.345 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-27T17:51:08.499 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-27T17:51:08.499 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-27T17:51:08.581 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:08.707 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:08.858 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mon (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:08.898 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs-dev (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:09.057 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rados (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:09.150 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-test (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:09.163 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-27T17:51:09.163 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-27T17:51:09.183 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-top (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:09.285 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up radosgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:09.318 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-27T17:51:09.718 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:09.805 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-27T17:51:09.805 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-27T17:51:09.861 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:10.114 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-dashboard (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:10.390 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-volume (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:10.445 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-base (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rbd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:10.632 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up rbd-fuse (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:10.803 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-27T17:51:10.808 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:10.860 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-27T17:51:10.951 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cephfs (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:11.077 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-shell (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:11.253 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-common (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:11.455 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mds (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:11.673 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-27T17:51:11.686 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-27T17:51:11.686 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-27T17:51:11.896 INFO:teuthology.orchestra.run.smithi081.stdout:Adding group ceph....done 2023-11-27T17:51:12.149 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-27T17:51:12.152 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-27T17:51:12.212 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2023-11-27T17:51:12.281 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user ceph....done 2023-11-27T17:51:12.331 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:12.404 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2023-11-27T17:51:12.405 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2023-11-27T17:51:12.441 INFO:teuthology.orchestra.run.smithi081.stdout:Setting system user ceph properties....done 2023-11-27T17:51:12.457 INFO:teuthology.orchestra.run.smithi081.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-27T17:51:12.530 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-27T17:51:12.530 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-27T17:51:12.579 INFO:teuthology.orchestra.run.smithi031.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-27T17:51:12.579 INFO:teuthology.orchestra.run.smithi031.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-27T17:51:12.579 INFO:teuthology.orchestra.run.smithi031.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-27T17:51:12.579 INFO:teuthology.orchestra.run.smithi031.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-27T17:51:12.579 INFO:teuthology.orchestra.run.smithi031.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-27T17:51:12.580 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:51:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T17:51:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T17:51:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T17:51:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-27T17:51:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: python2.7-minimal 2023-11-27T17:51:12.581 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:51:12.581 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2023-11-27T17:51:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-27T17:51:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-27T17:51:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-27T17:51:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-27T17:51:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-27T17:51:12.583 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2023-11-27T17:51:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-27T17:51:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-27T17:51:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: libengine-pkcs11-openssl 2023-11-27T17:51:12.590 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-27T17:51:12.621 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2023-11-27T17:51:12.622 INFO:teuthology.orchestra.run.smithi031.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-27T17:51:12.622 INFO:teuthology.orchestra.run.smithi031.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-27T17:51:12.623 INFO:teuthology.orchestra.run.smithi031.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-27T17:51:12.623 INFO:teuthology.orchestra.run.smithi031.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-27T17:51:12.623 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-27T17:51:12.623 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-27T17:51:12.623 INFO:teuthology.orchestra.run.smithi031.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-27T17:51:12.624 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages will be upgraded: 2023-11-27T17:51:12.625 INFO:teuthology.orchestra.run.smithi031.stdout: libssl3 2023-11-27T17:51:12.681 INFO:teuthology.orchestra.run.smithi031.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-27T17:51:12.681 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 54.6 MB of archives. 2023-11-27T17:51:12.681 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-27T17:51:12.681 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-27T17:51:12.785 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-27T17:51:12.848 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-27T17:51:12.862 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-27T17:51:12.863 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-27T17:51:12.866 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-27T17:51:12.867 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-27T17:51:12.868 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-27T17:51:12.870 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-27T17:51:12.871 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-27T17:51:12.872 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-27T17:51:12.872 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-27T17:51:12.887 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-27T17:51:12.950 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-27T17:51:13.191 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-osd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:13.217 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-27T17:51:13.219 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-27T17:51:13.220 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-27T17:51:13.222 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-27T17:51:13.222 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-27T17:51:13.226 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-27T17:51:13.228 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-27T17:51:13.234 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-27T17:51:13.234 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-27T17:51:13.254 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-27T17:51:13.254 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-27T17:51:13.264 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-27T17:51:13.288 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-27T17:51:13.291 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-27T17:51:13.292 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-27T17:51:13.293 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-27T17:51:13.293 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-27T17:51:13.304 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-27T17:51:13.305 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-27T17:51:13.480 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephfs-mirror (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:13.509 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-27T17:51:13.550 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-27T17:51:13.550 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-27T17:51:13.551 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-27T17:51:13.551 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-27T17:51:13.551 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-27T17:51:13.552 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-27T17:51:13.552 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-27T17:51:13.552 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-27T17:51:13.553 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-27T17:51:13.810 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-27T17:51:13.810 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-27T17:51:13.942 INFO:teuthology.orchestra.run.smithi031.stdout:Preconfiguring packages ... 2023-11-27T17:51:14.093 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 54.6 MB in 1s (61.4 MB/s) 2023-11-27T17:51:14.152 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:14.213 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package flex. 2023-11-27T17:51:14.278 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:14.298 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137419 files and directories currently installed.) 2023-11-27T17:51:14.303 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-27T17:51:14.345 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-27T17:51:14.348 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-test (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:14.420 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mon (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:14.474 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up radosgw (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:14.630 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-27T17:51:14.630 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-27T17:51:14.897 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-27T17:51:15.005 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-27T17:51:15.005 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-27T17:51:15.084 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-27T17:51:15.263 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:15.406 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:15.475 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T17:51:15.532 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-mgr-dashboard (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:15.560 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-base (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:15.666 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ceph-volume (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:15.957 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-27T17:51:15.976 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package bison. 2023-11-27T17:51:16.010 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-27T17:51:16.066 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137492 files and directories currently installed.) 2023-11-27T17:51:16.071 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-27T17:51:16.120 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-27T17:51:16.470 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mds (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:16.562 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-27T17:51:16.584 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-27T17:51:16.628 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-27T17:51:16.721 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-27T17:51:16.722 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-27T17:51:16.948 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package dump. 2023-11-27T17:51:16.970 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-27T17:51:17.023 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking dump (0.4b47-3) ... 2023-11-27T17:51:17.169 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-27T17:51:17.263 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:17.310 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package indent. 2023-11-27T17:51:17.323 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:17.361 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-27T17:51:17.501 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-27T17:51:17.501 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-27T17:51:17.621 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-27T17:51:17.633 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-27T17:51:17.637 INFO:teuthology.orchestra.run.smithi176.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-27T17:51:17.642 DEBUG:teuthology.orchestra.run.smithi176:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-27T17:51:17.670 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-27T17:51:17.717 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2023-11-27T17:51:17.891 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2023-11-27T17:51:17.892 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2023-11-27T17:51:17.974 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-27T17:51:17.997 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-27T17:51:18.041 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-27T17:51:18.048 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-osd (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:18.050 INFO:teuthology.orchestra.run.smithi176.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-27T17:51:18.050 INFO:teuthology.orchestra.run.smithi176.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-27T17:51:18.050 INFO:teuthology.orchestra.run.smithi176.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-27T17:51:18.050 INFO:teuthology.orchestra.run.smithi176.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-27T17:51:18.050 INFO:teuthology.orchestra.run.smithi176.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-27T17:51:18.050 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:51:18.050 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T17:51:18.050 INFO:teuthology.orchestra.run.smithi176.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T17:51:18.051 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T17:51:18.052 INFO:teuthology.orchestra.run.smithi176.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-27T17:51:18.052 INFO:teuthology.orchestra.run.smithi176.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-27T17:51:18.052 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:51:18.052 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2023-11-27T17:51:18.052 INFO:teuthology.orchestra.run.smithi176.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-27T17:51:18.052 INFO:teuthology.orchestra.run.smithi176.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-27T17:51:18.052 INFO:teuthology.orchestra.run.smithi176.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-27T17:51:18.052 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-27T17:51:18.053 INFO:teuthology.orchestra.run.smithi176.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-27T17:51:18.053 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2023-11-27T17:51:18.053 INFO:teuthology.orchestra.run.smithi176.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-27T17:51:18.053 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-27T17:51:18.053 INFO:teuthology.orchestra.run.smithi176.stdout: libengine-pkcs11-openssl 2023-11-27T17:51:18.102 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2023-11-27T17:51:18.102 INFO:teuthology.orchestra.run.smithi176.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-27T17:51:18.103 INFO:teuthology.orchestra.run.smithi176.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-27T17:51:18.103 INFO:teuthology.orchestra.run.smithi176.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-27T17:51:18.103 INFO:teuthology.orchestra.run.smithi176.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-27T17:51:18.103 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-27T17:51:18.103 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-27T17:51:18.104 INFO:teuthology.orchestra.run.smithi176.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-27T17:51:18.104 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages will be upgraded: 2023-11-27T17:51:18.105 INFO:teuthology.orchestra.run.smithi176.stdout: libssl3 2023-11-27T17:51:18.210 INFO:teuthology.orchestra.run.smithi176.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-27T17:51:18.210 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 54.6 MB of archives. 2023-11-27T17:51:18.210 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-27T17:51:18.210 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-27T17:51:18.360 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-27T17:51:18.361 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-27T17:51:18.462 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-27T17:51:18.470 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-27T17:51:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-27T17:51:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-27T17:51:18.622 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-27T17:51:18.644 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-27T17:51:18.645 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-27T17:51:18.649 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-27T17:51:18.650 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-27T17:51:18.652 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-27T17:51:18.654 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-27T17:51:18.656 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-27T17:51:18.656 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-27T17:51:18.679 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-27T17:51:18.719 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-27T17:51:18.816 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-27T17:51:18.838 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-27T17:51:18.874 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-27T17:51:19.003 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:19.112 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:19.168 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-27T17:51:19.190 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-27T17:51:19.234 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-27T17:51:19.263 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mon (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:19.399 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-27T17:51:19.401 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-27T17:51:19.401 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-27T17:51:19.404 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-27T17:51:19.404 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-27T17:51:19.408 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-27T17:51:19.410 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-27T17:51:19.432 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-27T17:51:19.432 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-27T17:51:19.458 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-27T17:51:19.465 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-27T17:51:19.475 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-27T17:51:19.476 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-27T17:51:19.482 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-27T17:51:19.518 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-27T17:51:19.524 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-27T17:51:19.524 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-27T17:51:19.525 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-27T17:51:19.526 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-27T17:51:19.555 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-27T17:51:19.559 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-27T17:51:19.604 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjson-perl. 2023-11-27T17:51:19.626 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-27T17:51:19.671 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-27T17:51:19.905 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-27T17:51:19.905 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-27T17:51:19.905 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-27T17:51:19.905 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-27T17:51:19.905 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-27T17:51:19.905 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-27T17:51:19.923 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-27T17:51:19.923 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-27T17:51:19.991 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-27T17:51:20.013 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-27T17:51:20.049 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-27T17:51:20.056 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-cephadm (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:20.223 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:20.302 INFO:teuthology.orchestra.run.smithi176.stdout:Preconfiguring packages ... 2023-11-27T17:51:20.375 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-dashboard (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:20.452 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 54.6 MB in 2s (30.1 MB/s) 2023-11-27T17:51:20.534 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-volume (18.0.0-7498-g369173db-1jammy) ... 2023-11-27T17:51:20.542 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package flex. 2023-11-27T17:51:20.616 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139845 files and directories currently installed.) 2023-11-27T17:51:20.620 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-27T17:51:20.683 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-27T17:51:20.879 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-27T17:51:21.236 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-27T17:51:21.413 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-27T17:51:21.718 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-27T17:51:21.741 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-27T17:51:21.746 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-27T17:51:21.784 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T17:51:21.819 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T17:51:22.054 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-27T17:51:22.067 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-27T17:51:22.104 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T17:51:22.209 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-27T17:51:22.214 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-27T17:51:22.271 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2023-11-27T17:51:22.356 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package bison. 2023-11-27T17:51:22.429 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139918 files and directories currently installed.) 2023-11-27T17:51:22.432 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-27T17:51:22.432 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-27T17:51:22.454 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-27T17:51:22.458 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2023-11-27T17:51:22.459 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2023-11-27T17:51:22.483 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-27T17:51:22.498 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T17:51:22.622 INFO:teuthology.orchestra.run.smithi081.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-27T17:51:22.622 INFO:teuthology.orchestra.run.smithi081.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-27T17:51:22.622 INFO:teuthology.orchestra.run.smithi081.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-27T17:51:22.623 INFO:teuthology.orchestra.run.smithi081.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-27T17:51:22.623 INFO:teuthology.orchestra.run.smithi081.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-27T17:51:22.623 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:51:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-27T17:51:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-27T17:51:22.623 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-27T17:51:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-27T17:51:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: python2.7-minimal 2023-11-27T17:51:22.624 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:51:22.624 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2023-11-27T17:51:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-27T17:51:22.624 INFO:teuthology.orchestra.run.smithi081.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-27T17:51:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-27T17:51:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-27T17:51:22.625 INFO:teuthology.orchestra.run.smithi081.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-27T17:51:22.626 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2023-11-27T17:51:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-27T17:51:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-27T17:51:22.626 INFO:teuthology.orchestra.run.smithi081.stdout: libengine-pkcs11-openssl 2023-11-27T17:51:22.659 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2023-11-27T17:51:22.660 INFO:teuthology.orchestra.run.smithi081.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-27T17:51:22.660 INFO:teuthology.orchestra.run.smithi081.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-27T17:51:22.660 INFO:teuthology.orchestra.run.smithi081.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-27T17:51:22.660 INFO:teuthology.orchestra.run.smithi081.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-27T17:51:22.661 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-27T17:51:22.661 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-27T17:51:22.661 INFO:teuthology.orchestra.run.smithi081.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-27T17:51:22.661 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2023-11-27T17:51:22.662 INFO:teuthology.orchestra.run.smithi081.stdout: libssl3 2023-11-27T17:51:22.801 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-27T17:51:22.814 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-27T17:51:22.842 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-27T17:51:22.900 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-27T17:51:22.914 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-27T17:51:22.975 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-27T17:51:23.162 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-27T17:51:23.184 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-27T17:51:23.229 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-27T17:51:23.303 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package dump. 2023-11-27T17:51:23.318 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-27T17:51:23.361 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking dump (0.4b47-3) ... 2023-11-27T17:51:23.614 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package indent. 2023-11-27T17:51:23.616 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-27T17:51:23.629 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:23.638 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:23.672 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-27T17:51:23.682 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:23.908 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-27T17:51:23.924 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-27T17:51:23.966 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-27T17:51:23.977 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-27T17:51:23.999 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:24.035 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T17:51:24.362 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-27T17:51:24.376 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:24.421 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T17:51:24.447 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-27T17:51:24.463 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-27T17:51:24.505 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-27T17:51:24.665 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-27T17:51:24.678 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-27T17:51:24.723 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T17:51:24.766 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-27T17:51:24.781 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-27T17:51:24.824 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-27T17:51:25.127 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-27T17:51:25.143 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-27T17:51:25.177 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-27T17:51:25.308 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-27T17:51:25.331 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-27T17:51:25.376 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-27T17:51:25.454 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-27T17:51:25.471 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-27T17:51:25.513 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-27T17:51:25.729 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package modemmanager. 2023-11-27T17:51:25.740 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libjson-perl. 2023-11-27T17:51:25.752 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-27T17:51:25.756 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-27T17:51:25.790 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-27T17:51:25.796 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T17:51:26.085 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-27T17:51:26.101 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-27T17:51:26.143 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-27T17:51:26.419 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package network-manager. 2023-11-27T17:51:26.441 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-27T17:51:26.494 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-27T17:51:27.118 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ppp. 2023-11-27T17:51:27.140 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-27T17:51:27.451 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-27T17:51:27.479 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-27T17:51:27.495 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-27T17:51:27.537 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T17:51:27.755 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package pptp-linux. 2023-11-27T17:51:27.778 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-27T17:51:27.822 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-27T17:51:27.822 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-27T17:51:27.839 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-27T17:51:27.881 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T17:51:28.083 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-27T17:51:28.105 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-27T17:51:28.150 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-27T17:51:28.175 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-27T17:51:28.191 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-27T17:51:28.225 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T17:51:28.453 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-27T17:51:28.475 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-27T17:51:28.519 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client-common (238) ... 2023-11-27T17:51:28.561 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-27T17:51:28.577 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-27T17:51:28.619 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-27T17:51:28.972 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-27T17:51:28.987 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-27T17:51:29.030 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-27T17:51:29.316 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-27T17:51:29.338 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:29.399 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:29.416 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-27T17:51:29.432 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:29.483 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:29.772 INFO:teuthology.orchestra.run.smithi081.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-27T17:51:29.772 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 54.6 MB of archives. 2023-11-27T17:51:29.772 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-27T17:51:29.772 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-27T17:51:29.819 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-27T17:51:29.835 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:29.877 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T17:51:29.967 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-27T17:51:29.995 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-common. 2023-11-27T17:51:30.017 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-27T17:51:30.081 INFO:teuthology.orchestra.run.smithi031.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-27T17:51:30.104 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-27T17:51:30.110 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-common (238) ... 2023-11-27T17:51:30.124 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-27T17:51:30.126 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-27T17:51:30.130 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-27T17:51:30.136 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-27T17:51:30.137 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-27T17:51:30.140 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-27T17:51:30.142 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-27T17:51:30.142 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-27T17:51:30.143 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-27T17:51:30.165 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-27T17:51:30.188 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-27T17:51:30.204 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:30.246 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T17:51:30.498 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-27T17:51:30.514 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-27T17:51:30.556 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T17:51:30.560 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-14. 2023-11-27T17:51:30.582 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:30.630 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:30.695 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-27T17:51:30.698 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-27T17:51:30.756 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-27T17:51:30.762 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-27T17:51:30.763 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-27T17:51:30.772 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-27T17:51:30.776 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-27T17:51:30.792 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-27T17:51:30.792 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-27T17:51:30.830 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-27T17:51:30.830 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-27T17:51:30.842 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-27T17:51:30.862 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-27T17:51:30.866 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-27T17:51:30.868 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-27T17:51:30.868 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-27T17:51:30.868 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-27T17:51:30.893 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-27T17:51:30.896 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-27T17:51:31.018 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-27T17:51:31.034 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-27T17:51:31.068 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-27T17:51:31.279 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-27T17:51:31.279 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-27T17:51:31.279 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-27T17:51:31.279 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-27T17:51:31.280 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-27T17:51:31.280 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-27T17:51:31.297 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-27T17:51:31.297 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-27T17:51:31.454 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package modemmanager. 2023-11-27T17:51:31.470 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-27T17:51:31.512 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T17:51:31.699 INFO:teuthology.orchestra.run.smithi081.stdout:Preconfiguring packages ... 2023-11-27T17:51:31.930 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql. 2023-11-27T17:51:31.953 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-27T17:51:31.961 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 54.6 MB in 9s (6,326 kB/s) 2023-11-27T17:51:31.996 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql (14+238) ... 2023-11-27T17:51:32.105 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package flex. 2023-11-27T17:51:32.126 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package network-manager. 2023-11-27T17:51:32.142 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-27T17:51:32.185 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-27T17:51:32.193 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137419 files and directories currently installed.) 2023-11-27T17:51:32.198 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-27T17:51:32.240 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client. 2023-11-27T17:51:32.253 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-27T17:51:32.262 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-27T17:51:32.306 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client (14+238) ... 2023-11-27T17:51:32.552 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-27T17:51:32.565 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-27T17:51:32.602 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-27T17:51:32.800 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ppp. 2023-11-27T17:51:32.817 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-27T17:51:32.855 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-27T17:51:32.863 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package tcl8.6. 2023-11-27T17:51:32.876 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-27T17:51:32.913 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-27T17:51:33.059 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-27T17:51:33.161 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-27T17:51:33.199 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package tcl. 2023-11-27T17:51:33.212 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-27T17:51:33.262 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-27T17:51:33.457 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T17:51:33.470 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package pptp-linux. 2023-11-27T17:51:33.484 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-27T17:51:33.529 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-27T17:51:33.610 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package wpasupplicant. 2023-11-27T17:51:33.633 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-27T17:51:33.677 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-27T17:51:33.789 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-27T17:51:33.803 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-27T17:51:33.864 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-27T17:51:34.002 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package bison. 2023-11-27T17:51:34.022 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-27T17:51:34.036 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-27T17:51:34.072 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-27T17:51:34.089 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137492 files and directories currently installed.) 2023-11-27T17:51:34.094 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-27T17:51:34.134 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-27T17:51:34.146 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-27T17:51:34.148 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-27T17:51:34.184 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client-common (238) ... 2023-11-27T17:51:34.555 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-27T17:51:34.570 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:34.580 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-27T17:51:34.602 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-27T17:51:34.605 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:34.672 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-27T17:51:34.719 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-27T17:51:34.743 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-27T17:51:34.794 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-27T17:51:35.008 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package dump. 2023-11-27T17:51:35.030 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-27T17:51:35.075 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking dump (0.4b47-3) ... 2023-11-27T17:51:35.095 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client-common (238) ... 2023-11-27T17:51:35.117 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-common. 2023-11-27T17:51:35.132 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-27T17:51:35.185 INFO:teuthology.orchestra.run.smithi176.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-27T17:51:35.208 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-common (238) ... 2023-11-27T17:51:35.316 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-27T17:51:35.412 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package indent. 2023-11-27T17:51:35.434 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:35.451 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-27T17:51:35.479 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-27T17:51:35.577 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:35.666 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-14. 2023-11-27T17:51:35.681 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:35.702 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-27T17:51:35.727 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:35.781 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-27T17:51:35.803 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-27T17:51:35.829 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-27T17:51:35.839 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-27T17:51:35.946 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:36.152 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-27T17:51:36.173 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-27T17:51:36.218 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-27T17:51:36.490 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-27T17:51:36.538 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-27T17:51:36.560 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-27T17:51:36.568 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-27T17:51:36.605 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-27T17:51:36.752 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql. 2023-11-27T17:51:36.767 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-27T17:51:36.810 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql (14+238) ... 2023-11-27T17:51:36.937 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-27T17:51:36.938 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-27T17:51:36.950 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-27T17:51:36.972 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-27T17:51:37.008 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-27T17:51:37.037 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-client. 2023-11-27T17:51:37.052 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-27T17:51:37.096 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-client (14+238) ... 2023-11-27T17:51:37.227 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-27T17:51:37.240 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-27T17:51:37.269 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-27T17:51:37.364 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-27T17:51:37.379 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-27T17:51:37.423 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-27T17:51:37.512 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-27T17:51:37.530 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjson-perl. 2023-11-27T17:51:37.552 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-27T17:51:37.597 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-27T17:51:37.638 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T17:51:37.667 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package tcl8.6. 2023-11-27T17:51:37.682 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-27T17:51:37.717 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-27T17:51:37.764 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-27T17:51:37.890 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-27T17:51:37.950 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-27T17:51:37.972 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-27T17:51:38.016 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-27T17:51:38.017 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-27T17:51:38.019 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package tcl. 2023-11-27T17:51:38.035 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-27T17:51:38.082 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-27T17:51:38.166 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-27T17:51:38.284 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-27T17:51:38.457 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package wpasupplicant. 2023-11-27T17:51:38.471 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-27T17:51:38.514 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-27T17:51:38.860 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-27T17:51:38.875 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-27T17:51:38.917 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-27T17:51:38.989 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-27T17:51:39.115 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up dump (0.4b47-3) ... 2023-11-27T17:51:39.209 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-27T17:51:39.275 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T17:51:39.279 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-27T17:51:39.295 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-27T17:51:39.347 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-27T17:51:39.401 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-27T17:51:39.502 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-27T17:51:39.636 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-27T17:51:39.762 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-27T17:51:39.838 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-27T17:51:39.853 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-27T17:51:39.859 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-27T17:51:39.896 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T17:51:39.939 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-27T17:51:40.065 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-27T17:51:40.157 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-27T17:51:40.178 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-27T17:51:40.241 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-27T17:51:40.265 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T17:51:40.281 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client-common (238) ... 2023-11-27T17:51:40.367 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T17:51:40.493 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-27T17:51:40.497 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-27T17:51:40.593 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-27T17:51:40.615 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-27T17:51:40.623 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-27T17:51:40.659 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T17:51:40.661 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client (14+238) ... 2023-11-27T17:51:40.749 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:40.787 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-27T17:51:40.875 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-27T17:51:41.013 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-27T17:51:41.026 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-27T17:51:41.035 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-27T17:51:41.071 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-27T17:51:41.151 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:41.250 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:51:41.251 INFO:teuthology.orchestra.run.smithi031.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-27T17:51:41.251 INFO:teuthology.orchestra.run.smithi031.stdout:which means they are currently configured by ifupdown: 2023-11-27T17:51:41.251 INFO:teuthology.orchestra.run.smithi031.stdout:- ens1f0 2023-11-27T17:51:41.251 INFO:teuthology.orchestra.run.smithi031.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-27T17:51:41.251 INFO:teuthology.orchestra.run.smithi031.stdout:remove their configuration from /etc/network/interfaces. 2023-11-27T17:51:41.251 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:51:41.365 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-27T17:51:41.449 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-27T17:51:41.471 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-27T17:51:41.515 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-27T17:51:41.708 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-27T17:51:41.918 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-27T17:51:41.940 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:41.985 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:42.055 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-27T17:51:42.160 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-27T17:51:42.266 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-27T17:51:42.288 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-27T17:51:42.310 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:42.346 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T17:51:42.558 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T17:51:42.643 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-27T17:51:42.643 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-27T17:51:42.666 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-27T17:51:42.678 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:42.708 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-27T17:51:42.715 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T17:51:42.834 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-27T17:51:42.951 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-common (238) ... 2023-11-27T17:51:42.993 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-27T17:51:43.015 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-27T17:51:43.059 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T17:51:43.376 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-27T17:51:43.502 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T17:51:43.563 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-27T17:51:43.585 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-27T17:51:43.630 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-27T17:51:43.637 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-27T17:51:43.763 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-27T17:51:43.841 INFO:teuthology.orchestra.run.smithi031.stdout:Adding user postgres to group ssl-cert 2023-11-27T17:51:43.888 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-27T17:51:43.983 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package modemmanager. 2023-11-27T17:51:44.005 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-27T17:51:44.014 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-27T17:51:44.038 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:51:44.038 INFO:teuthology.orchestra.run.smithi031.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-27T17:51:44.075 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T17:51:44.140 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-27T17:51:44.235 INFO:teuthology.orchestra.run.smithi031.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-27T17:51:44.235 INFO:teuthology.orchestra.run.smithi031.stdout:Removing obsolete dictionary files: 2023-11-27T17:51:44.796 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-27T17:51:44.835 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-27T17:51:44.922 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up dump (0.4b47-3) ... 2023-11-27T17:51:45.017 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-27T17:51:45.081 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T17:51:45.092 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package network-manager. 2023-11-27T17:51:45.114 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-27T17:51:45.207 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-27T17:51:45.208 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-27T17:51:45.256 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:45.333 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-27T17:51:45.442 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-27T17:51:45.552 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-27T17:51:45.588 INFO:teuthology.orchestra.run.smithi031.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-27T17:51:45.603 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-27T17:51:45.642 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-27T17:51:45.650 INFO:teuthology.orchestra.run.smithi031.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-27T17:51:45.650 INFO:teuthology.orchestra.run.smithi031.stdout:This user must also own the server process. 2023-11-27T17:51:45.650 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:51:45.650 INFO:teuthology.orchestra.run.smithi031.stdout:The database cluster will be initialized with locale "en_US". 2023-11-27T17:51:45.650 INFO:teuthology.orchestra.run.smithi031.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-27T17:51:45.650 INFO:teuthology.orchestra.run.smithi031.stdout:The default text search configuration will be set to "english". 2023-11-27T17:51:45.650 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:51:45.650 INFO:teuthology.orchestra.run.smithi031.stdout:Data page checksums are disabled. 2023-11-27T17:51:45.650 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:51:45.650 INFO:teuthology.orchestra.run.smithi031.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-27T17:51:45.651 INFO:teuthology.orchestra.run.smithi031.stdout:creating subdirectories ... ok 2023-11-27T17:51:45.651 INFO:teuthology.orchestra.run.smithi031.stdout:selecting dynamic shared memory implementation ... posix 2023-11-27T17:51:45.667 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default max_connections ... 100 2023-11-27T17:51:45.690 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default shared_buffers ... 128MB 2023-11-27T17:51:45.701 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default time zone ... Etc/UTC 2023-11-27T17:51:45.701 INFO:teuthology.orchestra.run.smithi031.stdout:creating configuration files ... ok 2023-11-27T17:51:45.736 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-27T17:51:45.821 INFO:teuthology.orchestra.run.smithi031.stdout:running bootstrap script ... ok 2023-11-27T17:51:45.857 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ppp. 2023-11-27T17:51:45.871 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-27T17:51:45.879 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-27T17:51:46.047 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-27T17:51:46.173 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T17:51:46.197 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-27T17:51:46.299 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-27T17:51:46.467 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-client (14+238) ... 2023-11-27T17:51:46.503 INFO:teuthology.orchestra.run.smithi031.stdout:performing post-bootstrap initialization ... ok 2023-11-27T17:51:46.563 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package pptp-linux. 2023-11-27T17:51:46.576 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-27T17:51:46.585 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-27T17:51:46.629 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-27T17:51:46.915 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-27T17:51:46.937 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-27T17:51:46.982 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-27T17:51:47.161 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:51:47.161 INFO:teuthology.orchestra.run.smithi176.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-27T17:51:47.162 INFO:teuthology.orchestra.run.smithi176.stdout:which means they are currently configured by ifupdown: 2023-11-27T17:51:47.162 INFO:teuthology.orchestra.run.smithi176.stdout:- enp3s0f1 2023-11-27T17:51:47.162 INFO:teuthology.orchestra.run.smithi176.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-27T17:51:47.162 INFO:teuthology.orchestra.run.smithi176.stdout:remove their configuration from /etc/network/interfaces. 2023-11-27T17:51:47.162 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:51:47.238 INFO:teuthology.orchestra.run.smithi031.stdout:syncing data to disk ... ok 2023-11-27T17:51:47.260 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-27T17:51:47.282 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-27T17:51:47.293 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-27T17:51:47.368 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client-common (238) ... 2023-11-27T17:51:47.652 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-27T17:51:47.681 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-27T17:51:47.690 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-27T17:51:47.703 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:47.747 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:48.118 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-27T17:51:48.402 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-common. 2023-11-27T17:51:48.424 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-27T17:51:48.520 INFO:teuthology.orchestra.run.smithi081.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-27T17:51:48.550 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-common (238) ... 2023-11-27T17:51:48.854 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T17:51:49.022 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-27T17:51:49.043 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-14. 2023-11-27T17:51:49.065 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:51:49.146 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:49.147 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-27T17:51:49.298 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-common (238) ... 2023-11-27T17:51:50.237 INFO:teuthology.orchestra.run.smithi176.stdout:Adding user postgres to group ssl-cert 2023-11-27T17:51:50.443 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T17:51:50.522 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:51:50.522 INFO:teuthology.orchestra.run.smithi176.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-27T17:51:50.530 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql. 2023-11-27T17:51:50.553 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-27T17:51:50.569 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-27T17:51:50.597 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql (14+238) ... 2023-11-27T17:51:50.686 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql (14+238) ... 2023-11-27T17:51:50.794 INFO:teuthology.orchestra.run.smithi176.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-27T17:51:50.794 INFO:teuthology.orchestra.run.smithi176.stdout:Removing obsolete dictionary files: 2023-11-27T17:51:50.813 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T17:51:50.874 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-client. 2023-11-27T17:51:50.896 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-27T17:51:50.941 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-client (14+238) ... 2023-11-27T17:51:50.963 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T17:51:51.209 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-27T17:51:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-27T17:51:51.224 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-27T17:51:51.231 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-27T17:51:51.276 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-27T17:51:51.541 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-27T17:51:51.662 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package tcl8.6. 2023-11-27T17:51:51.684 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-27T17:51:51.762 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-27T17:51:51.849 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-27T17:51:52.016 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:52.090 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package tcl. 2023-11-27T17:51:52.109 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-27T17:51:52.112 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-27T17:51:52.160 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-27T17:51:52.253 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-27T17:51:52.372 INFO:teuthology.orchestra.run.smithi176.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-27T17:51:52.389 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-27T17:51:52.441 INFO:teuthology.orchestra.run.smithi176.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-27T17:51:52.442 INFO:teuthology.orchestra.run.smithi176.stdout:This user must also own the server process. 2023-11-27T17:51:52.442 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:51:52.442 INFO:teuthology.orchestra.run.smithi176.stdout:The database cluster will be initialized with locale "en_US". 2023-11-27T17:51:52.442 INFO:teuthology.orchestra.run.smithi176.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-27T17:51:52.442 INFO:teuthology.orchestra.run.smithi176.stdout:The default text search configuration will be set to "english". 2023-11-27T17:51:52.442 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:51:52.442 INFO:teuthology.orchestra.run.smithi176.stdout:Data page checksums are disabled. 2023-11-27T17:51:52.442 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:51:52.442 INFO:teuthology.orchestra.run.smithi176.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-27T17:51:52.443 INFO:teuthology.orchestra.run.smithi176.stdout:creating subdirectories ... ok 2023-11-27T17:51:52.443 INFO:teuthology.orchestra.run.smithi176.stdout:selecting dynamic shared memory implementation ... posix 2023-11-27T17:51:52.467 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default max_connections ... 100 2023-11-27T17:51:52.502 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default shared_buffers ... 128MB 2023-11-27T17:51:52.515 INFO:teuthology.orchestra.run.smithi176.stdout:selecting default time zone ... Etc/UTC 2023-11-27T17:51:52.516 INFO:teuthology.orchestra.run.smithi176.stdout:creating configuration files ... ok 2023-11-27T17:51:52.576 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package wpasupplicant. 2023-11-27T17:51:52.598 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-27T17:51:52.651 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-27T17:51:52.685 INFO:teuthology.orchestra.run.smithi176.stdout:running bootstrap script ... ok 2023-11-27T17:51:52.980 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-27T17:51:53.063 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-27T17:51:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-27T17:51:53.119 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-27T17:51:53.172 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-27T17:51:53.306 INFO:teuthology.orchestra.run.smithi176.stdout:performing post-bootstrap initialization ... ok 2023-11-27T17:51:53.650 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-27T17:51:53.674 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-27T17:51:53.722 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-27T17:51:53.725 DEBUG:teuthology.parallel:result is None 2023-11-27T17:51:53.726 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-27T17:51:53.790 INFO:teuthology.orchestra.run.smithi176.stdout:syncing data to disk ... ok 2023-11-27T17:51:54.051 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client-common (238) ... 2023-11-27T17:51:54.323 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-27T17:51:54.339 INFO:teuthology.orchestra.run.smithi176.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-27T17:51:54.516 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-27T17:51:54.659 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:54.785 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-27T17:51:54.919 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-27T17:51:55.187 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:51:55.680 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-27T17:51:55.750 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-27T17:51:56.088 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-27T17:51:56.089 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-27T17:51:56.662 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-27T17:51:56.780 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-27T17:51:56.905 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-27T17:51:57.032 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-27T17:51:57.191 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-27T17:51:57.257 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T17:51:57.317 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-27T17:51:57.375 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-27T17:51:57.435 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-27T17:51:57.484 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up postgresql (14+238) ... 2023-11-27T17:51:57.610 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T17:51:57.760 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T17:51:58.030 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-27T17:51:58.030 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-27T17:51:58.082 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-27T17:51:58.225 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up dump (0.4b47-3) ... 2023-11-27T17:51:58.352 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-27T17:51:58.418 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T17:51:58.521 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-27T17:51:58.621 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-27T17:51:58.722 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-27T17:51:58.796 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-27T17:51:58.881 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-27T17:51:58.972 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-27T17:51:59.050 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-27T17:51:59.157 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-27T17:51:59.175 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-27T17:51:59.316 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-27T17:51:59.621 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-27T17:52:00.470 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T17:52:00.580 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-27T17:52:00.727 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-27T17:52:00.781 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-client (14+238) ... 2023-11-27T17:52:00.827 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-27T17:52:00.907 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-27T17:52:01.403 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:01.403 INFO:teuthology.orchestra.run.smithi081.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-27T17:52:01.403 INFO:teuthology.orchestra.run.smithi081.stdout:which means they are currently configured by ifupdown: 2023-11-27T17:52:01.403 INFO:teuthology.orchestra.run.smithi081.stdout:- enp3s0f1 2023-11-27T17:52:01.403 INFO:teuthology.orchestra.run.smithi081.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-27T17:52:01.403 INFO:teuthology.orchestra.run.smithi081.stdout:remove their configuration from /etc/network/interfaces. 2023-11-27T17:52:01.403 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:01.532 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-27T17:52:01.559 INFO:teuthology.orchestra.run.smithi176.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-27T17:52:01.564 DEBUG:teuthology.parallel:result is None 2023-11-27T17:52:01.877 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-27T17:52:02.245 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-27T17:52:02.852 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-27T17:52:03.011 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-27T17:52:04.736 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-27T17:52:04.736 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-common (238) ... 2023-11-27T17:52:04.736 INFO:teuthology.orchestra.run.smithi081.stdout:Adding user postgres to group ssl-cert 2023-11-27T17:52:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:04.738 INFO:teuthology.orchestra.run.smithi081.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-27T17:52:04.738 INFO:teuthology.orchestra.run.smithi081.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-27T17:52:04.739 INFO:teuthology.orchestra.run.smithi081.stdout:Removing obsolete dictionary files: 2023-11-27T17:52:05.262 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-27T17:52:05.699 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-27T17:52:06.046 INFO:teuthology.orchestra.run.smithi081.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-27T17:52:06.069 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-27T17:52:06.111 INFO:teuthology.orchestra.run.smithi081.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-27T17:52:06.111 INFO:teuthology.orchestra.run.smithi081.stdout:This user must also own the server process. 2023-11-27T17:52:06.111 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:06.111 INFO:teuthology.orchestra.run.smithi081.stdout:The database cluster will be initialized with locale "en_US". 2023-11-27T17:52:06.111 INFO:teuthology.orchestra.run.smithi081.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-27T17:52:06.111 INFO:teuthology.orchestra.run.smithi081.stdout:The default text search configuration will be set to "english". 2023-11-27T17:52:06.112 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:06.112 INFO:teuthology.orchestra.run.smithi081.stdout:Data page checksums are disabled. 2023-11-27T17:52:06.112 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:06.112 INFO:teuthology.orchestra.run.smithi081.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-27T17:52:06.112 INFO:teuthology.orchestra.run.smithi081.stdout:creating subdirectories ... ok 2023-11-27T17:52:06.112 INFO:teuthology.orchestra.run.smithi081.stdout:selecting dynamic shared memory implementation ... posix 2023-11-27T17:52:06.128 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default max_connections ... 100 2023-11-27T17:52:06.148 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default shared_buffers ... 128MB 2023-11-27T17:52:06.155 INFO:teuthology.orchestra.run.smithi081.stdout:selecting default time zone ... Etc/UTC 2023-11-27T17:52:06.155 INFO:teuthology.orchestra.run.smithi081.stdout:creating configuration files ... ok 2023-11-27T17:52:06.271 INFO:teuthology.orchestra.run.smithi081.stdout:running bootstrap script ... ok 2023-11-27T17:52:06.908 INFO:teuthology.orchestra.run.smithi081.stdout:performing post-bootstrap initialization ... ok 2023-11-27T17:52:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:syncing data to disk ... ok 2023-11-27T17:52:08.208 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-27T17:52:11.182 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T17:52:11.324 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-27T17:52:11.451 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up postgresql (14+238) ... 2023-11-27T17:52:11.618 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-27T17:52:11.769 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-27T17:52:12.059 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-27T17:52:12.060 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-27T17:52:12.680 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-27T17:52:13.024 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-27T17:52:13.217 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-27T17:52:14.111 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-27T17:52:14.244 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-27T17:52:14.892 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-27T17:52:14.895 DEBUG:teuthology.parallel:result is None 2023-11-27T17:52:14.896 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:52:15.059 DEBUG:teuthology.orchestra.run.smithi031:> dpkg-query -W -f '${Version}' ceph 2023-11-27T17:52:15.079 INFO:teuthology.orchestra.run.smithi031.stdout:18.0.0-7498-g369173db-1jammy 2023-11-27T17:52:15.080 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498-g369173db-1jammy 2023-11-27T17:52:15.080 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498-g369173db-1jammy is installed. 2023-11-27T17:52:15.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:52:15.299 DEBUG:teuthology.orchestra.run.smithi081:> dpkg-query -W -f '${Version}' ceph 2023-11-27T17:52:15.319 INFO:teuthology.orchestra.run.smithi081.stdout:18.0.0-7498-g369173db-1jammy 2023-11-27T17:52:15.319 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498-g369173db-1jammy 2023-11-27T17:52:15.320 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498-g369173db-1jammy is installed. 2023-11-27T17:52:15.320 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=369173db14b6995b2bd07c60ec5f63d01cf21631 2023-11-27T17:52:15.538 DEBUG:teuthology.orchestra.run.smithi176:> dpkg-query -W -f '${Version}' ceph 2023-11-27T17:52:15.563 INFO:teuthology.orchestra.run.smithi176.stdout:18.0.0-7498-g369173db-1jammy 2023-11-27T17:52:15.563 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7498-g369173db-1jammy 2023-11-27T17:52:15.563 INFO:teuthology.task.install:The correct ceph version 18.0.0-7498-g369173db-1jammy is installed. 2023-11-27T17:52:15.563 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-27T17:52:15.563 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:15.563 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T17:52:15.579 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:15.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T17:52:15.593 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:52:15.593 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-27T17:52:15.630 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-27T17:52:15.631 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:15.631 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T17:52:15.645 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T17:52:15.699 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:15.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T17:52:15.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T17:52:15.769 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:52:15.769 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2023-11-27T17:52:15.791 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-27T17:52:15.859 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-27T17:52:15.860 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:15.860 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T17:52:15.873 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T17:52:15.927 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:15.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T17:52:15.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T17:52:15.997 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:52:15.997 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-27T17:52:16.018 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-27T17:52:16.085 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-27T17:52:16.085 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:16.085 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T17:52:16.099 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T17:52:16.155 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:16.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T17:52:16.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T17:52:16.221 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:52:16.221 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2023-11-27T17:52:16.243 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-27T17:52:16.305 INFO:teuthology.run_tasks:Running task ceph... 2023-11-27T17:52:16.377 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-27T17:52:16.377 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2023-11-27T17:52:16.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2023-11-27T17:52:16.382 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2023-11-27T17:52:16.404 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-27T17:52:16.404 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T17:52:16.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T17:52:16.438 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-27T17:52:16.465 INFO:tasks.ceph:Creating extra log directories... 2023-11-27T17:52:16.465 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T17:52:16.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T17:52:16.495 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-27T17:52:16.540 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-27T17:52:16.541 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-27T17:52:16.541 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-27T17:52:16.541 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:16.541 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T17:52:16.551 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T17:52:16.627 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:16.628 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T17:52:16.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T17:52:16.711 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:52:16.711 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-27T17:52:16.721 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-27T17:52:16.821 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-27T17:52:16.821 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-27T17:52:16.821 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7467883', 'branch': 'wip-yuri10-testing-2023-11-22-1112', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7467883', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-27_17:14:24-fs-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri10-testing-2023-11-22-1112'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri10-testing-2023-11-22-1112', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 8541, 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri10-testing-2023-11-22-1112', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL0fZRbIKBxpfaKybS6vLZ4GiOJAw5O+A/Lun4Xlo/9nJ8s78YZI5DduQdd/XA77nG5eCO6HblKMZWdQh3PcEeQ=', 'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM1H6kZt0IcSxFBAGTyv1GEqQB3lYFDSSjQlvKmCZ2gIvnFnPeYSCOqv5MJ8SUyNtdOao13YcMahNzdpcKjWty0=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJPA8eLnUX9BQLL4M0cXgOkCeVs8XBmckdAmF+1cf8PC3yMHucZqb/Fxp2GgfmOe5SvdSFOiiVJzOpekSG92HMY='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '369173db14b6995b2bd07c60ec5f63d01cf21631', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-27_17:14:24', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-27T17:52:16.822 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T17:52:16.824 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T17:52:16.827 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-27T17:52:16.837 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T17:52:16.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T17:52:16.875 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2023-11-27T17:52:16.905 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:16.905 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2023-11-27T17:52:16.934 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-27T17:52:16.935 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2023-11-27T17:52:16.983 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-27T17:52:16.983 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:52:16.983 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 886 Links: 1 2023-11-27T17:52:16.984 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:52:16.984 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-11-27 17:44:04.171388148 +0000 2023-11-27T17:52:16.984 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-11-27 17:44:03.771393096 +0000 2023-11-27T17:52:16.984 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-11-27 17:44:03.771393096 +0000 2023-11-27T17:52:16.984 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-11-27T17:52:16.984 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-27T17:52:17.037 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-11-27T17:52:17.038 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-11-27T17:52:17.038 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000528173 s, 969 kB/s 2023-11-27T17:52:17.039 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-27T17:52:17.093 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2023-11-27T17:52:17.141 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-27T17:52:17.142 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:52:17.142 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 908 Links: 1 2023-11-27T17:52:17.142 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:52:17.142 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-11-27 17:44:04.759380876 +0000 2023-11-27T17:52:17.142 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-11-27 17:44:04.387385477 +0000 2023-11-27T17:52:17.142 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-11-27 17:44:04.387385477 +0000 2023-11-27T17:52:17.142 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-11-27T17:52:17.143 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-27T17:52:17.193 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-11-27T17:52:17.194 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-11-27T17:52:17.194 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000458736 s, 1.1 MB/s 2023-11-27T17:52:17.195 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-27T17:52:17.244 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2023-11-27T17:52:17.296 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-27T17:52:17.296 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:52:17.296 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 919 Links: 1 2023-11-27T17:52:17.296 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:52:17.296 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-11-27 17:44:04.987378057 +0000 2023-11-27T17:52:17.297 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-11-27 17:44:04.983378108 +0000 2023-11-27T17:52:17.297 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-11-27 17:44:04.983378108 +0000 2023-11-27T17:52:17.297 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-11-27T17:52:17.297 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-27T17:52:17.352 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-11-27T17:52:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-11-27T17:52:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000451169 s, 1.1 MB/s 2023-11-27T17:52:17.354 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-27T17:52:17.400 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2023-11-27T17:52:17.447 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-27T17:52:17.448 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:52:17.448 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 5h/5d Inode: 940 Links: 1 2023-11-27T17:52:17.448 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:52:17.448 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-11-27 17:44:05.951366146 +0000 2023-11-27T17:52:17.448 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-11-27 17:44:05.611370346 +0000 2023-11-27T17:52:17.448 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-11-27 17:44:05.611370346 +0000 2023-11-27T17:52:17.449 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-11-27T17:52:17.449 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-27T17:52:17.506 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-11-27T17:52:17.506 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-11-27T17:52:17.506 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000446202 s, 1.1 MB/s 2023-11-27T17:52:17.507 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-27T17:52:17.556 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T17:52:17.557 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:17.557 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2023-11-27T17:52:17.562 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-27T17:52:17.563 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2023-11-27T17:52:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-27T17:52:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:52:17.610 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 884 Links: 1 2023-11-27T17:52:17.610 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:52:17.610 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-11-27 17:44:11.594527523 +0000 2023-11-27T17:52:17.610 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-11-27 17:44:11.590527625 +0000 2023-11-27T17:52:17.610 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-11-27 17:44:11.590527625 +0000 2023-11-27T17:52:17.610 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-11-27T17:52:17.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-27T17:52:17.665 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-11-27T17:52:17.665 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-11-27T17:52:17.665 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000605295 s, 846 kB/s 2023-11-27T17:52:17.666 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-27T17:52:17.717 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2023-11-27T17:52:17.765 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-27T17:52:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:52:17.766 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 897 Links: 1 2023-11-27T17:52:17.766 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:52:17.766 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-11-27 17:44:12.558502971 +0000 2023-11-27T17:52:17.766 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-11-27 17:44:12.206511928 +0000 2023-11-27T17:52:17.766 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-11-27 17:44:12.206511928 +0000 2023-11-27T17:52:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-11-27T17:52:17.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-27T17:52:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-11-27T17:52:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-11-27T17:52:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000530978 s, 964 kB/s 2023-11-27T17:52:17.821 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-27T17:52:17.872 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2023-11-27T17:52:17.918 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-27T17:52:17.918 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:52:17.918 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 914 Links: 1 2023-11-27T17:52:17.918 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:52:17.918 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-11-27 17:44:13.154487811 +0000 2023-11-27T17:52:17.918 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-11-27 17:44:12.782497271 +0000 2023-11-27T17:52:17.918 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-11-27 17:44:12.782497271 +0000 2023-11-27T17:52:17.918 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-11-27T17:52:17.919 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-27T17:52:17.972 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-11-27T17:52:17.973 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-11-27T17:52:17.973 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000481605 s, 1.1 MB/s 2023-11-27T17:52:17.974 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-27T17:52:18.023 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2023-11-27T17:52:18.070 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-27T17:52:18.070 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-27T17:52:18.070 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 935 Links: 1 2023-11-27T17:52:18.070 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-27T17:52:18.071 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2023-11-27 17:44:13.418481106 +0000 2023-11-27T17:52:18.071 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2023-11-27 17:44:13.414481209 +0000 2023-11-27T17:52:18.071 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2023-11-27 17:44:13.414481209 +0000 2023-11-27T17:52:18.071 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2023-11-27T17:52:18.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-27T17:52:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2023-11-27T17:52:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2023-11-27T17:52:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000512372 s, 999 kB/s 2023-11-27T17:52:18.125 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-27T17:52:18.175 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T17:52:18.175 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-27T17:52:18.175 INFO:tasks.ceph:Generating config... 2023-11-27T17:52:18.177 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-27T17:52:18.177 INFO:tasks.ceph:[client] debug client = 20 2023-11-27T17:52:18.177 INFO:tasks.ceph:[client] debug ms = 1 2023-11-27T17:52:18.177 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-27T17:52:18.177 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-27T17:52:18.178 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-11-27T17:52:18.178 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-27T17:52:18.178 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-27T17:52:18.178 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-27T17:52:18.178 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-27T17:52:18.178 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-27T17:52:18.178 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-27T17:52:18.178 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-27T17:52:18.178 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-27T17:52:18.178 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-27T17:52:18.178 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-27T17:52:18.178 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-27T17:52:18.179 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-27T17:52:18.179 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-27T17:52:18.179 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-27T17:52:18.179 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-27T17:52:18.179 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-27T17:52:18.179 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-27T17:52:18.179 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-27T17:52:18.179 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-27T17:52:18.179 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-27T17:52:18.179 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-27T17:52:18.179 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-27T17:52:18.179 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-27T17:52:18.179 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-27T17:52:18.180 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-27T17:52:18.180 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-27T17:52:18.180 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-27T17:52:18.180 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-27T17:52:18.180 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-27T17:52:18.180 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-27T17:52:18.180 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-27T17:52:18.180 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-27T17:52:18.180 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-27T17:52:18.180 INFO:tasks.ceph:Setting up mon.a... 2023-11-27T17:52:18.181 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-27T17:52:18.215 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.keyring 2023-11-27T17:52:18.225 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-27T17:52:18.301 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T17:52:18.355 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.31'), ('mon.b', '172.21.15.81'), ('mon.c', '[v2:172.21.15.81:3301,v1:172.21.15.81:6790]')] 2023-11-27T17:52:18.355 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.31,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-27T17:52:18.356 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:18.356 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-27T17:52:18.404 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.31 --add b 172.21.15.81 --addv c '[v2:172.21.15.81:3301,v1:172.21.15.81:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:18.491 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:18.491 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: generated fsid d7e0ec54-b878-4521-a03f-3b848cceedea 2023-11-27T17:52:18.491 INFO:teuthology.orchestra.run.smithi031.stdout:setting min_mon_release = quincy 2023-11-27T17:52:18.491 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 0 2023-11-27T17:52:18.492 INFO:teuthology.orchestra.run.smithi031.stdout:fsid d7e0ec54-b878-4521-a03f-3b848cceedea 2023-11-27T17:52:18.492 INFO:teuthology.orchestra.run.smithi031.stdout:last_changed 2023-11-27T17:52:18.491503+0000 2023-11-27T17:52:18.492 INFO:teuthology.orchestra.run.smithi031.stdout:created 2023-11-27T17:52:18.491503+0000 2023-11-27T17:52:18.492 INFO:teuthology.orchestra.run.smithi031.stdout:min_mon_release 17 (quincy) 2023-11-27T17:52:18.492 INFO:teuthology.orchestra.run.smithi031.stdout:election_strategy: 1 2023-11-27T17:52:18.492 INFO:teuthology.orchestra.run.smithi031.stdout:0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2023-11-27T17:52:18.493 INFO:teuthology.orchestra.run.smithi031.stdout:1: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.b 2023-11-27T17:52:18.493 INFO:teuthology.orchestra.run.smithi031.stdout:2: [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] mon.c 2023-11-27T17:52:18.493 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-27T17:52:18.495 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-27T17:52:18.499 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d7e0ec54-b878-4521-a03f-3b848cceedea... 2023-11-27T17:52:18.500 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T17:52:18.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T17:52:18.546 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-27T17:52:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2023-11-27T17:52:18.574 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2023-11-27T17:52:18.574 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T17:52:18.574 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2023-11-27T17:52:18.574 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.574 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2023-11-27T17:52:18.574 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.574 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2023-11-27T17:52:18.574 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.574 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2023-11-27T17:52:18.574 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2023-11-27T17:52:18.574 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.574 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2023-11-27T17:52:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2023-11-27T17:52:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2023-11-27T17:52:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2023-11-27T17:52:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2023-11-27T17:52:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2023-11-27T17:52:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T17:52:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T17:52:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2023-11-27T17:52:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T17:52:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2023-11-27T17:52:18.576 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]" 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn min per osd = 0 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on skipped message = False 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = d7e0ec54-b878-4521-a03f-3b848cceedea 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2023-11-27T17:52:18.577 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2023-11-27T17:52:18.578 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2023-11-27T17:52:18.578 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.578 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2023-11-27T17:52:18.578 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2023-11-27T17:52:18.578 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.578 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2023-11-27T17:52:18.578 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2023-11-27T17:52:18.578 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2023-11-27T17:52:18.578 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2023-11-27T17:52:18.579 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.579 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2023-11-27T17:52:18.579 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2023-11-27T17:52:18.579 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.579 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2023-11-27T17:52:18.579 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.579 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2023-11-27T17:52:18.579 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.579 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2023-11-27T17:52:18.579 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.579 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2023-11-27T17:52:18.579 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = bitmap 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2023-11-27T17:52:18.580 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2023-11-27T17:52:18.581 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T17:52:18.581 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2023-11-27T17:52:18.581 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2023-11-27T17:52:18.581 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2023-11-27T17:52:18.581 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2023-11-27T17:52:18.581 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2023-11-27T17:52:18.581 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2023-11-27T17:52:18.581 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-27T17:52:18.581 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2023-11-27T17:52:18.581 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-11-27T17:52:18.581 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-11-27T17:52:18.582 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2023-11-27T17:52:18.583 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2023-11-27T17:52:18.583 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-11-27T17:52:18.583 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.583 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T17:52:18.583 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T17:52:18.583 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T17:52:18.583 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.583 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T17:52:18.583 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T17:52:18.583 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T17:52:18.583 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.583 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2023-11-27T17:52:18.584 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2023-11-27T17:52:18.584 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.584 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2023-11-27T17:52:18.584 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2023-11-27T17:52:18.584 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:52:18.584 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2023-11-27T17:52:18.584 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2023-11-27T17:52:18.584 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2023-11-27T17:52:18.584 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2023-11-27T17:52:18.584 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T17:52:18.584 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T17:52:18.585 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2023-11-27T17:52:18.585 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2023-11-27T17:52:18.585 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-27T17:52:18.585 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2023-11-27T17:52:18.585 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2023-11-27T17:52:18.585 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2023-11-27T17:52:18.585 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2023-11-27T17:52:18.585 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2023-11-27T17:52:18.585 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-11-27T17:52:18.585 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2023-11-27T17:52:18.585 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2023-11-27T17:52:18.585 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2023-11-27T17:52:18.586 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2023-11-27T17:52:18.586 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2023-11-27T17:52:18.586 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-11-27T17:52:18.586 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2023-11-27T17:52:18.586 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2023-11-27T17:52:18.586 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2023-11-27T17:52:18.586 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2023-11-27T17:52:18.586 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2023-11-27T17:52:18.586 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2023-11-27T17:52:18.586 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2023-11-27T17:52:18.588 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2023-11-27T17:52:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2023-11-27T17:52:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T17:52:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2023-11-27T17:52:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2023-11-27T17:52:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T17:52:18.589 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T17:52:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2023-11-27T17:52:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2023-11-27T17:52:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2023-11-27T17:52:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2023-11-27T17:52:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2023-11-27T17:52:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2023-11-27T17:52:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2023-11-27T17:52:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2023-11-27T17:52:18.590 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2023-11-27T17:52:18.591 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.31,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]" 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn min per osd = 0 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on skipped message = False 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = d7e0ec54-b878-4521-a03f-3b848cceedea 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2023-11-27T17:52:18.592 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2023-11-27T17:52:18.593 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2023-11-27T17:52:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2023-11-27T17:52:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2023-11-27T17:52:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2023-11-27T17:52:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2023-11-27T17:52:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: bdev async discard = True 2023-11-27T17:52:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: bdev enable discard = True 2023-11-27T17:52:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore allocator = bitmap 2023-11-27T17:52:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2023-11-27T17:52:18.594 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.595 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2023-11-27T17:52:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-11-27T17:52:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2023-11-27T17:52:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-11-27T17:52:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-11-27T17:52:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-11-27T17:52:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-11-27T17:52:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2023-11-27T17:52:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.596 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2023-11-27T17:52:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-11-27T17:52:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2023-11-27T17:52:18.596 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.597 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2023-11-27T17:52:18.598 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-11-27T17:52:18.599 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-11-27T17:52:18.600 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2023-11-27T17:52:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2023-11-27T17:52:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds balancer = 20 2023-11-27T17:52:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2023-11-27T17:52:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2023-11-27T17:52:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2023-11-27T17:52:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2023-11-27T17:52:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2023-11-27T17:52:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2023-11-27T17:52:18.600 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2023-11-27T17:52:18.601 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2023-11-27T17:52:18.601 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2023-11-27T17:52:18.601 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2023-11-27T17:52:18.601 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-27T17:52:18.601 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2023-11-27T17:52:18.601 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.602 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2023-11-27T17:52:18.602 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.602 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2023-11-27T17:52:18.602 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.602 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2023-11-27T17:52:18.602 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2023-11-27T17:52:18.602 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.602 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2023-11-27T17:52:18.602 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2023-11-27T17:52:18.602 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.602 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-27T17:52:18.602 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2023-11-27T17:52:18.603 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.603 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2023-11-27T17:52:18.603 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-27T17:52:18.603 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.603 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2023-11-27T17:52:18.603 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.603 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2023-11-27T17:52:18.603 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2023-11-27T17:52:18.603 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2023-11-27T17:52:18.603 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2023-11-27T17:52:18.603 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2023-11-27T17:52:18.603 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2023-11-27T17:52:18.604 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.31,172.21.15.81,[v2:172.21.15.81:3301,v1:172.21.15.81:6790]" 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn min per osd = 0 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = d7e0ec54-b878-4521-a03f-3b848cceedea 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2023-11-27T17:52:18.605 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.606 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2023-11-27T17:52:18.606 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2023-11-27T17:52:18.606 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.606 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2023-11-27T17:52:18.606 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2023-11-27T17:52:18.606 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2023-11-27T17:52:18.606 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2023-11-27T17:52:18.606 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.606 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2023-11-27T17:52:18.606 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2023-11-27T17:52:18.606 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.606 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: bdev async discard = True 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: bdev enable discard = True 2023-11-27T17:52:18.607 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore allocator = bitmap 2023-11-27T17:52:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2023-11-27T17:52:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2023-11-27T17:52:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 1/20 2023-11-27T17:52:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 1/20 2023-11-27T17:52:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-27T17:52:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2023-11-27T17:52:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 4/10 2023-11-27T17:52:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2023-11-27T17:52:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2023-11-27T17:52:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2023-11-27T17:52:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2023-11-27T17:52:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-27T17:52:18.609 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2023-11-27T17:52:18.610 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2023-11-27T17:52:18.610 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2023-11-27T17:52:18.610 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2023-11-27T17:52:18.610 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2023-11-27T17:52:18.610 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2023-11-27T17:52:18.610 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2023-11-27T17:52:18.610 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2023-11-27T17:52:18.610 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2023-11-27T17:52:18.610 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.610 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-27T17:52:18.611 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2023-11-27T17:52:18.611 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2023-11-27T17:52:18.611 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.611 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2023-11-27T17:52:18.611 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-27T17:52:18.611 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-27T17:52:18.611 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.611 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2023-11-27T17:52:18.611 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2023-11-27T17:52:18.611 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.611 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2023-11-27T17:52:18.612 INFO:teuthology.orchestra.run.smithi176.stdout: mon op complaint time = 120 2023-11-27T17:52:18.612 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:52:18.612 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2023-11-27T17:52:18.612 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2023-11-27T17:52:18.612 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2023-11-27T17:52:18.612 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2023-11-27T17:52:18.612 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-27T17:52:18.612 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-27T17:52:18.612 INFO:teuthology.orchestra.run.smithi176.stdout: client mount timeout = 600 2023-11-27T17:52:18.612 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2023-11-27T17:52:18.612 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-27T17:52:18.613 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2023-11-27T17:52:18.613 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2023-11-27T17:52:18.613 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2023-11-27T17:52:18.613 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2023-11-27T17:52:18.613 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2023-11-27T17:52:18.613 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2023-11-27T17:52:18.613 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2023-11-27T17:52:18.613 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2023-11-27T17:52:18.613 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2023-11-27T17:52:18.613 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds = 20 2023-11-27T17:52:18.613 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds balancer = 20 2023-11-27T17:52:18.614 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-27T17:52:18.614 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug frag = True 2023-11-27T17:52:18.614 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug scatterstat = True 2023-11-27T17:52:18.614 INFO:teuthology.orchestra.run.smithi176.stdout: mds op complaint time = 180 2023-11-27T17:52:18.614 INFO:teuthology.orchestra.run.smithi176.stdout: mds verify scatter = True 2023-11-27T17:52:18.614 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2023-11-27T17:52:18.614 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2023-11-27T17:52:18.614 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2023-11-27T17:52:18.615 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-27T17:52:18.616 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-27T17:52:18.679 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-27T17:52:18.680 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:18.680 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-27T17:52:18.684 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:18.684 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-27T17:52:18.731 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2023-11-27T17:52:18.732 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:18.732 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T17:52:18.732 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T17:52:18.796 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:18.796 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:18.843 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2023-11-27T17:52:18.843 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:18.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T17:52:18.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T17:52:18.867 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:18.867 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:18.914 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2023-11-27T17:52:18.914 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:52:18.914 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-27T17:52:18.915 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-27T17:52:18.950 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:52:18.951 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:19.005 INFO:tasks.ceph:Setting up mon nodes... 2023-11-27T17:52:19.005 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-27T17:52:19.005 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-27T17:52:19.050 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-27T17:52:19.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-27T17:52:19.097 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-27T17:52:19.106 INFO:tasks.ceph:Setting up mds nodes... 2023-11-27T17:52:19.106 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-27T17:52:19.150 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-27T17:52:19.153 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-27T17:52:19.210 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-27T17:52:19.297 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-27T17:52:19.299 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-27T17:52:19.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-27T17:52:19.399 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-27T17:52:19.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-27T17:52:19.459 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-27T17:52:19.459 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-27T17:52:19.507 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-27T17:52:19.531 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-27T17:52:19.531 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-27T17:52:19.532 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-27T17:52:19.545 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T17:52:19.545 INFO:tasks.ceph:role: osd.0 2023-11-27T17:52:19.545 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-27T17:52:19.545 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-27T17:52:19.607 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:52:19.608 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:52:19.608 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:52:19.608 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:52:19.608 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:52:19.608 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:52:19.608 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:52:19.608 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:52:19.608 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:52:19.608 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:52:20.069 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-11-27T17:52:20.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-11-27T17:52:20.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-27T17:52:20.227 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-27T17:52:20.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:52:20.240 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T17:52:20.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-27T17:52:20.300 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T17:52:20.300 INFO:tasks.ceph:role: osd.1 2023-11-27T17:52:20.300 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-27T17:52:20.300 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-27T17:52:20.364 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:52:20.417 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:52:20.417 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:52:20.417 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:52:20.417 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:52:20.417 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:52:20.417 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:52:20.417 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:52:20.417 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:52:20.417 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:52:20.812 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-11-27T17:52:20.814 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-11-27T17:52:20.814 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-27T17:52:20.892 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-27T17:52:20.945 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T17:52:20.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:52:20.947 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-27T17:52:21.003 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T17:52:21.003 INFO:tasks.ceph:role: osd.2 2023-11-27T17:52:21.003 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-27T17:52:21.003 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-27T17:52:21.067 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:52:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:52:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:52:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:52:21.067 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:52:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:52:21.068 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:52:21.068 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:52:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:52:21.068 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:52:21.532 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-11-27T17:52:21.535 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-11-27T17:52:21.535 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-27T17:52:21.686 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-27T17:52:21.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:52:21.699 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T17:52:21.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-27T17:52:21.756 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-27T17:52:21.757 INFO:tasks.ceph:role: osd.3 2023-11-27T17:52:21.757 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2023-11-27T17:52:21.757 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-27T17:52:21.820 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:52:21.820 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:52:21.821 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:52:21.821 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:52:21.821 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:52:21.821 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:52:21.821 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:52:21.821 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:52:21.821 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:52:21.821 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:52:22.300 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-11-27T17:52:22.303 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-11-27T17:52:22.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-27T17:52:22.444 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-27T17:52:22.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:52:22.458 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T17:52:22.458 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:22.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:22.559+0000 7f2bc5083640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-27T17:52:22.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:22.563+0000 7f2bc5083640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-27T17:52:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:22.563+0000 7f2bc5083640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T17:52:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:22.563+0000 7f2bc5083640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T17:52:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:22.563+0000 7f2bc5083640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-27T17:52:22.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:22.563+0000 7f2bc5083640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-27T17:52:25.592 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-27T17:52:25.606 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:25.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:25.683+0000 7f0352838640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-27T17:52:25.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:25.683+0000 7f0352838640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-27T17:52:25.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:25.683+0000 7f0352838640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T17:52:25.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:25.683+0000 7f0352838640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T17:52:25.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:25.683+0000 7f0352838640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-27T17:52:25.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:25.683+0000 7f0352838640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-27T17:52:28.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-27T17:52:28.720 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:28.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:28.799+0000 7f3348e3a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-27T17:52:28.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:28.799+0000 7f3348e3a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-27T17:52:28.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:28.799+0000 7f3348e3a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T17:52:28.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:28.799+0000 7f3348e3a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T17:52:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:28.799+0000 7f3348e3a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-27T17:52:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:28.799+0000 7f3348e3a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-27T17:52:31.824 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-27T17:52:31.880 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:31.963+0000 7f3b8ae83640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-27T17:52:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:31.963+0000 7f3b8ae83640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-27T17:52:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:31.963+0000 7f3b8ae83640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T17:52:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:31.963+0000 7f3b8ae83640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T17:52:31.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:31.963+0000 7f3b8ae83640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-27T17:52:31.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:31.963+0000 7f3b8ae83640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-27T17:52:34.969 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-27T17:52:35.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-27T17:52:35.043 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T17:52:35.044 INFO:tasks.ceph:role: osd.4 2023-11-27T17:52:35.044 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2023-11-27T17:52:35.044 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-27T17:52:35.106 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:52:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:52:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:52:35.106 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:52:35.106 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:52:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:52:35.107 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:52:35.107 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:52:35.107 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:52:35.107 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:52:35.581 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-11-27T17:52:35.584 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-11-27T17:52:35.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-27T17:52:35.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-27T17:52:35.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:52:35.742 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T17:52:35.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-27T17:52:35.797 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T17:52:35.797 INFO:tasks.ceph:role: osd.5 2023-11-27T17:52:35.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2023-11-27T17:52:35.798 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-27T17:52:35.861 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:52:35.861 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:52:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:52:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:52:35.862 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:52:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:52:35.862 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:52:35.862 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:52:35.862 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:52:35.862 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:52:36.292 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-11-27T17:52:36.295 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-11-27T17:52:36.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-27T17:52:36.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-27T17:52:36.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:52:36.418 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T17:52:36.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-27T17:52:36.471 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T17:52:36.471 INFO:tasks.ceph:role: osd.6 2023-11-27T17:52:36.471 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2023-11-27T17:52:36.471 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-27T17:52:36.535 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:52:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:52:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:52:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:52:36.535 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:52:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:52:36.535 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:52:36.535 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:52:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:52:36.535 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:52:36.992 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-11-27T17:52:36.995 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-11-27T17:52:36.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-27T17:52:37.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-27T17:52:37.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:52:37.099 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T17:52:37.099 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-27T17:52:37.151 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-27T17:52:37.151 INFO:tasks.ceph:role: osd.7 2023-11-27T17:52:37.152 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2023-11-27T17:52:37.152 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-27T17:52:37.213 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-27T17:52:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-27T17:52:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-27T17:52:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-27T17:52:37.213 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-27T17:52:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2023-11-27T17:52:37.213 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-27T17:52:37.213 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-27T17:52:37.213 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-27T17:52:37.213 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-27T17:52:37.677 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2023-11-27T17:52:37.679 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2023-11-27T17:52:37.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-27T17:52:37.807 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-27T17:52:37.818 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2023-11-27T17:52:37.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:52:37.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:37.947 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:37.942+0000 7f2fa0854640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-27T17:52:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:37.946+0000 7f2fa0854640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-27T17:52:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:37.946+0000 7f2fa0854640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T17:52:37.952 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:37.946+0000 7f2fa0854640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T17:52:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:37.946+0000 7f2fa0854640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-27T17:52:37.953 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:37.950+0000 7f2fa0854640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-27T17:52:40.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-27T17:52:40.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:41.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:41.070+0000 7f3919685640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-27T17:52:41.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:41.070+0000 7f3919685640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-27T17:52:41.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:41.070+0000 7f3919685640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T17:52:41.076 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:41.070+0000 7f3919685640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T17:52:41.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:41.070+0000 7f3919685640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-27T17:52:41.077 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:41.074+0000 7f3919685640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-27T17:52:44.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-27T17:52:44.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:44.220 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:44.214+0000 7f8b9dd2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-27T17:52:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:44.214+0000 7f8b9dd2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-27T17:52:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:44.214+0000 7f8b9dd2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T17:52:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:44.214+0000 7f8b9dd2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T17:52:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:44.214+0000 7f8b9dd2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-27T17:52:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:44.218+0000 7f8b9dd2b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-27T17:52:46.824 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:52:46.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:52:46.830 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:52:47.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-27T17:52:47.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:47.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:47.338+0000 7fa5d393e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-27T17:52:47.344 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:47.338+0000 7fa5d393e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-27T17:52:47.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:47.338+0000 7fa5d393e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T17:52:47.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:47.338+0000 7fa5d393e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T17:52:47.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:47.338+0000 7fa5d393e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-27T17:52:47.345 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:47.342+0000 7fa5d393e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-27T17:52:50.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-27T17:52:50.414 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-27T17:52:50.414 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:50.415 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-27T17:52:50.429 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:50.429 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-27T17:52:50.483 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:50.483 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-27T17:52:50.539 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:50.539 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-27T17:52:50.595 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:50.595 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-27T17:52:50.656 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:50.656 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-27T17:52:50.711 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:50.711 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-27T17:52:50.767 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:50.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-27T17:52:50.781 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:50.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-27T17:52:50.837 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:50.838 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-27T17:52:50.892 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:50.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-27T17:52:50.944 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:50.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-27T17:52:50.996 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:50.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-27T17:52:51.049 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:52:51.049 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-27T17:52:51.059 INFO:tasks.ceph:Adding keys to all mons... 2023-11-27T17:52:51.059 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-27T17:52:51.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-27T17:52:51.096 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2023-11-27T17:52:51.096 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBT12RlNz8LAxAADE0KfL29q+wE20sBf3nsNQ== 2023-11-27T17:52:51.096 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-11-27T17:52:51.096 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBT12Rly+v0CBAAM1/AIv8HQjpX5HDSl1b5aQ== 2023-11-27T17:52:51.096 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2023-11-27T17:52:51.096 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBT12RlhU2uERAAEsKnLYGy6SBf8Rrgio5XHg== 2023-11-27T17:52:51.096 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2023-11-27T17:52:51.096 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBW12RlwpfGIRAA4iV4+SIOGLXeRm/FVVKSKQ== 2023-11-27T17:52:51.096 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBZ12RlJRQLKRAAEn/WOttbKmZsXXpSBTh3Fg== 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBc12Rly2ruLxAA/hU/YwL89WkWtNU0l0HYBQ== 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBf12Rlp8h4ORAAFCVFUQu5Xmjd8M4ejRESag== 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBT12RlknjZBRAA24DxLaIYU53VOgXm7SG38w== 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBT12RlJYDZFxAA76+y4pjIBvhxhaqN9e7/KA== 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBl12Rl6jl4OBAAMCJZT4Kzp0Vu81xluM7ekA== 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBp12RlhvmSBBAATgLor3aHVPt1DcUEAhUKyg== 2023-11-27T17:52:51.097 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2023-11-27T17:52:51.098 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBs12RlnUotDRAAfRVSLXdbzNWCofG8dSrcGQ== 2023-11-27T17:52:51.098 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2023-11-27T17:52:51.098 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBv12Rlb8WJFBAANjZH+NgnUtcMhVfjgGhBNQ== 2023-11-27T17:52:51.098 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2023-11-27T17:52:51.098 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBT12RlGScMHhAAuWSgPslHVjR+yfiMMPITUg== 2023-11-27T17:52:51.103 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2023-11-27T17:52:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBT12RlNz8LAxAADE0KfL29q+wE20sBf3nsNQ== 2023-11-27T17:52:51.103 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2023-11-27T17:52:51.103 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBT12Rly+v0CBAAM1/AIv8HQjpX5HDSl1b5aQ== 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBT12RlhU2uERAAEsKnLYGy6SBf8Rrgio5XHg== 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBW12RlwpfGIRAA4iV4+SIOGLXeRm/FVVKSKQ== 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBZ12RlJRQLKRAAEn/WOttbKmZsXXpSBTh3Fg== 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBc12Rly2ruLxAA/hU/YwL89WkWtNU0l0HYBQ== 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBf12Rlp8h4ORAAFCVFUQu5Xmjd8M4ejRESag== 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBT12RlknjZBRAA24DxLaIYU53VOgXm7SG38w== 2023-11-27T17:52:51.104 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2023-11-27T17:52:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBT12RlJYDZFxAA76+y4pjIBvhxhaqN9e7/KA== 2023-11-27T17:52:51.105 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2023-11-27T17:52:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBl12Rl6jl4OBAAMCJZT4Kzp0Vu81xluM7ekA== 2023-11-27T17:52:51.105 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2023-11-27T17:52:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBp12RlhvmSBBAATgLor3aHVPt1DcUEAhUKyg== 2023-11-27T17:52:51.105 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2023-11-27T17:52:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBs12RlnUotDRAAfRVSLXdbzNWCofG8dSrcGQ== 2023-11-27T17:52:51.105 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2023-11-27T17:52:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBv12Rlb8WJFBAANjZH+NgnUtcMhVfjgGhBNQ== 2023-11-27T17:52:51.105 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2023-11-27T17:52:51.105 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBT12RlGScMHhAAuWSgPslHVjR+yfiMMPITUg== 2023-11-27T17:52:51.106 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T17:52:51.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T17:52:51.193 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:52:51.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:52:51.281 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:52:51.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:52:51.368 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:51.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:51.458 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:51.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:51.502 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:51.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:51.588 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:51.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:51.675 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T17:52:51.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-27T17:52:51.761 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:52:51.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-27T17:52:51.852 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:51.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:51.935 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:51.937 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:52.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:52.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:52.097 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:52.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-27T17:52:52.175 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T17:52:52.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-27T17:52:52.259 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-27T17:52:52.260 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-27T17:52:52.274 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T17:52:52.372 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-27T17:52:52.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-27T17:52:52.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T17:52:52.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-27T17:52:52.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-27T17:52:52.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-27T17:52:52.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-27T17:52:52.664 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:52.666 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-27T17:52:52.709 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-27T17:52:52.709 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-27T17:52:52.709 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-27T17:52:52.712 INFO:tasks.ceph.mon.a:Started 2023-11-27T17:52:52.712 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-27T17:52:52.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-27T17:52:52.754 INFO:tasks.ceph.mon.b:Started 2023-11-27T17:52:52.755 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-27T17:52:52.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-27T17:52:52.757 INFO:tasks.ceph.mon.c:Started 2023-11-27T17:52:52.757 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-27T17:52:52.757 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-27T17:52:52.758 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-27T17:52:52.760 INFO:tasks.ceph.mgr.y:Started 2023-11-27T17:52:52.760 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-27T17:52:52.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-27T17:52:52.762 INFO:tasks.ceph.mgr.x:Started 2023-11-27T17:52:52.763 INFO:tasks.ceph:Setting crush tunables to default 2023-11-27T17:52:52.763 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd crush tunables default 2023-11-27T17:52:52.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.874+0000 7f303f4a1640 1 Processor -- start 2023-11-27T17:52:52.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.874+0000 7f303f4a1640 1 -- start start 2023-11-27T17:52:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.878+0000 7f303f4a1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.878+0000 7f303f4a1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30380b4360 con 0x7f303814c7b0 2023-11-27T17:52:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.878+0000 7f303f4a1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30380b5c10 con 0x7f30380a42b0 2023-11-27T17:52:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.878+0000 7f303f4a1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303806e7a0 con 0x7f303806ef70 2023-11-27T17:52:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.878+0000 7f303ca3c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f303814c7b0 0x7f30380b5500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33842/0 (socket says 172.21.15.31:33842) 2023-11-27T17:52:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.878+0000 7f303ca3c640 1 -- 172.21.15.31:0/2756015496 learned_addr learned my addr 172.21.15.31:0/2756015496 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:52:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.878+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.878+0000 7f303da3e640 1 -- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 msgr2=0x7f303806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T17:52:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.878+0000 7f303da3e640 1 -- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 msgr2=0x7f303806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:52:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.878+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:52:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:52.878+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T17:52:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:53.082+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:53.082+0000 7f303da3e640 1 -- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 msgr2=0x7f303806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T17:52:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:53.082+0000 7f303da3e640 1 -- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 msgr2=0x7f303806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:52:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:53.082+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:52:53.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:53.082+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T17:52:53.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:53.486+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:53.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:53.486+0000 7f303da3e640 1 -- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 msgr2=0x7f303806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T17:52:53.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:53.486+0000 7f303da3e640 1 -- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 msgr2=0x7f303806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:52:53.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:53.486+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:52:53.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:53.486+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T17:52:54.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:54.290+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:54.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:54.290+0000 7f303da3e640 1 -- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 msgr2=0x7f303806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-27T17:52:54.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:54.290+0000 7f303da3e640 1 -- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 msgr2=0x7f303806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:52:54.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:54.290+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:52:54.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:54.290+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T17:52:55.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f302effd640 1 -- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 msgr2=0x7f303806f400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:52:55.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f302effd640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f303806ef70 0x7f303806f400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f302effd640 1 -- 172.21.15.31:0/2756015496 >> v1:172.21.15.81:6789/0 conn(0x7f30380a42b0 legacy=0x7f30380b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f302effd640 1 -- 172.21.15.31:0/2756015496 >> v1:172.21.15.31:6789/0 conn(0x7f303814c7b0 legacy=0x7f30380b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f302effd640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f302effd640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f302effd640 1 -- 172.21.15.31:0/2756015496 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303806e7a0 con 0x7f301c006260 2023-11-27T17:52:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f302effd640 1 -- 172.21.15.31:0/2756015496 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301c008dd0 con 0x7f301c003720 2023-11-27T17:52:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f303d23d640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f303ca3c640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 msgr2=0x7f301c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T17:52:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f303ca3c640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 msgr2=0x7f301c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:52:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:52:55.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T17:52:55.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f303d23d640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 msgr2=0x7f301c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T17:52:55.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f303d23d640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 msgr2=0x7f301c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:52:55.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f303d23d640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:52:55.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:55.878+0000 7f303d23d640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-27T17:52:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.082+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.082+0000 7f303ca3c640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 msgr2=0x7f301c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T17:52:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.082+0000 7f303ca3c640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 msgr2=0x7f301c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:52:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.082+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:52:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.082+0000 7f303d23d640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.082+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T17:52:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.082+0000 7f303d23d640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 msgr2=0x7f301c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T17:52:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.082+0000 7f303d23d640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 msgr2=0x7f301c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:52:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.082+0000 7f303d23d640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:52:56.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.082+0000 7f303d23d640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-27T17:52:56.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.486+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:56.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.486+0000 7f303d23d640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:56.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.486+0000 7f303ca3c640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 msgr2=0x7f301c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T17:52:56.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.486+0000 7f303ca3c640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 msgr2=0x7f301c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:52:56.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.486+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:52:56.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.486+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T17:52:56.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.486+0000 7f303d23d640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 msgr2=0x7f301c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T17:52:56.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.486+0000 7f303d23d640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 msgr2=0x7f301c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:52:56.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.486+0000 7f303d23d640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:52:56.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:56.486+0000 7f303d23d640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-27T17:52:57.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:57.290+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:57.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:57.290+0000 7f303d23d640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:57.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:57.290+0000 7f303ca3c640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 msgr2=0x7f301c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-27T17:52:57.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:57.290+0000 7f303ca3c640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 msgr2=0x7f301c008720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:52:57.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:57.290+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:52:57.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:57.290+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T17:52:57.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:57.290+0000 7f303d23d640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 msgr2=0x7f301c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-27T17:52:57.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:57.290+0000 7f303d23d640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 msgr2=0x7f301c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-27T17:52:57.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:57.290+0000 7f303d23d640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-27T17:52:57.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:57.290+0000 7f303d23d640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-27T17:52:58.477 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:52:58.474+0000 7fae4f41d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T17:52:58.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f302effd640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 msgr2=0x7f301c005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:52:58.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f302effd640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.81:3300/0 conn(0x7f301c003720 0x7f301c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:58.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f302effd640 1 -- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 msgr2=0x7f301c008720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:52:58.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f302effd640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c006260 0x7f301c008720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:58.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f303da3e640 1 -- 172.21.15.31:0/2756015496 reap_dead start 2023-11-27T17:52:58.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f302effd640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c007e30 0x7f301c008210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:58.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f302effd640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f301c008750 0x7f301c00d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:58.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f302effd640 1 -- 172.21.15.31:0/2756015496 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30380b4030 con 0x7f301c003b70 2023-11-27T17:52:58.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f302effd640 1 -- 172.21.15.31:0/2756015496 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303806e7a0 con 0x7f301c007e30 2023-11-27T17:52:58.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f302effd640 1 -- 172.21.15.31:0/2756015496 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301c008dd0 con 0x7f301c008750 2023-11-27T17:52:58.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> v2:172.21.15.31:3300/0 conn(0x7f301c007e30 0x7f301c008210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:58.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f303da3e640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f301c008750 0x7f301c00d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:58.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f303ca3c640 1 -- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f301c008750 msgr2=0x7f301c00d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:52:58.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f301c008750 0x7f301c00d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:58.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f303ca3c640 1 -- 172.21.15.31:0/2756015496 >> v1:172.21.15.81:6789/0 conn(0x7f301c003b70 legacy=0x7f301c006710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:58.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.878+0000 7f303ca3c640 1 -- 172.21.15.31:0/2756015496 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c00e930 con 0x7f301c007e30 2023-11-27T17:52:58.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.882+0000 7f303ca3c640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301c007e30 0x7f301c008210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f303814cbd0 tx=0x7f302801cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebb03d65507a9be server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:52:58.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.882+0000 7f302ffff640 1 -- 172.21.15.31:0/2756015496 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30280a5e80 con 0x7f301c007e30 2023-11-27T17:52:58.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.882+0000 7f302ffff640 1 -- 172.21.15.31:0/2756015496 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30280a9070 con 0x7f301c007e30 2023-11-27T17:52:58.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.882+0000 7f302ffff640 1 -- 172.21.15.31:0/2756015496 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30280af600 con 0x7f301c007e30 2023-11-27T17:52:58.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.886+0000 7f303f4a1640 1 -- 172.21.15.31:0/2756015496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301c007e30 msgr2=0x7f301c008210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:58.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.886+0000 7f303f4a1640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301c007e30 0x7f301c008210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f303814cbd0 tx=0x7f302801cfa0 comp rx=0 tx=0).stop 2023-11-27T17:52:58.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.886+0000 7f303f4a1640 1 -- 172.21.15.31:0/2756015496 shutdown_connections 2023-11-27T17:52:58.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.886+0000 7f303f4a1640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f301c008750 0x7f301c00d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:58.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.886+0000 7f303f4a1640 1 --2- 172.21.15.31:0/2756015496 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301c007e30 0x7f301c008210 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:58.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.886+0000 7f303f4a1640 1 -- 172.21.15.31:0/2756015496 >> 172.21.15.31:0/2756015496 conn(0x7f30380bb7d0 msgr2=0x7f30380bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:52:58.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.886+0000 7f303f4a1640 1 -- 172.21.15.31:0/2756015496 shutdown_connections 2023-11-27T17:52:58.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.886+0000 7f303f4a1640 1 -- 172.21.15.31:0/2756015496 wait complete. 2023-11-27T17:52:58.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.886+0000 7f303f4a1640 1 Processor -- start 2023-11-27T17:52:58.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.886+0000 7f303f4a1640 1 -- start start 2023-11-27T17:52:58.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303f4a1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f301c003b70 0x7f30381df610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:58.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303f4a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c007e30 0x7f30380b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:58.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303f4a1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301c008750 0x7f3038141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:58.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303f4a1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30381df180 con 0x7f301c008750 2023-11-27T17:52:58.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303f4a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30380b8f10 con 0x7f301c007e30 2023-11-27T17:52:58.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303f4a1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30381deb30 con 0x7f301c003b70 2023-11-27T17:52:58.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303da3e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301c008750 0x7f3038141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:58.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303da3e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301c008750 0x7f3038141a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44768/0 (socket says 172.21.15.31:44768) 2023-11-27T17:52:58.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303da3e640 1 -- 172.21.15.31:0/3307870111 learned_addr learned my addr 172.21.15.31:0/3307870111 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:52:58.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303d23d640 1 --2- 172.21.15.31:0/3307870111 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f301c003b70 0x7f30381df610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:58.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303ca3c640 1 --2- 172.21.15.31:0/3307870111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c007e30 0x7f30380b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:58.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303da3e640 1 -- 172.21.15.31:0/3307870111 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f301c003b70 msgr2=0x7f30381df610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:58.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303da3e640 1 --2- 172.21.15.31:0/3307870111 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f301c003b70 0x7f30381df610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:58.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303da3e640 1 -- 172.21.15.31:0/3307870111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c007e30 msgr2=0x7f30380b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:58.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303da3e640 1 --2- 172.21.15.31:0/3307870111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c007e30 0x7f30380b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:58.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303da3e640 1 -- 172.21.15.31:0/3307870111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302800f040 con 0x7f301c008750 2023-11-27T17:52:58.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303da3e640 1 --2- 172.21.15.31:0/3307870111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301c008750 0x7f3038141a60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f301c006140 tx=0x7f3030015700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:52:58.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f302dffb640 1 -- 172.21.15.31:0/3307870111 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30300046a0 con 0x7f301c008750 2023-11-27T17:52:58.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f302dffb640 1 -- 172.21.15.31:0/3307870111 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303000f040 con 0x7f301c008750 2023-11-27T17:52:58.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f302dffb640 1 -- 172.21.15.31:0/3307870111 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030021410 con 0x7f301c008750 2023-11-27T17:52:58.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303f4a1640 1 -- 172.21.15.31:0/3307870111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30381dee10 con 0x7f301c008750 2023-11-27T17:52:58.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303f4a1640 1 -- 172.21.15.31:0/3307870111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303814a2e0 con 0x7f301c008750 2023-11-27T17:52:58.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f302dffb640 1 -- 172.21.15.31:0/3307870111 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f30300218f0 con 0x7f301c008750 2023-11-27T17:52:58.897 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f302dffb640 1 -- 172.21.15.31:0/3307870111 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3030020700 con 0x7f301c008750 2023-11-27T17:52:58.898 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.890+0000 7f303f4a1640 1 -- 172.21.15.31:0/3307870111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303804e850 con 0x7f301c008750 2023-11-27T17:52:58.901 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.898+0000 7f302dffb640 1 -- 172.21.15.31:0/3307870111 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f303001c030 con 0x7f301c008750 2023-11-27T17:52:58.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.974+0000 7f303f4a1640 1 -- 172.21.15.31:0/3307870111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f30381df2c0 con 0x7f301c008750 2023-11-27T17:52:58.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.974+0000 7f302dffb640 1 -- 172.21.15.31:0/3307870111 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3030017d20 con 0x7f301c008750 2023-11-27T17:52:58.978 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2023-11-27T17:52:58.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.978+0000 7f303f4a1640 1 -- 172.21.15.31:0/3307870111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301c008750 msgr2=0x7f3038141a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.978+0000 7f303f4a1640 1 --2- 172.21.15.31:0/3307870111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301c008750 0x7f3038141a60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f301c006140 tx=0x7f3030015700 comp rx=0 tx=0).stop 2023-11-27T17:52:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.978+0000 7f303f4a1640 1 -- 172.21.15.31:0/3307870111 shutdown_connections 2023-11-27T17:52:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.978+0000 7f303f4a1640 1 --2- 172.21.15.31:0/3307870111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f301c008750 0x7f3038141a60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.978+0000 7f303f4a1640 1 --2- 172.21.15.31:0/3307870111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f301c007e30 0x7f30380b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.978+0000 7f303f4a1640 1 --2- 172.21.15.31:0/3307870111 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f301c003b70 0x7f30381df610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.978+0000 7f303f4a1640 1 -- 172.21.15.31:0/3307870111 >> 172.21.15.31:0/3307870111 conn(0x7f30380bb7d0 msgr2=0x7f303814a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:52:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.978+0000 7f303f4a1640 1 -- 172.21.15.31:0/3307870111 shutdown_connections 2023-11-27T17:52:58.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:52:58.978+0000 7f303f4a1640 1 -- 172.21.15.31:0/3307870111 wait complete. 2023-11-27T17:52:58.998 INFO:tasks.ceph:check_enable_crimson: False 2023-11-27T17:52:58.998 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-27T17:52:58.999 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:58.999 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-27T17:52:59.008 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:59.009 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-27T17:52:59.035 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:52:59.030+0000 7fae4f41d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T17:52:59.050 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:59.050 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-27T17:52:59.102 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-11-27T17:52:59.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-27T17:52:59.129 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:52:59.122+0000 7f88d941f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-27T17:52:59.155 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:59.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-27T17:52:59.169 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:59.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-27T17:52:59.215 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:52:59.214+0000 7fae4f41d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T17:52:59.226 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:59.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-27T17:52:59.280 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2023-11-27T17:52:59.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-27T17:52:59.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 2d3cc2c7-687c-403a-bf6f-08af9df079f1 0 2023-11-27T17:52:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.490+0000 7fdc32b48640 1 Processor -- start 2023-11-27T17:52:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.490+0000 7fdc32b48640 1 -- start start 2023-11-27T17:52:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.490+0000 7fdc32b48640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 0x7fdc2c0b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.490+0000 7fdc32b48640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c071ef0 con 0x7fdc2c0ba830 2023-11-27T17:52:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.490+0000 7fdc32b48640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c070430 con 0x7fdc2c148160 2023-11-27T17:52:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.490+0000 7fdc32b48640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0b4da0 con 0x7fdc2c142700 2023-11-27T17:52:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.490+0000 7fdc2bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdc2c148160 0x7fdc2c141ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49298/0 (socket says 172.21.15.81:49298) 2023-11-27T17:52:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.490+0000 7fdc2bfff640 1 -- 172.21.15.81:0/1705010527 learned_addr learned my addr 172.21.15.81:0/1705010527 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-27T17:52:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.490+0000 7fdc310e5640 1 --2- 172.21.15.81:0/1705010527 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 0x7fdc2c0b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.490+0000 7fdc310e5640 1 -- 172.21.15.81:0/1705010527 >> v1:172.21.15.81:6789/0 conn(0x7fdc2c148160 legacy=0x7fdc2c141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.490+0000 7fdc310e5640 1 -- 172.21.15.81:0/1705010527 >> v1:172.21.15.31:6789/0 conn(0x7fdc2c0ba830 legacy=0x7fdc2c0714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:52:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.490+0000 7fdc310e5640 1 -- 172.21.15.81:0/1705010527 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c070710 con 0x7fdc2c142700 2023-11-27T17:52:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc310e5640 1 --2- 172.21.15.81:0/1705010527 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 0x7fdc2c0b47a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009dc0 tx=0x7fdc2401c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7fcbeb384a7c44d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:52:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc2b7fe640 1 -- 172.21.15.81:0/1705010527 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc240a5980 con 0x7fdc2c142700 2023-11-27T17:52:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc2b7fe640 1 -- 172.21.15.81:0/1705010527 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc240a5ae0 con 0x7fdc2c142700 2023-11-27T17:52:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc2b7fe640 1 -- 172.21.15.81:0/1705010527 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc240a5e70 con 0x7fdc2c142700 2023-11-27T17:52:59.498 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 -- 172.21.15.81:0/1705010527 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 msgr2=0x7fdc2c0b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 --2- 172.21.15.81:0/1705010527 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 0x7fdc2c0b47a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009dc0 tx=0x7fdc2401c860 comp rx=0 tx=0).stop 2023-11-27T17:52:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 -- 172.21.15.81:0/1705010527 shutdown_connections 2023-11-27T17:52:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 --2- 172.21.15.81:0/1705010527 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 0x7fdc2c0b47a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 -- 172.21.15.81:0/1705010527 >> 172.21.15.81:0/1705010527 conn(0x7fdc2c06e8a0 msgr2=0x7fdc2c06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:52:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 -- 172.21.15.81:0/1705010527 shutdown_connections 2023-11-27T17:52:59.499 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 -- 172.21.15.81:0/1705010527 wait complete. 2023-11-27T17:52:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 Processor -- start 2023-11-27T17:52:59.500 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 -- start start 2023-11-27T17:52:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c0ba830 0x7fdc2c0b7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 0x7fdc2c1e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc2c148160 0x7fdc2c144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0b7ea0 con 0x7fdc2c148160 2023-11-27T17:52:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.494+0000 7fdc32b48640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c1e55a0 con 0x7fdc2c0ba830 2023-11-27T17:52:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc32b48640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c1e5f70 con 0x7fdc2c142700 2023-11-27T17:52:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc2bfff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 0x7fdc2c1e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc308e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c0ba830 0x7fdc2c0b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.503 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc2bfff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 0x7fdc2c1e5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:58166/0 (socket says 172.21.15.81:58166) 2023-11-27T17:52:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc2bfff640 1 -- 172.21.15.81:0/2337638505 learned_addr learned my addr 172.21.15.81:0/2337638505 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-27T17:52:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc308e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c0ba830 0x7fdc2c0b7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33860/0 (socket says 172.21.15.81:33860) 2023-11-27T17:52:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc310e5640 1 --2- 172.21.15.81:0/2337638505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc2c148160 0x7fdc2c144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc2bfff640 1 -- 172.21.15.81:0/2337638505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c0ba830 msgr2=0x7fdc2c0b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc2bfff640 1 --2- 172.21.15.81:0/2337638505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c0ba830 0x7fdc2c0b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc2bfff640 1 -- 172.21.15.81:0/2337638505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc2c148160 msgr2=0x7fdc2c144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc2bfff640 1 --2- 172.21.15.81:0/2337638505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc2c148160 0x7fdc2c144bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc2bfff640 1 -- 172.21.15.81:0/2337638505 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc24009a70 con 0x7fdc2c142700 2023-11-27T17:52:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc308e4640 1 --2- 172.21.15.81:0/2337638505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c0ba830 0x7fdc2c0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:52:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc310e5640 1 --2- 172.21.15.81:0/2337638505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc2c148160 0x7fdc2c144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:52:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc2bfff640 1 --2- 172.21.15.81:0/2337638505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 0x7fdc2c1e5a30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdc20001ec0 tx=0x7fdc2000c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:52:59.504 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc297fa640 1 -- 172.21.15.81:0/2337638505 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20005cf0 con 0x7fdc2c142700 2023-11-27T17:52:59.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc297fa640 1 -- 172.21.15.81:0/2337638505 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc20005e50 con 0x7fdc2c142700 2023-11-27T17:52:59.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc297fa640 1 -- 172.21.15.81:0/2337638505 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc200072d0 con 0x7fdc2c142700 2023-11-27T17:52:59.505 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc32b48640 1 -- 172.21.15.81:0/2337638505 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2c145650 con 0x7fdc2c142700 2023-11-27T17:52:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc32b48640 1 -- 172.21.15.81:0/2337638505 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2c1e5230 con 0x7fdc2c142700 2023-11-27T17:52:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc297fa640 1 -- 172.21.15.81:0/2337638505 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fdc2001c440 con 0x7fdc2c142700 2023-11-27T17:52:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc297fa640 1 -- 172.21.15.81:0/2337638505 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdc20012ae0 con 0x7fdc2c142700 2023-11-27T17:52:59.506 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.498+0000 7fdc32b48640 1 -- 172.21.15.81:0/2337638505 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2c1e5710 con 0x7fdc2c142700 2023-11-27T17:52:59.527 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.522+0000 7fdc297fa640 1 -- 172.21.15.81:0/2337638505 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fdc20021060 con 0x7fdc2c142700 2023-11-27T17:52:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.590+0000 7fdc32b48640 1 -- 172.21.15.81:0/2337638505 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d3cc2c7-687c-403a-bf6f-08af9df079f1", "id": 0} v 0) v1 -- 0x7fdc2c04e850 con 0x7fdc2c142700 2023-11-27T17:52:59.605 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.602+0000 7fdc297fa640 1 -- 172.21.15.81:0/2337638505 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d3cc2c7-687c-403a-bf6f-08af9df079f1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdc20017070 con 0x7fdc2c142700 2023-11-27T17:52:59.606 INFO:teuthology.orchestra.run.smithi081.stdout:0 2023-11-27T17:52:59.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.602+0000 7fdc32b48640 1 -- 172.21.15.81:0/2337638505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 msgr2=0x7fdc2c1e5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:59.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.602+0000 7fdc32b48640 1 --2- 172.21.15.81:0/2337638505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 0x7fdc2c1e5a30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdc20001ec0 tx=0x7fdc2000c890 comp rx=0 tx=0).stop 2023-11-27T17:52:59.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.602+0000 7fdc32b48640 1 -- 172.21.15.81:0/2337638505 shutdown_connections 2023-11-27T17:52:59.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.602+0000 7fdc32b48640 1 --2- 172.21.15.81:0/2337638505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc2c148160 0x7fdc2c144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.607 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.602+0000 7fdc32b48640 1 --2- 172.21.15.81:0/2337638505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdc2c142700 0x7fdc2c1e5a30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.602+0000 7fdc32b48640 1 --2- 172.21.15.81:0/2337638505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc2c0ba830 0x7fdc2c0b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.602+0000 7fdc32b48640 1 -- 172.21.15.81:0/2337638505 >> 172.21.15.81:0/2337638505 conn(0x7fdc2c06e8a0 msgr2=0x7fdc2c1370d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:52:59.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.602+0000 7fdc32b48640 1 -- 172.21.15.81:0/2337638505 shutdown_connections 2023-11-27T17:52:59.608 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.602+0000 7fdc32b48640 1 -- 172.21.15.81:0/2337638505 wait complete. 2023-11-27T17:52:59.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4 1 2023-11-27T17:52:59.733 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:52:59.726+0000 7f88d941f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-27T17:52:59.743 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab529bb640 1 Processor -- start 2023-11-27T17:52:59.744 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab529bb640 1 -- start start 2023-11-27T17:52:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab529bb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c142680 0x7fab4c06b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab529bb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab4c0b7510 0x7fab4c148160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab529bb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c0b8dd0 con 0x7fab4c1422a0 2023-11-27T17:52:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab529bb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c071fd0 con 0x7fab4c0b7510 2023-11-27T17:52:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab529bb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0b9b50 con 0x7fab4c142680 2023-11-27T17:52:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab4b7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c142680 0x7fab4c06b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab50f58640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab4c0b7510 0x7fab4c148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab4b7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c142680 0x7fab4c06b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:58168/0 (socket says 172.21.15.81:58168) 2023-11-27T17:52:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab4b7fe640 1 -- 172.21.15.81:0/618852309 learned_addr learned my addr 172.21.15.81:0/618852309 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-27T17:52:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab4b7fe640 1 -- 172.21.15.81:0/618852309 >> v2:172.21.15.81:3300/0 conn(0x7fab4c0b7510 msgr2=0x7fab4c148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:52:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab4b7fe640 1 --2- 172.21.15.81:0/618852309 >> v2:172.21.15.81:3300/0 conn(0x7fab4c0b7510 0x7fab4c148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab4b7fe640 1 -- 172.21.15.81:0/618852309 >> v1:172.21.15.31:6789/0 conn(0x7fab4c1422a0 legacy=0x7fab4c0717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:52:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab4b7fe640 1 -- 172.21.15.81:0/618852309 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0b9070 con 0x7fab4c142680 2023-11-27T17:52:59.746 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.738+0000 7fab50f58640 1 --2- 172.21.15.81:0/618852309 >> v2:172.21.15.81:3300/0 conn(0x7fab4c0b7510 0x7fab4c148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:52:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.742+0000 7fab4b7fe640 1 --2- 172.21.15.81:0/618852309 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c142680 0x7fab4c06b570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab3400bb10 tx=0x7fab3401eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bfdd7a65cbbde2d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:52:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.742+0000 7fab4affd640 1 -- 172.21.15.81:0/618852309 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340a7b50 con 0x7fab4c142680 2023-11-27T17:52:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.742+0000 7fab4affd640 1 -- 172.21.15.81:0/618852309 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340a7cb0 con 0x7fab4c142680 2023-11-27T17:52:59.747 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.742+0000 7fab4affd640 1 -- 172.21.15.81:0/618852309 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340af660 con 0x7fab4c142680 2023-11-27T17:52:59.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.742+0000 7fab529bb640 1 -- 172.21.15.81:0/618852309 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c142680 msgr2=0x7fab4c06b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:59.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.742+0000 7fab529bb640 1 --2- 172.21.15.81:0/618852309 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c142680 0x7fab4c06b570 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab3400bb10 tx=0x7fab3401eba0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.748 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.742+0000 7fab529bb640 1 -- 172.21.15.81:0/618852309 shutdown_connections 2023-11-27T17:52:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.742+0000 7fab529bb640 1 --2- 172.21.15.81:0/618852309 >> v2:172.21.15.81:3300/0 conn(0x7fab4c0b7510 0x7fab4c148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.742+0000 7fab529bb640 1 --2- 172.21.15.81:0/618852309 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c142680 0x7fab4c06b570 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.742+0000 7fab529bb640 1 -- 172.21.15.81:0/618852309 >> 172.21.15.81:0/618852309 conn(0x7fab4c0b9dc0 msgr2=0x7fab4c0ba1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:52:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.742+0000 7fab529bb640 1 -- 172.21.15.81:0/618852309 shutdown_connections 2023-11-27T17:52:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.742+0000 7fab529bb640 1 -- 172.21.15.81:0/618852309 wait complete. 2023-11-27T17:52:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab529bb640 1 Processor -- start 2023-11-27T17:52:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab529bb640 1 -- start start 2023-11-27T17:52:59.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab529bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c0b7510 0x7fab4c0bc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab529bb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c1422a0 0x7fab4c13da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.751 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab529bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab4c142680 0x7fab4c13c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab529bb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c13a500 con 0x7fab4c142680 2023-11-27T17:52:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab529bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c13d630 con 0x7fab4c0b7510 2023-11-27T17:52:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab529bb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c139f40 con 0x7fab4c1422a0 2023-11-27T17:52:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab4b7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c1422a0 0x7fab4c13da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c0b7510 0x7fab4c0bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab4b7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c1422a0 0x7fab4c13da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:58180/0 (socket says 172.21.15.81:58180) 2023-11-27T17:52:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab4bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c0b7510 0x7fab4c0bc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33886/0 (socket says 172.21.15.81:33886) 2023-11-27T17:52:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab4b7fe640 1 -- 172.21.15.81:0/3912445950 learned_addr learned my addr 172.21.15.81:0/3912445950 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-27T17:52:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab50f58640 1 --2- 172.21.15.81:0/3912445950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab4c142680 0x7fab4c13c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab4bfff640 1 -- 172.21.15.81:0/3912445950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c1422a0 msgr2=0x7fab4c13da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab4bfff640 1 --2- 172.21.15.81:0/3912445950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c1422a0 0x7fab4c13da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.752 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab4bfff640 1 -- 172.21.15.81:0/3912445950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab4c142680 msgr2=0x7fab4c13c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab4bfff640 1 --2- 172.21.15.81:0/3912445950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab4c142680 0x7fab4c13c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab4bfff640 1 -- 172.21.15.81:0/3912445950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c009420 con 0x7fab4c0b7510 2023-11-27T17:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab4b7fe640 1 --2- 172.21.15.81:0/3912445950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c1422a0 0x7fab4c13da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab4bfff640 1 --2- 172.21.15.81:0/3912445950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c0b7510 0x7fab4c0bc370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fab4400c700 tx=0x7fab4400cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab48ff9640 1 -- 172.21.15.81:0/3912445950 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4400aa50 con 0x7fab4c0b7510 2023-11-27T17:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab48ff9640 1 -- 172.21.15.81:0/3912445950 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4400abb0 con 0x7fab4c0b7510 2023-11-27T17:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab529bb640 1 -- 172.21.15.81:0/3912445950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3400b770 con 0x7fab4c0b7510 2023-11-27T17:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab48ff9640 1 -- 172.21.15.81:0/3912445950 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4400ce10 con 0x7fab4c0b7510 2023-11-27T17:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab529bb640 1 -- 172.21.15.81:0/3912445950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c13df90 con 0x7fab4c0b7510 2023-11-27T17:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab48ff9640 1 -- 172.21.15.81:0/3912445950 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fab44012420 con 0x7fab4c0b7510 2023-11-27T17:52:59.753 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab48ff9640 1 -- 172.21.15.81:0/3912445950 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fab4401b930 con 0x7fab4c0b7510 2023-11-27T17:52:59.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.746+0000 7fab529bb640 1 -- 172.21.15.81:0/3912445950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c066ab0 con 0x7fab4c0b7510 2023-11-27T17:52:59.754 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.750+0000 7fab48ff9640 1 -- 172.21.15.81:0/3912445950 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fab4403ace0 con 0x7fab4c0b7510 2023-11-27T17:52:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.818+0000 7fab529bb640 1 -- 172.21.15.81:0/3912445950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4", "id": 1} v 0) v1 -- 0x7fab4c04e850 con 0x7fab4c0b7510 2023-11-27T17:52:59.827 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:52:59.826+0000 7fae4f41d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T17:52:59.832 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.826+0000 7fab48ff9640 1 -- 172.21.15.81:0/3912445950 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fab44029070 con 0x7fab4c0b7510 2023-11-27T17:52:59.832 INFO:teuthology.orchestra.run.smithi081.stdout:1 2023-11-27T17:52:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.826+0000 7fab529bb640 1 -- 172.21.15.81:0/3912445950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c0b7510 msgr2=0x7fab4c0bc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.826+0000 7fab529bb640 1 --2- 172.21.15.81:0/3912445950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c0b7510 0x7fab4c0bc370 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fab4400c700 tx=0x7fab4400cbc0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.830+0000 7fab529bb640 1 -- 172.21.15.81:0/3912445950 shutdown_connections 2023-11-27T17:52:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.830+0000 7fab529bb640 1 --2- 172.21.15.81:0/3912445950 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab4c142680 0x7fab4c13c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.833 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.830+0000 7fab529bb640 1 --2- 172.21.15.81:0/3912445950 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fab4c1422a0 0x7fab4c13da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.830+0000 7fab529bb640 1 --2- 172.21.15.81:0/3912445950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab4c0b7510 0x7fab4c0bc370 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.830+0000 7fab529bb640 1 -- 172.21.15.81:0/3912445950 >> 172.21.15.81:0/3912445950 conn(0x7fab4c0b9dc0 msgr2=0x7fab4c13a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:52:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.830+0000 7fab529bb640 1 -- 172.21.15.81:0/3912445950 shutdown_connections 2023-11-27T17:52:59.834 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.830+0000 7fab529bb640 1 -- 172.21.15.81:0/3912445950 wait complete. 2023-11-27T17:52:59.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 29da069a-fe83-4334-9c3d-480084a05f9a 2 2023-11-27T17:52:59.883 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:52:59.882+0000 7fae4f41d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T17:52:59.932 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:52:59.926+0000 7f88d941f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-27T17:52:59.937 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:52:59.934+0000 7fae4f41d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T17:52:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.966+0000 7f0cfef42640 1 Processor -- start 2023-11-27T17:52:59.972 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.966+0000 7f0cfef42640 1 -- start start 2023-11-27T17:52:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.966+0000 7f0cfef42640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf8148160 0x7f0cf80b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.966+0000 7f0cfef42640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cf80b99b0 0x7f0cf8141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.966+0000 7f0cfef42640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf8071ef0 con 0x7f0cf80ba830 2023-11-27T17:52:59.973 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.966+0000 7f0cfef42640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf80b4da0 con 0x7f0cf80b99b0 2023-11-27T17:52:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.966+0000 7f0cfef42640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80b9e40 con 0x7f0cf8148160 2023-11-27T17:52:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.966+0000 7f0cf7fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf8148160 0x7f0cf80b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.966+0000 7f0cfd4df640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0cf80b99b0 0x7f0cf8141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.966+0000 7f0cf7fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf8148160 0x7f0cf80b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:58186/0 (socket says 172.21.15.81:58186) 2023-11-27T17:52:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.966+0000 7f0cf7fff640 1 -- 172.21.15.81:0/1885335826 learned_addr learned my addr 172.21.15.81:0/1885335826 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-27T17:52:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cf7fff640 1 -- 172.21.15.81:0/1885335826 >> v2:172.21.15.81:3300/0 conn(0x7f0cf80b99b0 msgr2=0x7f0cf8141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:52:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cf7fff640 1 --2- 172.21.15.81:0/1885335826 >> v2:172.21.15.81:3300/0 conn(0x7f0cf80b99b0 0x7f0cf8141ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cf7fff640 1 -- 172.21.15.81:0/1885335826 >> v1:172.21.15.31:6789/0 conn(0x7f0cf80ba830 legacy=0x7f0cf80714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:52:59.974 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cf7fff640 1 -- 172.21.15.81:0/1885335826 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8070430 con 0x7f0cf8148160 2023-11-27T17:52:59.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cf7fff640 1 --2- 172.21.15.81:0/1885335826 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf8148160 0x7f0cf80b47a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009870 tx=0x7f0ce001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a975a20c2e06479 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:52:59.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cf77fe640 1 -- 172.21.15.81:0/1885335826 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00ad640 con 0x7f0cf8148160 2023-11-27T17:52:59.975 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cf77fe640 1 -- 172.21.15.81:0/1885335826 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce00ad7a0 con 0x7f0cf8148160 2023-11-27T17:52:59.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cf77fe640 1 -- 172.21.15.81:0/1885335826 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00adb30 con 0x7f0cf8148160 2023-11-27T17:52:59.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cfef42640 1 -- 172.21.15.81:0/1885335826 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf8148160 msgr2=0x7f0cf80b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:59.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cfef42640 1 --2- 172.21.15.81:0/1885335826 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf8148160 0x7f0cf80b47a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009870 tx=0x7f0ce001c480 comp rx=0 tx=0).stop 2023-11-27T17:52:59.976 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cfef42640 1 -- 172.21.15.81:0/1885335826 shutdown_connections 2023-11-27T17:52:59.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cfef42640 1 --2- 172.21.15.81:0/1885335826 >> v2:172.21.15.81:3300/0 conn(0x7f0cf80b99b0 0x7f0cf8141ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cfef42640 1 --2- 172.21.15.81:0/1885335826 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf8148160 0x7f0cf80b47a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cfef42640 1 -- 172.21.15.81:0/1885335826 >> 172.21.15.81:0/1885335826 conn(0x7f0cf806e8a0 msgr2=0x7f0cf806b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:52:59.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cfef42640 1 -- 172.21.15.81:0/1885335826 shutdown_connections 2023-11-27T17:52:59.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.970+0000 7f0cfef42640 1 -- 172.21.15.81:0/1885335826 wait complete. 2023-11-27T17:52:59.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfef42640 1 Processor -- start 2023-11-27T17:52:59.977 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfef42640 1 -- start start 2023-11-27T17:52:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfef42640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cf80b99b0 0x7f0cf8138530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfef42640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf80ba830 0x7f0cf8144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfef42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf8148160 0x7f0cf81e55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:52:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfef42640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf80b9790 con 0x7f0cf80b99b0 2023-11-27T17:52:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfef42640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf8138a70 con 0x7f0cf8148160 2023-11-27T17:52:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfef42640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf81438f0 con 0x7f0cf80ba830 2023-11-27T17:52:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf7fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf80ba830 0x7f0cf8144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf7fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf80ba830 0x7f0cf8144710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:58200/0 (socket says 172.21.15.81:58200) 2023-11-27T17:52:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf7fff640 1 -- 172.21.15.81:0/4163778732 learned_addr learned my addr 172.21.15.81:0/4163778732 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-27T17:52:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfd4df640 1 --2- 172.21.15.81:0/4163778732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf8148160 0x7f0cf81e55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfccde640 1 --2- 172.21.15.81:0/4163778732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cf80b99b0 0x7f0cf8138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:52:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf7fff640 1 -- 172.21.15.81:0/4163778732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf8148160 msgr2=0x7f0cf81e55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf7fff640 1 --2- 172.21.15.81:0/4163778732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf8148160 0x7f0cf81e55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf7fff640 1 -- 172.21.15.81:0/4163778732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cf80b99b0 msgr2=0x7f0cf8138530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:52:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf7fff640 1 --2- 172.21.15.81:0/4163778732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cf80b99b0 0x7f0cf8138530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:52:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf7fff640 1 -- 172.21.15.81:0/4163778732 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00094d0 con 0x7f0cf80ba830 2023-11-27T17:52:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfccde640 1 --2- 172.21.15.81:0/4163778732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cf80b99b0 0x7f0cf8138530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:52:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf7fff640 1 --2- 172.21.15.81:0/4163778732 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf80ba830 0x7f0cf8144710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0ce001ab30 tx=0x7f0ce0019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:52:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf57fa640 1 -- 172.21.15.81:0/4163778732 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00b8640 con 0x7f0cf80ba830 2023-11-27T17:52:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf57fa640 1 -- 172.21.15.81:0/4163778732 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce00a6040 con 0x7f0cf80ba830 2023-11-27T17:52:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfef42640 1 -- 172.21.15.81:0/4163778732 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf81432a0 con 0x7f0cf80ba830 2023-11-27T17:52:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf57fa640 1 -- 172.21.15.81:0/4163778732 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00b8a00 con 0x7f0cf80ba830 2023-11-27T17:52:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfef42640 1 -- 172.21.15.81:0/4163778732 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf8144c50 con 0x7f0cf80ba830 2023-11-27T17:52:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cfef42640 1 -- 172.21.15.81:0/4163778732 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf8143100 con 0x7f0cf80ba830 2023-11-27T17:52:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf57fa640 1 -- 172.21.15.81:0/4163778732 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f0ce00b8b60 con 0x7f0cf80ba830 2023-11-27T17:52:59.982 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.974+0000 7f0cf57fa640 1 -- 172.21.15.81:0/4163778732 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0ce00b7800 con 0x7f0cf80ba830 2023-11-27T17:52:59.983 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:52:59.978+0000 7f0cf57fa640 1 -- 172.21.15.81:0/4163778732 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f0cf8143100 con 0x7f0cf80ba830 2023-11-27T17:53:00.017 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:00.014+0000 7fae4f41d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T17:53:00.051 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.046+0000 7f0cfef42640 1 -- 172.21.15.81:0/4163778732 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "29da069a-fe83-4334-9c3d-480084a05f9a", "id": 2} v 0) v1 -- 0x7f0cf8143aa0 con 0x7f0cf80ba830 2023-11-27T17:53:00.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.054+0000 7f0cf57fa640 1 -- 172.21.15.81:0/4163778732 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29da069a-fe83-4334-9c3d-480084a05f9a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0cf8143aa0 con 0x7f0cf80ba830 2023-11-27T17:53:00.060 INFO:teuthology.orchestra.run.smithi081.stdout:2 2023-11-27T17:53:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.054+0000 7f0cfef42640 1 -- 172.21.15.81:0/4163778732 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf80ba830 msgr2=0x7f0cf8144710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.054+0000 7f0cfef42640 1 --2- 172.21.15.81:0/4163778732 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf80ba830 0x7f0cf8144710 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0ce001ab30 tx=0x7f0ce0019220 comp rx=0 tx=0).stop 2023-11-27T17:53:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.054+0000 7f0cfef42640 1 -- 172.21.15.81:0/4163778732 shutdown_connections 2023-11-27T17:53:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.054+0000 7f0cfef42640 1 --2- 172.21.15.81:0/4163778732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cf8148160 0x7f0cf81e55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.054+0000 7f0cfef42640 1 --2- 172.21.15.81:0/4163778732 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0cf80ba830 0x7f0cf8144710 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.054+0000 7f0cfef42640 1 --2- 172.21.15.81:0/4163778732 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0cf80b99b0 0x7f0cf8138530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.054+0000 7f0cfef42640 1 -- 172.21.15.81:0/4163778732 >> 172.21.15.81:0/4163778732 conn(0x7f0cf806e8a0 msgr2=0x7f0cf8132f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.054+0000 7f0cfef42640 1 -- 172.21.15.81:0/4163778732 shutdown_connections 2023-11-27T17:53:00.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.054+0000 7f0cfef42640 1 -- 172.21.15.81:0/4163778732 wait complete. 2023-11-27T17:53:00.072 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:00.070+0000 7fae4f41d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T17:53:00.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 399a48bb-57ca-4f1a-b64c-23abea9d7695 3 2023-11-27T17:53:00.152 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:00.150+0000 7fae4f41d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T17:53:00.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e7e3f9640 1 Processor -- start 2023-11-27T17:53:00.196 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e7e3f9640 1 -- start start 2023-11-27T17:53:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e7e3f9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1e780a42b0 0x7f1e780b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e7e3f9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e7814c7b0 0x7f1e780b5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e7e3f9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e780b4360 con 0x7f1e7806ef70 2023-11-27T17:53:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e7e3f9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7806e7a0 con 0x7f1e780a42b0 2023-11-27T17:53:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e7e3f9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e780b4d30 con 0x7f1e7814c7b0 2023-11-27T17:53:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e777fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1e7814c7b0 0x7f1e780b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e7c996640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1e7806ef70 0x7f1e78149290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49312/0 (socket says 172.21.15.81:49312) 2023-11-27T17:53:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e7c996640 1 -- 172.21.15.81:0/3330728032 learned_addr learned my addr 172.21.15.81:0/3330728032 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-27T17:53:00.197 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e77fff640 1 --2- 172.21.15.81:0/3330728032 >> v2:172.21.15.31:3300/0 conn(0x7f1e780a42b0 0x7f1e780b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e777fe640 1 -- 172.21.15.81:0/3330728032 >> v2:172.21.15.31:3300/0 conn(0x7f1e780a42b0 msgr2=0x7f1e780b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e777fe640 1 --2- 172.21.15.81:0/3330728032 >> v2:172.21.15.31:3300/0 conn(0x7f1e780a42b0 0x7f1e780b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e777fe640 1 -- 172.21.15.81:0/3330728032 >> v1:172.21.15.81:6789/0 conn(0x7f1e7806ef70 legacy=0x7f1e78149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.198 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.190+0000 7f1e777fe640 1 -- 172.21.15.81:0/3330728032 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e780b4030 con 0x7f1e7814c7b0 2023-11-27T17:53:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.194+0000 7f1e777fe640 1 --2- 172.21.15.81:0/3330728032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7814c7b0 0x7f1e780b5500 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1e7806b220 tx=0x7f1e6c01ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcd17a0005feb6fe server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.194+0000 7f1e76ffd640 1 -- 172.21.15.81:0/3330728032 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0a8950 con 0x7f1e7814c7b0 2023-11-27T17:53:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.194+0000 7f1e76ffd640 1 -- 172.21.15.81:0/3330728032 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c0a8ab0 con 0x7f1e7814c7b0 2023-11-27T17:53:00.199 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.194+0000 7f1e76ffd640 1 -- 172.21.15.81:0/3330728032 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0a8e40 con 0x7f1e7814c7b0 2023-11-27T17:53:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.194+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/3330728032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7814c7b0 msgr2=0x7f1e780b5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.194+0000 7f1e7e3f9640 1 --2- 172.21.15.81:0/3330728032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7814c7b0 0x7f1e780b5500 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1e7806b220 tx=0x7f1e6c01ec50 comp rx=0 tx=0).stop 2023-11-27T17:53:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.194+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/3330728032 shutdown_connections 2023-11-27T17:53:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.194+0000 7f1e7e3f9640 1 --2- 172.21.15.81:0/3330728032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e7814c7b0 0x7f1e780b5500 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.200 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.194+0000 7f1e7e3f9640 1 --2- 172.21.15.81:0/3330728032 >> v2:172.21.15.31:3300/0 conn(0x7f1e780a42b0 0x7f1e780b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.194+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/3330728032 >> 172.21.15.81:0/3330728032 conn(0x7f1e780bb7d0 msgr2=0x7f1e780bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.194+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/3330728032 shutdown_connections 2023-11-27T17:53:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.194+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/3330728032 wait complete. 2023-11-27T17:53:00.201 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7e3f9640 1 Processor -- start 2023-11-27T17:53:00.202 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7e3f9640 1 -- start start 2023-11-27T17:53:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7e3f9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7806ef70 0x7f1e781d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7e3f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e780a42b0 0x7f1e78149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7e3f9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e7814c7b0 0x7f1e781df190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7e3f9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e781497a0 con 0x7f1e7806ef70 2023-11-27T17:53:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7e3f9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e781d3200 con 0x7f1e780a42b0 2023-11-27T17:53:00.204 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7e3f9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e78149990 con 0x7f1e7814c7b0 2023-11-27T17:53:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7c996640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e7814c7b0 0x7f1e781df190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e780a42b0 0x7f1e78149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7c996640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e7814c7b0 0x7f1e781df190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:58204/0 (socket says 172.21.15.81:58204) 2023-11-27T17:53:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e780a42b0 0x7f1e78149260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33914/0 (socket says 172.21.15.81:33914) 2023-11-27T17:53:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7c996640 1 -- 172.21.15.81:0/970083643 learned_addr learned my addr 172.21.15.81:0/970083643 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-27T17:53:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e77fff640 1 --2- 172.21.15.81:0/970083643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7806ef70 0x7f1e781d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7c996640 1 -- 172.21.15.81:0/970083643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e780a42b0 msgr2=0x7f1e78149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7c996640 1 --2- 172.21.15.81:0/970083643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e780a42b0 0x7f1e78149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7c996640 1 -- 172.21.15.81:0/970083643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7806ef70 msgr2=0x7f1e781d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7c996640 1 --2- 172.21.15.81:0/970083643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7806ef70 0x7f1e781d2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.205 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7c996640 1 -- 172.21.15.81:0/970083643 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c009420 con 0x7f1e7814c7b0 2023-11-27T17:53:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e777fe640 1 --2- 172.21.15.81:0/970083643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e780a42b0 0x7f1e78149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e77fff640 1 --2- 172.21.15.81:0/970083643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7806ef70 0x7f1e781d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7c996640 1 --2- 172.21.15.81:0/970083643 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e7814c7b0 0x7f1e781df190 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000ca70 tx=0x7f1e7000cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e74ff9640 1 -- 172.21.15.81:0/970083643 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7000abd0 con 0x7f1e7814c7b0 2023-11-27T17:53:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e74ff9640 1 -- 172.21.15.81:0/970083643 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7000ad30 con 0x7f1e7814c7b0 2023-11-27T17:53:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/970083643 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e78149c70 con 0x7f1e7814c7b0 2023-11-27T17:53:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e74ff9640 1 -- 172.21.15.81:0/970083643 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70012600 con 0x7f1e7814c7b0 2023-11-27T17:53:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/970083643 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e781dec70 con 0x7f1e7814c7b0 2023-11-27T17:53:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e74ff9640 1 -- 172.21.15.81:0/970083643 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f1e70012760 con 0x7f1e7814c7b0 2023-11-27T17:53:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e74ff9640 1 -- 172.21.15.81:0/970083643 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f1e70007070 con 0x7f1e7814c7b0 2023-11-27T17:53:00.207 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:00.202+0000 7fae4f41d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T17:53:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.198+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/970083643 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7804e850 con 0x7f1e7814c7b0 2023-11-27T17:53:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.202+0000 7f1e74ff9640 1 -- 172.21.15.81:0/970083643 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f1e70021060 con 0x7f1e7814c7b0 2023-11-27T17:53:00.274 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.270+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/970083643 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "399a48bb-57ca-4f1a-b64c-23abea9d7695", "id": 3} v 0) v1 -- 0x7f1e780bb3c0 con 0x7f1e7814c7b0 2023-11-27T17:53:00.282 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.278+0000 7f1e74ff9640 1 -- 172.21.15.81:0/970083643 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "399a48bb-57ca-4f1a-b64c-23abea9d7695", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1e70017070 con 0x7f1e7814c7b0 2023-11-27T17:53:00.282 INFO:teuthology.orchestra.run.smithi081.stdout:3 2023-11-27T17:53:00.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.278+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/970083643 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e7814c7b0 msgr2=0x7f1e781df190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.283 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.278+0000 7f1e7e3f9640 1 --2- 172.21.15.81:0/970083643 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e7814c7b0 0x7f1e781df190 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000ca70 tx=0x7f1e7000cf30 comp rx=0 tx=0).stop 2023-11-27T17:53:00.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.278+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/970083643 shutdown_connections 2023-11-27T17:53:00.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.278+0000 7f1e7e3f9640 1 --2- 172.21.15.81:0/970083643 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1e7814c7b0 0x7f1e781df190 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.278+0000 7f1e7e3f9640 1 --2- 172.21.15.81:0/970083643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e780a42b0 0x7f1e78149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.278+0000 7f1e7e3f9640 1 --2- 172.21.15.81:0/970083643 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e7806ef70 0x7f1e781d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.278+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/970083643 >> 172.21.15.81:0/970083643 conn(0x7f1e780bb7d0 msgr2=0x7f1e780bcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:00.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.278+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/970083643 shutdown_connections 2023-11-27T17:53:00.284 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.278+0000 7f1e7e3f9640 1 -- 172.21.15.81:0/970083643 wait complete. 2023-11-27T17:53:00.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 598af3bc-e276-4309-9117-d294c77c3f32 4 2023-11-27T17:53:00.352 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:00.350+0000 7fae4f41d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T17:53:00.414 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:00.410+0000 7fae4f41d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T17:53:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa8d767640 1 Processor -- start 2023-11-27T17:53:00.415 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa8d767640 1 -- start start 2023-11-27T17:53:00.416 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa8d767640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffa8806b7d0 0x7ffa880b5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa8d767640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffa880b47c0 0x7ffa88143200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa8d767640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa88071d10 con 0x7ffa88143740 2023-11-27T17:53:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa8d767640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880722d0 con 0x7ffa8806b7d0 2023-11-27T17:53:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa8d767640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880b4d30 con 0x7ffa880b47c0 2023-11-27T17:53:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa867fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffa880b47c0 0x7ffa88143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa867fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffa880b47c0 0x7ffa88143200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33924/0 (socket says 172.21.15.81:33924) 2023-11-27T17:53:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa867fc640 1 -- 172.21.15.81:0/4097619081 learned_addr learned my addr 172.21.15.81:0/4097619081 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-27T17:53:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa86ffd640 1 --2- 172.21.15.81:0/4097619081 >> v2:172.21.15.31:3300/0 conn(0x7ffa8806b7d0 0x7ffa880b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa867fc640 1 -- 172.21.15.81:0/4097619081 >> v2:172.21.15.31:3300/0 conn(0x7ffa8806b7d0 msgr2=0x7ffa880b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:00.417 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa867fc640 1 --2- 172.21.15.81:0/4097619081 >> v2:172.21.15.31:3300/0 conn(0x7ffa8806b7d0 0x7ffa880b5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa867fc640 1 -- 172.21.15.81:0/4097619081 >> v1:172.21.15.31:6789/0 conn(0x7ffa88143740 legacy=0x7ffa880b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.410+0000 7ffa867fc640 1 -- 172.21.15.81:0/4097619081 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa88071f60 con 0x7ffa880b47c0 2023-11-27T17:53:00.418 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa867fc640 1 --2- 172.21.15.81:0/4097619081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa880b47c0 0x7ffa88143200 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffa8806f9b0 tx=0x7ffa7c01c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b7c8e4aaed2e71f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:00.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa85ffb640 1 -- 172.21.15.81:0/4097619081 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0ab600 con 0x7ffa880b47c0 2023-11-27T17:53:00.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa85ffb640 1 -- 172.21.15.81:0/4097619081 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c0a7050 con 0x7ffa880b47c0 2023-11-27T17:53:00.419 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa85ffb640 1 -- 172.21.15.81:0/4097619081 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0ab980 con 0x7ffa880b47c0 2023-11-27T17:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa8d767640 1 -- 172.21.15.81:0/4097619081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa880b47c0 msgr2=0x7ffa88143200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa8d767640 1 --2- 172.21.15.81:0/4097619081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa880b47c0 0x7ffa88143200 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffa8806f9b0 tx=0x7ffa7c01c500 comp rx=0 tx=0).stop 2023-11-27T17:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa8d767640 1 -- 172.21.15.81:0/4097619081 shutdown_connections 2023-11-27T17:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa8d767640 1 --2- 172.21.15.81:0/4097619081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa880b47c0 0x7ffa88143200 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa8d767640 1 --2- 172.21.15.81:0/4097619081 >> v2:172.21.15.31:3300/0 conn(0x7ffa8806b7d0 0x7ffa880b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa8d767640 1 -- 172.21.15.81:0/4097619081 >> 172.21.15.81:0/4097619081 conn(0x7ffa880b9dc0 msgr2=0x7ffa880ba1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa8d767640 1 -- 172.21.15.81:0/4097619081 shutdown_connections 2023-11-27T17:53:00.420 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa8d767640 1 -- 172.21.15.81:0/4097619081 wait complete. 2023-11-27T17:53:00.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa8d767640 1 Processor -- start 2023-11-27T17:53:00.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.414+0000 7ffa8d767640 1 -- start start 2023-11-27T17:53:00.422 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa8d767640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa8806b7d0 0x7ffa880bb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa8d767640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffa880b47c0 0x7ffa880bc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa8d767640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa88143740 0x7ffa88135090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa8d767640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880bb860 con 0x7ffa8806b7d0 2023-11-27T17:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa8d767640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8812f110 con 0x7ffa88143740 2023-11-27T17:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa8d767640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880bccb0 con 0x7ffa880b47c0 2023-11-27T17:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa867fc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffa880b47c0 0x7ffa880bc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa877fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa88143740 0x7ffa88135090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa867fc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffa880b47c0 0x7ffa880bc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:58212/0 (socket says 172.21.15.81:58212) 2023-11-27T17:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa867fc640 1 -- 172.21.15.81:0/4003461624 learned_addr learned my addr 172.21.15.81:0/4003461624 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-27T17:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa86ffd640 1 --2- 172.21.15.81:0/4003461624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa8806b7d0 0x7ffa880bb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.423 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa877fe640 1 -- 172.21.15.81:0/4003461624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffa880b47c0 msgr2=0x7ffa880bc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa877fe640 1 --2- 172.21.15.81:0/4003461624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffa880b47c0 0x7ffa880bc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa877fe640 1 -- 172.21.15.81:0/4003461624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa8806b7d0 msgr2=0x7ffa880bb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa877fe640 1 --2- 172.21.15.81:0/4003461624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa8806b7d0 0x7ffa880bb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa877fe640 1 -- 172.21.15.81:0/4003461624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c0094d0 con 0x7ffa88143740 2023-11-27T17:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa877fe640 1 --2- 172.21.15.81:0/4003461624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa88143740 0x7ffa88135090 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800c700 tx=0x7ffa7800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa6f7fe640 1 -- 172.21.15.81:0/4003461624 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78003b80 con 0x7ffa88143740 2023-11-27T17:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa6f7fe640 1 -- 172.21.15.81:0/4003461624 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa78003ce0 con 0x7ffa88143740 2023-11-27T17:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa8d767640 1 -- 172.21.15.81:0/4003461624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8812f380 con 0x7ffa88143740 2023-11-27T17:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa6f7fe640 1 -- 172.21.15.81:0/4003461624 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78005310 con 0x7ffa88143740 2023-11-27T17:53:00.424 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa8d767640 1 -- 172.21.15.81:0/4003461624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8812fbc0 con 0x7ffa88143740 2023-11-27T17:53:00.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa6f7fe640 1 -- 172.21.15.81:0/4003461624 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7ffa7800a640 con 0x7ffa88143740 2023-11-27T17:53:00.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa6f7fe640 1 -- 172.21.15.81:0/4003461624 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7ffa78012b60 con 0x7ffa88143740 2023-11-27T17:53:00.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.418+0000 7ffa8d767640 1 -- 172.21.15.81:0/4003461624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8812fdb0 con 0x7ffa88143740 2023-11-27T17:53:00.425 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.422+0000 7ffa6f7fe640 1 -- 172.21.15.81:0/4003461624 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7ffa78012e00 con 0x7ffa88143740 2023-11-27T17:53:00.502 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.498+0000 7ffa8d767640 1 -- 172.21.15.81:0/4003461624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "598af3bc-e276-4309-9117-d294c77c3f32", "id": 4} v 0) v1 -- 0x7ffa8804e850 con 0x7ffa88143740 2023-11-27T17:53:00.510 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.506+0000 7ffa6f7fe640 1 -- 172.21.15.81:0/4003461624 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "598af3bc-e276-4309-9117-d294c77c3f32", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffa78012650 con 0x7ffa88143740 2023-11-27T17:53:00.511 INFO:teuthology.orchestra.run.smithi081.stdout:4 2023-11-27T17:53:00.511 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.506+0000 7ffa8d767640 1 -- 172.21.15.81:0/4003461624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa88143740 msgr2=0x7ffa88135090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.506+0000 7ffa8d767640 1 --2- 172.21.15.81:0/4003461624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa88143740 0x7ffa88135090 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800c700 tx=0x7ffa7800cbc0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.506+0000 7ffa8d767640 1 -- 172.21.15.81:0/4003461624 shutdown_connections 2023-11-27T17:53:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.506+0000 7ffa8d767640 1 --2- 172.21.15.81:0/4003461624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa88143740 0x7ffa88135090 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.506+0000 7ffa8d767640 1 --2- 172.21.15.81:0/4003461624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffa880b47c0 0x7ffa880bc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.506+0000 7ffa8d767640 1 --2- 172.21.15.81:0/4003461624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa8806b7d0 0x7ffa880bb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.506+0000 7ffa8d767640 1 -- 172.21.15.81:0/4003461624 >> 172.21.15.81:0/4003461624 conn(0x7ffa880b9dc0 msgr2=0x7ffa88140290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.506+0000 7ffa8d767640 1 -- 172.21.15.81:0/4003461624 shutdown_connections 2023-11-27T17:53:00.512 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.506+0000 7ffa8d767640 1 -- 172.21.15.81:0/4003461624 wait complete. 2023-11-27T17:53:00.527 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb 5 2023-11-27T17:53:00.549 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:00.546+0000 7f88d941f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-27T17:53:00.605 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:00.598+0000 7f88d941f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-27T17:53:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.630+0000 7f6b87a56640 1 Processor -- start 2023-11-27T17:53:00.636 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.630+0000 7f6b87a56640 1 -- start start 2023-11-27T17:53:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b87a56640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b80141cc0 0x7f6b80147a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b87a56640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b80070e90 con 0x7f6b8006b7d0 2023-11-27T17:53:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b87a56640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b80071170 con 0x7f6b80070990 2023-11-27T17:53:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b87a56640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b80071450 con 0x7f6b80141cc0 2023-11-27T17:53:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b84ff1640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6b80070990 0x7f6b801415b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49314/0 (socket says 172.21.15.81:49314) 2023-11-27T17:53:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b84ff1640 1 -- 172.21.15.81:0/4202455737 learned_addr learned my addr 172.21.15.81:0/4202455737 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-27T17:53:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009886289 0 0) 0x7f6b80071170 con 0x7f6b80070990 2023-11-27T17:53:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b85ff3640 1 --2- 172.21.15.81:0/4202455737 >> v2:172.21.15.31:3300/0 conn(0x7f6b80141cc0 0x7f6b80147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b6c003530 con 0x7f6b80070990 2023-11-27T17:53:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 <== mon.1 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3179577482 0 0) 0x7f6b6c003530 con 0x7f6b80070990 2023-11-27T17:53:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 >> v2:172.21.15.31:3300/0 conn(0x7f6b80141cc0 msgr2=0x7f6b80147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 --2- 172.21.15.81:0/4202455737 >> v2:172.21.15.31:3300/0 conn(0x7f6b80141cc0 0x7f6b80147a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 >> v1:172.21.15.31:6789/0 conn(0x7f6b8006b7d0 legacy=0x7f6b8006fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8006bbb0 con 0x7f6b80070990 2023-11-27T17:53:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 <== mon.1 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f6b70001680 con 0x7f6b80070990 2023-11-27T17:53:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 >> v1:172.21.15.81:6789/0 conn(0x7f6b80070990 legacy=0x7f6b801415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 --2- 172.21.15.81:0/4202455737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b6c0039f0 0x7f6b6c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 --2- 172.21.15.81:0/4202455737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c0047d0 0x7f6b6c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 --2- 172.21.15.81:0/4202455737 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b6c005200 0x7f6b6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80071450 con 0x7f6b6c0039f0 2023-11-27T17:53:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c00c160 con 0x7f6b6c0047d0 2023-11-27T17:53:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c00c320 con 0x7f6b6c005200 2023-11-27T17:53:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b85ff3640 1 --2- 172.21.15.81:0/4202455737 >> v2:172.21.15.31:3300/0 conn(0x7f6b80141cc0 0x7f6b80147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:00.640 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b84ff1640 1 --2- 172.21.15.81:0/4202455737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c0047d0 0x7f6b6c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b85ff3640 1 --2- 172.21.15.81:0/4202455737 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b6c005200 0x7f6b6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b857f2640 1 --2- 172.21.15.81:0/4202455737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b6c0039f0 0x7f6b6c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b84ff1640 1 -- 172.21.15.81:0/4202455737 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b6c005200 msgr2=0x7f6b6c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b84ff1640 1 --2- 172.21.15.81:0/4202455737 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b6c005200 0x7f6b6c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b84ff1640 1 -- 172.21.15.81:0/4202455737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b6c0039f0 msgr2=0x7f6b6c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b84ff1640 1 --2- 172.21.15.81:0/4202455737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b6c0039f0 0x7f6b6c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b84ff1640 1 -- 172.21.15.81:0/4202455737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c003530 con 0x7f6b6c0047d0 2023-11-27T17:53:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b85ff3640 1 -- 172.21.15.81:0/4202455737 reap_dead start 2023-11-27T17:53:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b84ff1640 1 --2- 172.21.15.81:0/4202455737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c0047d0 0x7f6b6c004c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c240 tx=0x7f6b7001cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=279621a2449c4abb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70005ae0 con 0x7f6b6c0047d0 2023-11-27T17:53:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b70005c40 con 0x7f6b6c0047d0 2023-11-27T17:53:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.634+0000 7f6b77fff640 1 -- 172.21.15.81:0/4202455737 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700a5b00 con 0x7f6b6c0047d0 2023-11-27T17:53:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 -- 172.21.15.81:0/4202455737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c0047d0 msgr2=0x7f6b6c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 --2- 172.21.15.81:0/4202455737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c0047d0 0x7f6b6c004c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c240 tx=0x7f6b7001cbc0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 -- 172.21.15.81:0/4202455737 shutdown_connections 2023-11-27T17:53:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 --2- 172.21.15.81:0/4202455737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c0047d0 0x7f6b6c004c50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 -- 172.21.15.81:0/4202455737 >> 172.21.15.81:0/4202455737 conn(0x7f6b800b9dc0 msgr2=0x7f6b800ba1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 -- 172.21.15.81:0/4202455737 shutdown_connections 2023-11-27T17:53:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 -- 172.21.15.81:0/4202455737 wait complete. 2023-11-27T17:53:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 Processor -- start 2023-11-27T17:53:00.643 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 -- start start 2023-11-27T17:53:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b6c0047d0 0x7f6b8013aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801e4b70 0x7f6b801379d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b801e4ff0 0x7f6b80137f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.645 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80143810 con 0x7f6b801e4ff0 2023-11-27T17:53:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8013b0e0 con 0x7f6b801e4b70 2023-11-27T17:53:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b80138450 con 0x7f6b6c0047d0 2023-11-27T17:53:00.646 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b84ff1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801e4b70 0x7f6b801379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b857f2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b6c0047d0 0x7f6b8013aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b84ff1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801e4b70 0x7f6b801379d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33960/0 (socket says 172.21.15.81:33960) 2023-11-27T17:53:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b84ff1640 1 -- 172.21.15.81:0/4079005291 learned_addr learned my addr 172.21.15.81:0/4079005291 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-27T17:53:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b85ff3640 1 --2- 172.21.15.81:0/4079005291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b801e4ff0 0x7f6b80137f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b84ff1640 1 -- 172.21.15.81:0/4079005291 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b6c0047d0 msgr2=0x7f6b8013aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b84ff1640 1 --2- 172.21.15.81:0/4079005291 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b6c0047d0 0x7f6b8013aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b84ff1640 1 -- 172.21.15.81:0/4079005291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b801e4ff0 msgr2=0x7f6b80137f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b84ff1640 1 --2- 172.21.15.81:0/4079005291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b801e4ff0 0x7f6b80137f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b84ff1640 1 -- 172.21.15.81:0/4079005291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b80142ee0 con 0x7f6b801e4b70 2023-11-27T17:53:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b857f2640 1 --2- 172.21.15.81:0/4079005291 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b6c0047d0 0x7f6b8013aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b85ff3640 1 --2- 172.21.15.81:0/4079005291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b801e4ff0 0x7f6b80137f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:00.647 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b84ff1640 1 --2- 172.21.15.81:0/4079005291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801e4b70 0x7f6b801379d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6b7001c9f0 tx=0x7f6b6c005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b75ffb640 1 -- 172.21.15.81:0/4079005291 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700b4070 con 0x7f6b801e4b70 2023-11-27T17:53:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b75ffb640 1 -- 172.21.15.81:0/4079005291 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b700a5ad0 con 0x7f6b801e4b70 2023-11-27T17:53:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b75ffb640 1 -- 172.21.15.81:0/4079005291 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700a5e60 con 0x7f6b801e4b70 2023-11-27T17:53:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 -- 172.21.15.81:0/4079005291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b80143150 con 0x7f6b801e4b70 2023-11-27T17:53:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 -- 172.21.15.81:0/4079005291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b80146340 con 0x7f6b801e4b70 2023-11-27T17:53:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b75ffb640 1 -- 172.21.15.81:0/4079005291 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f6b70007070 con 0x7f6b801e4b70 2023-11-27T17:53:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b75ffb640 1 -- 172.21.15.81:0/4079005291 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f6b700ae460 con 0x7f6b801e4b70 2023-11-27T17:53:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.638+0000 7f6b87a56640 1 -- 172.21.15.81:0/4079005291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b80143950 con 0x7f6b801e4b70 2023-11-27T17:53:00.648 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.642+0000 7f6b75ffb640 1 -- 172.21.15.81:0/4079005291 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f6b80143950 con 0x7f6b801e4b70 2023-11-27T17:53:00.660 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:00.654+0000 7f88d941f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-27T17:53:00.715 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.710+0000 7f6b87a56640 1 -- 172.21.15.81:0/4079005291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb", "id": 5} v 0) v1 -- 0x7f6b8004e850 con 0x7f6b801e4b70 2023-11-27T17:53:00.722 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.718+0000 7f6b75ffb640 1 -- 172.21.15.81:0/4079005291 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b700c9020 con 0x7f6b801e4b70 2023-11-27T17:53:00.722 INFO:teuthology.orchestra.run.smithi081.stdout:5 2023-11-27T17:53:00.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.718+0000 7f6b87a56640 1 -- 172.21.15.81:0/4079005291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801e4b70 msgr2=0x7f6b801379d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.718+0000 7f6b87a56640 1 --2- 172.21.15.81:0/4079005291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801e4b70 0x7f6b801379d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6b7001c9f0 tx=0x7f6b6c005800 comp rx=0 tx=0).stop 2023-11-27T17:53:00.723 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.718+0000 7f6b87a56640 1 -- 172.21.15.81:0/4079005291 shutdown_connections 2023-11-27T17:53:00.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.718+0000 7f6b87a56640 1 --2- 172.21.15.81:0/4079005291 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b801e4ff0 0x7f6b80137f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.718+0000 7f6b87a56640 1 --2- 172.21.15.81:0/4079005291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b801e4b70 0x7f6b801379d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.718+0000 7f6b87a56640 1 --2- 172.21.15.81:0/4079005291 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b6c0047d0 0x7f6b8013aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.718+0000 7f6b87a56640 1 -- 172.21.15.81:0/4079005291 >> 172.21.15.81:0/4079005291 conn(0x7f6b800b9dc0 msgr2=0x7f6b800bb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:00.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.718+0000 7f6b87a56640 1 -- 172.21.15.81:0/4079005291 shutdown_connections 2023-11-27T17:53:00.724 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.718+0000 7f6b87a56640 1 -- 172.21.15.81:0/4079005291 wait complete. 2023-11-27T17:53:00.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c 6 2023-11-27T17:53:00.740 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:00.734+0000 7f88d941f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-27T17:53:00.794 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:00.790+0000 7f88d941f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-27T17:53:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.846+0000 7fa21500a640 1 Processor -- start 2023-11-27T17:53:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.846+0000 7fa21500a640 1 -- start start 2023-11-27T17:53:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.846+0000 7fa21500a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa210145650 0x7fa21006fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.846+0000 7fa21500a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa21014b6b0 0x7fa21014bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.846+0000 7fa21500a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21006bc80 con 0x7fa210070c90 2023-11-27T17:53:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.846+0000 7fa21500a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa210071bb0 con 0x7fa21014b6b0 2023-11-27T17:53:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.846+0000 7fa21500a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21014c060 con 0x7fa210145650 2023-11-27T17:53:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.846+0000 7fa20ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa210145650 0x7fa21006fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.846+0000 7fa20e59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa210070c90 0x7fa21006b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:49322/0 (socket says 172.21.15.81:49322) 2023-11-27T17:53:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.846+0000 7fa20ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa210145650 0x7fa21006fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33966/0 (socket says 172.21.15.81:33966) 2023-11-27T17:53:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.846+0000 7fa20e59c640 1 -- 172.21.15.81:0/2437219316 learned_addr learned my addr 172.21.15.81:0/2437219316 (peer_addr_for_me v1:172.21.15.81:0/0) 2023-11-27T17:53:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.846+0000 7fa20f59e640 1 --2- 172.21.15.81:0/2437219316 >> v2:172.21.15.31:3300/0 conn(0x7fa21014b6b0 0x7fa21014bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa20ed9d640 1 -- 172.21.15.81:0/2437219316 >> v2:172.21.15.31:3300/0 conn(0x7fa21014b6b0 msgr2=0x7fa21014bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa20ed9d640 1 --2- 172.21.15.81:0/2437219316 >> v2:172.21.15.31:3300/0 conn(0x7fa21014b6b0 0x7fa21014bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa20ed9d640 1 -- 172.21.15.81:0/2437219316 >> v1:172.21.15.81:6789/0 conn(0x7fa210070c90 legacy=0x7fa21006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa20ed9d640 1 -- 172.21.15.81:0/2437219316 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa210145a30 con 0x7fa210145650 2023-11-27T17:53:00.855 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa20dd9b640 1 -- 172.21.15.81:0/2437219316 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476034082 0 0) 0x7fa21006bc80 con 0x7fa210070c90 2023-11-27T17:53:00.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa20ed9d640 1 --2- 172.21.15.81:0/2437219316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa210145650 0x7fa21006fa70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa210066660 tx=0x7fa1f801c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cd8aeee1828b6d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:00.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa20dd9b640 1 -- 172.21.15.81:0/2437219316 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80ac630 con 0x7fa210145650 2023-11-27T17:53:00.856 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa20dd9b640 1 -- 172.21.15.81:0/2437219316 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f80ac790 con 0x7fa210145650 2023-11-27T17:53:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa20dd9b640 1 -- 172.21.15.81:0/2437219316 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80acb20 con 0x7fa210145650 2023-11-27T17:53:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa21500a640 1 -- 172.21.15.81:0/2437219316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa210145650 msgr2=0x7fa21006fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa21500a640 1 --2- 172.21.15.81:0/2437219316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa210145650 0x7fa21006fa70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa210066660 tx=0x7fa1f801c3d0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa21500a640 1 -- 172.21.15.81:0/2437219316 shutdown_connections 2023-11-27T17:53:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa21500a640 1 --2- 172.21.15.81:0/2437219316 >> v2:172.21.15.31:3300/0 conn(0x7fa21014b6b0 0x7fa21014bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa21500a640 1 --2- 172.21.15.81:0/2437219316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa210145650 0x7fa21006fa70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa21500a640 1 -- 172.21.15.81:0/2437219316 >> 172.21.15.81:0/2437219316 conn(0x7fa2100b9dc0 msgr2=0x7fa2100ba1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa21500a640 1 -- 172.21.15.81:0/2437219316 shutdown_connections 2023-11-27T17:53:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa21500a640 1 -- 172.21.15.81:0/2437219316 wait complete. 2023-11-27T17:53:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.850+0000 7fa21500a640 1 Processor -- start 2023-11-27T17:53:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa21500a640 1 -- start start 2023-11-27T17:53:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa21500a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa210070c90 0x7fa210147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa21500a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa210145650 0x7fa21013f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa21500a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa21014b6b0 0x7fa21013f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:00.860 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa21500a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa210147cd0 con 0x7fa210070c90 2023-11-27T17:53:00.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa21500a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21014c940 con 0x7fa21014b6b0 2023-11-27T17:53:00.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa21500a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2100b7410 con 0x7fa210145650 2023-11-27T17:53:00.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20e59c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa210145650 0x7fa21013f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa21014b6b0 0x7fa21013f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20e59c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa210145650 0x7fa21013f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:58226/0 (socket says 172.21.15.81:58226) 2023-11-27T17:53:00.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20e59c640 1 -- 172.21.15.81:0/2179540980 learned_addr learned my addr 172.21.15.81:0/2179540980 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-27T17:53:00.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa21014b6b0 0x7fa21013f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33968/0 (socket says 172.21.15.81:33968) 2023-11-27T17:53:00.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20ed9d640 1 --2- 172.21.15.81:0/2179540980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa210070c90 0x7fa210147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:00.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20e59c640 1 -- 172.21.15.81:0/2179540980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa21014b6b0 msgr2=0x7fa21013f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.861 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20e59c640 1 --2- 172.21.15.81:0/2179540980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa21014b6b0 0x7fa21013f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20e59c640 1 -- 172.21.15.81:0/2179540980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa210070c90 msgr2=0x7fa210147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20e59c640 1 --2- 172.21.15.81:0/2179540980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa210070c90 0x7fa210147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20e59c640 1 -- 172.21.15.81:0/2179540980 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8009420 con 0x7fa210145650 2023-11-27T17:53:00.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20ed9d640 1 --2- 172.21.15.81:0/2179540980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa210070c90 0x7fa210147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:00.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa20e59c640 1 --2- 172.21.15.81:0/2179540980 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa210145650 0x7fa21013f040 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c520 tx=0x7fa20000c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:00.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa2077fe640 1 -- 172.21.15.81:0/2179540980 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2000074e0 con 0x7fa210145650 2023-11-27T17:53:00.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa2077fe640 1 -- 172.21.15.81:0/2179540980 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa200007640 con 0x7fa210145650 2023-11-27T17:53:00.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa21500a640 1 -- 172.21.15.81:0/2179540980 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2101e3a50 con 0x7fa210145650 2023-11-27T17:53:00.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa2077fe640 1 -- 172.21.15.81:0/2179540980 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2000049f0 con 0x7fa210145650 2023-11-27T17:53:00.862 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa21500a640 1 -- 172.21.15.81:0/2179540980 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2101e4010 con 0x7fa210145650 2023-11-27T17:53:00.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa2077fe640 1 -- 172.21.15.81:0/2179540980 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fa20001d440 con 0x7fa210145650 2023-11-27T17:53:00.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa2077fe640 1 -- 172.21.15.81:0/2179540980 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa200012db0 con 0x7fa210145650 2023-11-27T17:53:00.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.854+0000 7fa21500a640 1 -- 172.21.15.81:0/2179540980 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21004e850 con 0x7fa210145650 2023-11-27T17:53:00.863 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.858+0000 7fa2077fe640 1 -- 172.21.15.81:0/2179540980 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fa200018070 con 0x7fa210145650 2023-11-27T17:53:00.875 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:00.870+0000 7f88d941f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-27T17:53:00.927 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:00.922+0000 7f88d941f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-27T17:53:00.928 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.922+0000 7fa21500a640 1 -- 172.21.15.81:0/2179540980 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd new", "uuid": "64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c", "id": 6} v 0) v1 -- 0x7fa2100b7790 con 0x7fa210145650 2023-11-27T17:53:00.936 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.930+0000 7fa2077fe640 1 -- 172.21.15.81:0/2179540980 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa2000127c0 con 0x7fa210145650 2023-11-27T17:53:00.936 INFO:teuthology.orchestra.run.smithi081.stdout:6 2023-11-27T17:53:00.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.934+0000 7fa21500a640 1 -- 172.21.15.81:0/2179540980 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa210145650 msgr2=0x7fa21013f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:00.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.934+0000 7fa21500a640 1 --2- 172.21.15.81:0/2179540980 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa210145650 0x7fa21013f040 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa20000c520 tx=0x7fa20000c9e0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.934+0000 7fa21500a640 1 -- 172.21.15.81:0/2179540980 shutdown_connections 2023-11-27T17:53:00.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.934+0000 7fa21500a640 1 --2- 172.21.15.81:0/2179540980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa21014b6b0 0x7fa21013f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.934+0000 7fa21500a640 1 --2- 172.21.15.81:0/2179540980 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa210145650 0x7fa21013f040 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.934+0000 7fa21500a640 1 --2- 172.21.15.81:0/2179540980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa210070c90 0x7fa210147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:00.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.934+0000 7fa21500a640 1 -- 172.21.15.81:0/2179540980 >> 172.21.15.81:0/2179540980 conn(0x7fa2100b9dc0 msgr2=0x7fa2100bba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:00.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.934+0000 7fa21500a640 1 -- 172.21.15.81:0/2179540980 shutdown_connections 2023-11-27T17:53:00.938 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:00.934+0000 7fa21500a640 1 -- 172.21.15.81:0/2179540980 wait complete. 2023-11-27T17:53:00.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd new 8a325db0-aedb-4f23-904a-e2c8ee9b9698 7 2023-11-27T17:53:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.050+0000 7fe650680640 1 Processor -- start 2023-11-27T17:53:01.056 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.050+0000 7fe650680640 1 -- start start 2023-11-27T17:53:01.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.050+0000 7fe650680640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6480a42b0 0x7fe6480b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.050+0000 7fe650680640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe64806ef70 0x7fe648153b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.057 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.050+0000 7fe650680640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6480b4360 con 0x7fe64814c7b0 2023-11-27T17:53:01.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.050+0000 7fe650680640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64806e7a0 con 0x7fe64806ef70 2023-11-27T17:53:01.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.050+0000 7fe650680640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6480b5c10 con 0x7fe6480a42b0 2023-11-27T17:53:01.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.050+0000 7fe64e41c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6480a42b0 0x7fe6480b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.050+0000 7fe64e41c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6480a42b0 0x7fe6480b47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:58020/0 (socket says 172.21.15.81:58020) 2023-11-27T17:53:01.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.050+0000 7fe64e41c640 1 -- 172.21.15.81:0/177951195 learned_addr learned my addr 172.21.15.81:0/177951195 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-27T17:53:01.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe64e41c640 1 -- 172.21.15.81:0/177951195 >> v2:172.21.15.31:3300/0 conn(0x7fe64806ef70 msgr2=0x7fe648153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:01.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe64ec1d640 1 --2- 172.21.15.81:0/177951195 >> v2:172.21.15.31:3300/0 conn(0x7fe64806ef70 0x7fe648153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe64e41c640 1 --2- 172.21.15.81:0/177951195 >> v2:172.21.15.31:3300/0 conn(0x7fe64806ef70 0x7fe648153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe64e41c640 1 -- 172.21.15.81:0/177951195 >> v1:172.21.15.31:6789/0 conn(0x7fe64814c7b0 legacy=0x7fe6480b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:01.058 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe64e41c640 1 -- 172.21.15.81:0/177951195 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6480b4d30 con 0x7fe6480a42b0 2023-11-27T17:53:01.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe64e41c640 1 --2- 172.21.15.81:0/177951195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6480a42b0 0x7fe6480b47f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe644009870 tx=0x7fe64401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=701c8bd503d025d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:01.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe64d41a640 1 -- 172.21.15.81:0/177951195 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440a89b0 con 0x7fe6480a42b0 2023-11-27T17:53:01.059 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe64d41a640 1 -- 172.21.15.81:0/177951195 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6440a8b10 con 0x7fe6480a42b0 2023-11-27T17:53:01.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe64d41a640 1 -- 172.21.15.81:0/177951195 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440a8ea0 con 0x7fe6480a42b0 2023-11-27T17:53:01.060 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe650680640 1 -- 172.21.15.81:0/177951195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6480a42b0 msgr2=0x7fe6480b47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe650680640 1 --2- 172.21.15.81:0/177951195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6480a42b0 0x7fe6480b47f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe644009870 tx=0x7fe64401ecf0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe650680640 1 -- 172.21.15.81:0/177951195 shutdown_connections 2023-11-27T17:53:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe650680640 1 --2- 172.21.15.81:0/177951195 >> v2:172.21.15.31:3300/0 conn(0x7fe64806ef70 0x7fe648153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe650680640 1 --2- 172.21.15.81:0/177951195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe6480a42b0 0x7fe6480b47f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe650680640 1 -- 172.21.15.81:0/177951195 >> 172.21.15.81:0/177951195 conn(0x7fe6480bb7d0 msgr2=0x7fe6480bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe650680640 1 -- 172.21.15.81:0/177951195 shutdown_connections 2023-11-27T17:53:01.061 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.054+0000 7fe650680640 1 -- 172.21.15.81:0/177951195 wait complete. 2023-11-27T17:53:01.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe650680640 1 Processor -- start 2023-11-27T17:53:01.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe650680640 1 -- start start 2023-11-27T17:53:01.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe650680640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe64806ef70 0x7fe6481e2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe650680640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6480a42b0 0x7fe6481d5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe650680640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe64814c7b0 0x7fe6481d3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe650680640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6481e27d0 con 0x7fe6480a42b0 2023-11-27T17:53:01.064 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe650680640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6480b8910 con 0x7fe64806ef70 2023-11-27T17:53:01.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe650680640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6480b8b20 con 0x7fe64814c7b0 2023-11-27T17:53:01.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64e41c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe64806ef70 0x7fe6481e2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64ec1d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe64814c7b0 0x7fe6481d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64e41c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe64806ef70 0x7fe6481e2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59672/0 (socket says 172.21.15.81:59672) 2023-11-27T17:53:01.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64ec1d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe64814c7b0 0x7fe6481d3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.81:58036/0 (socket says 172.21.15.81:58036) 2023-11-27T17:53:01.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64e41c640 1 -- 172.21.15.81:0/3267945143 learned_addr learned my addr 172.21.15.81:0/3267945143 (peer_addr_for_me v2:172.21.15.81:0/0) 2023-11-27T17:53:01.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64dc1b640 1 --2- 172.21.15.81:0/3267945143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6480a42b0 0x7fe6481d5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.065 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64e41c640 1 -- 172.21.15.81:0/3267945143 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe64814c7b0 msgr2=0x7fe6481d3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:01.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64e41c640 1 --2- 172.21.15.81:0/3267945143 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe64814c7b0 0x7fe6481d3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64e41c640 1 -- 172.21.15.81:0/3267945143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6480a42b0 msgr2=0x7fe6481d5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:01.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64e41c640 1 --2- 172.21.15.81:0/3267945143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6480a42b0 0x7fe6481d5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64e41c640 1 -- 172.21.15.81:0/3267945143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6440094d0 con 0x7fe64806ef70 2023-11-27T17:53:01.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64ec1d640 1 --2- 172.21.15.81:0/3267945143 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe64814c7b0 0x7fe6481d3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:01.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe64e41c640 1 --2- 172.21.15.81:0/3267945143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe64806ef70 0x7fe6481e2290 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe6440b3040 tx=0x7fe64401ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:01.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe63effd640 1 -- 172.21.15.81:0/3267945143 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440b0e40 con 0x7fe64806ef70 2023-11-27T17:53:01.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe63effd640 1 -- 172.21.15.81:0/3267945143 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6440bb470 con 0x7fe64806ef70 2023-11-27T17:53:01.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe63effd640 1 -- 172.21.15.81:0/3267945143 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440bb820 con 0x7fe64806ef70 2023-11-27T17:53:01.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe650680640 1 -- 172.21.15.81:0/3267945143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6481d61c0 con 0x7fe64806ef70 2023-11-27T17:53:01.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe650680640 1 -- 172.21.15.81:0/3267945143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6480b74a0 con 0x7fe64806ef70 2023-11-27T17:53:01.066 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe63effd640 1 -- 172.21.15.81:0/3267945143 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fe6440b7070 con 0x7fe64806ef70 2023-11-27T17:53:01.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe63effd640 1 -- 172.21.15.81:0/3267945143 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fe6440b9a80 con 0x7fe64806ef70 2023-11-27T17:53:01.067 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.058+0000 7fe650680640 1 -- 172.21.15.81:0/3267945143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe648149ea0 con 0x7fe64806ef70 2023-11-27T17:53:01.067 INFO:tasks.ceph.mgr.y.smithi031.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-27T17:53:01.067 INFO:tasks.ceph.mgr.y.smithi031.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-27T17:53:01.067 INFO:tasks.ceph.mgr.y.smithi031.stderr: from numpy import show_config as show_numpy_config 2023-11-27T17:53:01.068 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.062+0000 7fe63effd640 1 -- 172.21.15.81:0/3267945143 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fe648149ea0 con 0x7fe64806ef70 2023-11-27T17:53:01.075 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:01.070+0000 7f88d941f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-27T17:53:01.120 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:01.118+0000 7fae4f41d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T17:53:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.130+0000 7fe650680640 1 -- 172.21.15.81:0/3267945143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8a325db0-aedb-4f23-904a-e2c8ee9b9698", "id": 7} v 0) v1 -- 0x7fe64804e850 con 0x7fe64806ef70 2023-11-27T17:53:01.135 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:01.130+0000 7f88d941f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-27T17:53:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.138+0000 7fe63effd640 1 -- 172.21.15.81:0/3267945143 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8a325db0-aedb-4f23-904a-e2c8ee9b9698", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe6481d61c0 con 0x7fe64806ef70 2023-11-27T17:53:01.141 INFO:teuthology.orchestra.run.smithi081.stdout:7 2023-11-27T17:53:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.138+0000 7fe650680640 1 -- 172.21.15.81:0/3267945143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe64806ef70 msgr2=0x7fe6481e2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.138+0000 7fe650680640 1 --2- 172.21.15.81:0/3267945143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe64806ef70 0x7fe6481e2290 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe6440b3040 tx=0x7fe64401ba90 comp rx=0 tx=0).stop 2023-11-27T17:53:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.138+0000 7fe650680640 1 -- 172.21.15.81:0/3267945143 shutdown_connections 2023-11-27T17:53:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.138+0000 7fe650680640 1 --2- 172.21.15.81:0/3267945143 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe64814c7b0 0x7fe6481d3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.138+0000 7fe650680640 1 --2- 172.21.15.81:0/3267945143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe6480a42b0 0x7fe6481d5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.138+0000 7fe650680640 1 --2- 172.21.15.81:0/3267945143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe64806ef70 0x7fe6481e2290 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.138+0000 7fe650680640 1 -- 172.21.15.81:0/3267945143 >> 172.21.15.81:0/3267945143 conn(0x7fe6480bb7d0 msgr2=0x7fe648071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.138+0000 7fe650680640 1 -- 172.21.15.81:0/3267945143 shutdown_connections 2023-11-27T17:53:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2023-11-27T17:53:01.138+0000 7fe650680640 1 -- 172.21.15.81:0/3267945143 wait complete. 2023-11-27T17:53:01.157 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-27T17:53:01.157 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-27T17:53:01.160 INFO:tasks.ceph.osd.0:Started 2023-11-27T17:53:01.160 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-27T17:53:01.160 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-27T17:53:01.162 INFO:tasks.ceph.osd.1:Started 2023-11-27T17:53:01.162 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-27T17:53:01.163 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-27T17:53:01.165 INFO:tasks.ceph.osd.2:Started 2023-11-27T17:53:01.165 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-27T17:53:01.165 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-27T17:53:01.167 INFO:tasks.ceph.osd.3:Started 2023-11-27T17:53:01.167 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-27T17:53:01.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-27T17:53:01.170 INFO:tasks.ceph.osd.4:Started 2023-11-27T17:53:01.171 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-27T17:53:01.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-27T17:53:01.173 INFO:tasks.ceph.osd.5:Started 2023-11-27T17:53:01.173 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-27T17:53:01.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-27T17:53:01.176 INFO:tasks.ceph.osd.6:Started 2023-11-27T17:53:01.176 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-27T17:53:01.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-27T17:53:01.179 INFO:tasks.ceph.osd.7:Started 2023-11-27T17:53:01.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:01.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03ff7b2640 1 Processor -- start 2023-11-27T17:53:01.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03ff7b2640 1 -- start start 2023-11-27T17:53:01.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03ff7b2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f03f80bab00 0x7f03f80b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03ff7b2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f81491c0 0x7f03f8149630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03ff7b2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f80b6670 con 0x7f03f80baee0 2023-11-27T17:53:01.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03ff7b2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f80b6cf0 con 0x7f03f80bab00 2023-11-27T17:53:01.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03ff7b2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f80b9570 con 0x7f03f81491c0 2023-11-27T17:53:01.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03fcd4d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f03f80baee0 0x7f03f81430b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47746/0 (socket says 172.21.15.31:47746) 2023-11-27T17:53:01.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03fcd4d640 1 -- 172.21.15.31:0/1896268979 learned_addr learned my addr 172.21.15.31:0/1896268979 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:01.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03fdd4f640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f81491c0 0x7f03f8149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03fd54e640 1 --2- 172.21.15.31:0/1896268979 >> v2:172.21.15.81:3300/0 conn(0x7f03f80bab00 0x7f03f80b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208525908 0 0) 0x7f03f80b6670 con 0x7f03f80baee0 2023-11-27T17:53:01.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03e4003530 con 0x7f03f80baee0 2023-11-27T17:53:01.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3156162422 0 0) 0x7f03e4003530 con 0x7f03f80baee0 2023-11-27T17:53:01.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f81491c0 msgr2=0x7f03f8149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:01.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f81491c0 0x7f03f8149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 >> v2:172.21.15.81:3300/0 conn(0x7f03f80bab00 msgr2=0x7f03f80b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:01.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 --2- 172.21.15.31:0/1896268979 >> v2:172.21.15.81:3300/0 conn(0x7f03f80bab00 0x7f03f80b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f80b9e10 con 0x7f03f80baee0 2023-11-27T17:53:01.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f03e8001680 con 0x7f03f80baee0 2023-11-27T17:53:01.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 >> v1:172.21.15.31:6789/0 conn(0x7f03f80baee0 legacy=0x7f03f81430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:01.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03e40039f0 0x7f03e4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03e40047d0 0x7f03e4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f81491c0 0x7f03e4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f80b6cf0 con 0x7f03e40039f0 2023-11-27T17:53:01.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f80b9570 con 0x7f03e40047d0 2023-11-27T17:53:01.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e400b990 con 0x7f03f81491c0 2023-11-27T17:53:01.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03fd54e640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03e40039f0 0x7f03e4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03fcd4d640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03e40047d0 0x7f03e4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.330+0000 7f03fdd4f640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f81491c0 0x7f03e4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03fd54e640 1 -- 172.21.15.31:0/1896268979 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f81491c0 msgr2=0x7f03e4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:01.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03fd54e640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f81491c0 0x7f03e4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03fd54e640 1 -- 172.21.15.31:0/1896268979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03e40047d0 msgr2=0x7f03e4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:01.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03fd54e640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03e40047d0 0x7f03e4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03fd54e640 1 -- 172.21.15.31:0/1896268979 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e4003530 con 0x7f03e40039f0 2023-11-27T17:53:01.338 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03fcd4d640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03e40047d0 0x7f03e4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:01.339 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:01.334+0000 7fae4f41d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T17:53:01.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03fd54e640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03e40039f0 0x7f03e4003e10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009b10 tx=0x7f03f401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def98b65a67af2b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:01.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f40a5550 con 0x7f03e40039f0 2023-11-27T17:53:01.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f40a56b0 con 0x7f03e40039f0 2023-11-27T17:53:01.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03effff640 1 -- 172.21.15.31:0/1896268979 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f40a5a60 con 0x7f03e40039f0 2023-11-27T17:53:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03ff7b2640 1 -- 172.21.15.31:0/1896268979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03e40039f0 msgr2=0x7f03e4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03ff7b2640 1 --2- 172.21.15.31:0/1896268979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03e40039f0 0x7f03e4003e10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009b10 tx=0x7f03f401ca60 comp rx=0 tx=0).stop 2023-11-27T17:53:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03fdd4f640 1 -- 172.21.15.31:0/1896268979 reap_dead start 2023-11-27T17:53:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03ff7b2640 1 -- 172.21.15.31:0/1896268979 shutdown_connections 2023-11-27T17:53:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03ff7b2640 1 -- 172.21.15.31:0/1896268979 >> 172.21.15.31:0/1896268979 conn(0x7f03f80beb70 msgr2=0x7f03f80bef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03ff7b2640 1 -- 172.21.15.31:0/1896268979 shutdown_connections 2023-11-27T17:53:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.334+0000 7f03ff7b2640 1 -- 172.21.15.31:0/1896268979 wait complete. 2023-11-27T17:53:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03ff7b2640 1 Processor -- start 2023-11-27T17:53:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03ff7b2640 1 -- start start 2023-11-27T17:53:01.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03ff7b2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03e40039f0 0x7f03f81e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03ff7b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f8133fa0 0x7f03f8131bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03ff7b2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f8134400 0x7f03f8132110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03ff7b2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f8132650 con 0x7f03e40039f0 2023-11-27T17:53:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03ff7b2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f806c1d0 con 0x7f03f8133fa0 2023-11-27T17:53:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03ff7b2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f806c440 con 0x7f03f8134400 2023-11-27T17:53:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03fd54e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03e40039f0 0x7f03f81e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03fd54e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03e40039f0 0x7f03f81e7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44798/0 (socket says 172.21.15.31:44798) 2023-11-27T17:53:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03fd54e640 1 -- 172.21.15.31:0/718399970 learned_addr learned my addr 172.21.15.31:0/718399970 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03fcd4d640 1 --2- 172.21.15.31:0/718399970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f8133fa0 0x7f03f8131bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03fdd4f640 1 --2- 172.21.15.31:0/718399970 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f8134400 0x7f03f8132110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:01.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03fd54e640 1 -- 172.21.15.31:0/718399970 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f8134400 msgr2=0x7f03f8132110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:01.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03fd54e640 1 --2- 172.21.15.31:0/718399970 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f8134400 0x7f03f8132110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03fd54e640 1 -- 172.21.15.31:0/718399970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f8133fa0 msgr2=0x7f03f8131bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:01.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03fd54e640 1 --2- 172.21.15.31:0/718399970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f8133fa0 0x7f03f8131bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03fd54e640 1 -- 172.21.15.31:0/718399970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f80be2c0 con 0x7f03e40039f0 2023-11-27T17:53:01.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03fd54e640 1 --2- 172.21.15.31:0/718399970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03e40039f0 0x7f03f81e7a70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03f40b0040 tx=0x7f03e4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:01.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03edffb640 1 -- 172.21.15.31:0/718399970 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f40a5dc0 con 0x7f03e40039f0 2023-11-27T17:53:01.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03edffb640 1 -- 172.21.15.31:0/718399970 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f4004020 con 0x7f03e40039f0 2023-11-27T17:53:01.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03ff7b2640 1 -- 172.21.15.31:0/718399970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f80be5a0 con 0x7f03e40039f0 2023-11-27T17:53:01.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03edffb640 1 -- 172.21.15.31:0/718399970 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f40043d0 con 0x7f03e40039f0 2023-11-27T17:53:01.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03ff7b2640 1 -- 172.21.15.31:0/718399970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f806cf20 con 0x7f03e40039f0 2023-11-27T17:53:01.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03edffb640 1 -- 172.21.15.31:0/718399970 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f03f40b4040 con 0x7f03e40039f0 2023-11-27T17:53:01.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03edffb640 1 -- 172.21.15.31:0/718399970 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f03f4006020 con 0x7f03e40039f0 2023-11-27T17:53:01.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.338+0000 7f03ff7b2640 1 -- 172.21.15.31:0/718399970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f80b68b0 con 0x7f03e40039f0 2023-11-27T17:53:01.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.342+0000 7f03edffb640 1 -- 172.21.15.31:0/718399970 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7f03f40be020 con 0x7f03e40039f0 2023-11-27T17:53:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.410+0000 7f03ff7b2640 1 -- 172.21.15.31:0/718399970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03f804e850 con 0x7f03e40039f0 2023-11-27T17:53:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.410+0000 7f03edffb640 1 -- 172.21.15.31:0/718399970 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f03f40b2070 con 0x7f03e40039f0 2023-11-27T17:53:01.414 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:01.414 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:01.135708+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.414+0000 7f03ff7b2640 1 -- 172.21.15.31:0/718399970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03e40039f0 msgr2=0x7f03f81e7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.414+0000 7f03ff7b2640 1 --2- 172.21.15.31:0/718399970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03e40039f0 0x7f03f81e7a70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f03f40b0040 tx=0x7f03e4005800 comp rx=0 tx=0).stop 2023-11-27T17:53:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.414+0000 7f03ff7b2640 1 -- 172.21.15.31:0/718399970 shutdown_connections 2023-11-27T17:53:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.414+0000 7f03ff7b2640 1 --2- 172.21.15.31:0/718399970 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f03f8134400 0x7f03f8132110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.414+0000 7f03ff7b2640 1 --2- 172.21.15.31:0/718399970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f8133fa0 0x7f03f8131bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.414+0000 7f03ff7b2640 1 --2- 172.21.15.31:0/718399970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03e40039f0 0x7f03f81e7a70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.414+0000 7f03ff7b2640 1 -- 172.21.15.31:0/718399970 >> 172.21.15.31:0/718399970 conn(0x7f03f80beb70 msgr2=0x7f03f8141160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.414+0000 7f03ff7b2640 1 -- 172.21.15.31:0/718399970 shutdown_connections 2023-11-27T17:53:01.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:01.414+0000 7f03ff7b2640 1 -- 172.21.15.31:0/718399970 wait complete. 2023-11-27T17:53:01.432 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-27T17:53:01.433 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-27T17:53:01.524 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:01.522+0000 7fae4f41d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T17:53:01.594 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:01.590+0000 7fae4f41d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T17:53:01.731 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:01.726+0000 7fae4f41d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T17:53:01.750 INFO:tasks.ceph.mgr.x.smithi081.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-27T17:53:01.750 INFO:tasks.ceph.mgr.x.smithi081.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-27T17:53:01.750 INFO:tasks.ceph.mgr.x.smithi081.stderr: from numpy import show_config as show_numpy_config 2023-11-27T17:53:01.774 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-11-27T17:53:01.770+0000 7f7f83714640 -1 Falling back to public interface 2023-11-27T17:53:01.790 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-11-27T17:53:01.786+0000 7fbfaa74d640 -1 Falling back to public interface 2023-11-27T17:53:01.801 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-11-27T17:53:01.798+0000 7efc13b65640 -1 Falling back to public interface 2023-11-27T17:53:01.802 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-11-27T17:53:01.798+0000 7f62e1a90640 -1 Falling back to public interface 2023-11-27T17:53:01.802 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-11-27T17:53:01.798+0000 7f38e2331640 -1 Falling back to public interface 2023-11-27T17:53:01.808 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:01.802+0000 7f88d941f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-27T17:53:01.810 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-11-27T17:53:01.806+0000 7f22c5bd3640 -1 Falling back to public interface 2023-11-27T17:53:01.816 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-11-27T17:53:01.814+0000 7f021f16c640 -1 Falling back to public interface 2023-11-27T17:53:01.828 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-11-27T17:53:01.826+0000 7f9853613640 -1 Falling back to public interface 2023-11-27T17:53:01.932 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:01.926+0000 7f88d941f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-27T17:53:02.136 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:02.130+0000 7f88d941f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-27T17:53:02.199 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:02.194+0000 7f88d941f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-27T17:53:02.238 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:02.323 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:02.318+0000 7f88d941f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-27T17:53:02.354 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.350+0000 7fde7f307640 1 Processor -- start 2023-11-27T17:53:02.354 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.350+0000 7fde7f307640 1 -- start start 2023-11-27T17:53:02.355 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7f307640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde780b80b0 0x7fde780b8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:02.355 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7f307640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7814ca10 con 0x7fde78142de0 2023-11-27T17:53:02.355 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7f307640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7814ccf0 con 0x7fde78149830 2023-11-27T17:53:02.355 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7f307640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7814cfd0 con 0x7fde780b80b0 2023-11-27T17:53:02.356 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7d0a3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde780b80b0 0x7fde780b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:02.356 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7c8a2640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fde78142de0 0x7fde78149120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47762/0 (socket says 172.21.15.31:47762) 2023-11-27T17:53:02.356 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7d0a3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde780b80b0 0x7fde780b8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44800/0 (socket says 172.21.15.31:44800) 2023-11-27T17:53:02.356 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7c8a2640 1 -- 172.21.15.31:0/4134946561 learned_addr learned my addr 172.21.15.31:0/4134946561 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:02.356 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7d0a3640 1 -- 172.21.15.31:0/4134946561 >> v1:172.21.15.81:6789/0 conn(0x7fde78149830 legacy=0x7fde781539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:02.356 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7d0a3640 1 -- 172.21.15.31:0/4134946561 >> v1:172.21.15.31:6789/0 conn(0x7fde78142de0 legacy=0x7fde78149120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:02.357 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7d0a3640 1 -- 172.21.15.31:0/4134946561 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7814d2b0 con 0x7fde780b80b0 2023-11-27T17:53:02.357 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde6ffff640 1 -- 172.21.15.31:0/4134946561 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331135026 0 0) 0x7fde7814ca10 con 0x7fde78142de0 2023-11-27T17:53:02.358 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7d0a3640 1 --2- 172.21.15.31:0/4134946561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde780b80b0 0x7fde780b8490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fde740097c0 tx=0x7fde7401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08b92dd3482f149 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:02.358 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde6ffff640 1 -- 172.21.15.31:0/4134946561 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740ab670 con 0x7fde780b80b0 2023-11-27T17:53:02.358 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde6ffff640 1 -- 172.21.15.31:0/4134946561 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde740ab7d0 con 0x7fde780b80b0 2023-11-27T17:53:02.358 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde6ffff640 1 -- 172.21.15.31:0/4134946561 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740abb60 con 0x7fde780b80b0 2023-11-27T17:53:02.359 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7f307640 1 -- 172.21.15.31:0/4134946561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde780b80b0 msgr2=0x7fde780b8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:02.359 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7f307640 1 --2- 172.21.15.31:0/4134946561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde780b80b0 0x7fde780b8490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fde740097c0 tx=0x7fde7401c450 comp rx=0 tx=0).stop 2023-11-27T17:53:02.359 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7f307640 1 -- 172.21.15.31:0/4134946561 shutdown_connections 2023-11-27T17:53:02.359 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7f307640 1 --2- 172.21.15.31:0/4134946561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde780b80b0 0x7fde780b8490 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:02.359 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7f307640 1 -- 172.21.15.31:0/4134946561 >> 172.21.15.31:0/4134946561 conn(0x7fde7806a560 msgr2=0x7fde7806a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:02.359 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7f307640 1 -- 172.21.15.31:0/4134946561 shutdown_connections 2023-11-27T17:53:02.359 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.354+0000 7fde7f307640 1 -- 172.21.15.31:0/4134946561 wait complete. 2023-11-27T17:53:02.361 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7f307640 1 Processor -- start 2023-11-27T17:53:02.362 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7f307640 1 -- start start 2023-11-27T17:53:02.362 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7f307640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde780b80b0 0x7fde781e7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:02.362 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7f307640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde78142de0 0x7fde78135ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:02.362 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7f307640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde78149830 0x7fde78136420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:02.362 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7f307640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde781e7fe0 con 0x7fde78149830 2023-11-27T17:53:02.362 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7f307640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7806cdf0 con 0x7fde780b80b0 2023-11-27T17:53:02.362 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7f307640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7806d1d0 con 0x7fde78142de0 2023-11-27T17:53:02.362 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7d8a4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde78149830 0x7fde78136420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7d8a4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde78149830 0x7fde78136420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44808/0 (socket says 172.21.15.31:44808) 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7d8a4640 1 -- 172.21.15.31:0/846032243 learned_addr learned my addr 172.21.15.31:0/846032243 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7c8a2640 1 --2- 172.21.15.31:0/846032243 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde78142de0 0x7fde78135ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7d0a3640 1 --2- 172.21.15.31:0/846032243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde780b80b0 0x7fde781e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7d8a4640 1 -- 172.21.15.31:0/846032243 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde78142de0 msgr2=0x7fde78135ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7d8a4640 1 --2- 172.21.15.31:0/846032243 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde78142de0 0x7fde78135ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7d8a4640 1 -- 172.21.15.31:0/846032243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde780b80b0 msgr2=0x7fde781e7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7d8a4640 1 --2- 172.21.15.31:0/846032243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde780b80b0 0x7fde781e7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7d8a4640 1 -- 172.21.15.31:0/846032243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde74009420 con 0x7fde78149830 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7d8a4640 1 --2- 172.21.15.31:0/846032243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde78149830 0x7fde78136420 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fde7000c760 tx=0x7fde7000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde6dffb640 1 -- 172.21.15.31:0/846032243 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70003b80 con 0x7fde78149830 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde6dffb640 1 -- 172.21.15.31:0/846032243 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde70003ce0 con 0x7fde78149830 2023-11-27T17:53:02.363 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7f307640 1 -- 172.21.15.31:0/846032243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde780bba50 con 0x7fde78149830 2023-11-27T17:53:02.364 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde6dffb640 1 -- 172.21.15.31:0/846032243 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000aa30 con 0x7fde78149830 2023-11-27T17:53:02.364 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7f307640 1 -- 172.21.15.31:0/846032243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde781e7c00 con 0x7fde78149830 2023-11-27T17:53:02.364 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde6dffb640 1 -- 172.21.15.31:0/846032243 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7fde700050d0 con 0x7fde78149830 2023-11-27T17:53:02.364 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde6dffb640 1 -- 172.21.15.31:0/846032243 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fde70012e10 con 0x7fde78149830 2023-11-27T17:53:02.364 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.358+0000 7fde7f307640 1 -- 172.21.15.31:0/846032243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde781e7a30 con 0x7fde78149830 2023-11-27T17:53:02.364 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.362+0000 7fde6dffb640 1 -- 172.21.15.31:0/846032243 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72904 (secure 0 0 0) 0x7fde70005560 con 0x7fde78149830 2023-11-27T17:53:02.365 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:02.362+0000 7fae4f41d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T17:53:02.421 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.418+0000 7fde7f307640 1 -- 172.21.15.31:0/846032243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde7804e850 con 0x7fde78149830 2023-11-27T17:53:02.422 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.418+0000 7fde6dffb640 1 -- 172.21.15.31:0/846032243 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fde70005700 con 0x7fde78149830 2023-11-27T17:53:02.422 INFO:teuthology.misc.health.smithi031.stdout: 2023-11-27T17:53:02.422 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":10,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:01.135708+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:02.423 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.422+0000 7fde7f307640 1 -- 172.21.15.31:0/846032243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde78149830 msgr2=0x7fde78136420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:02.423 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.422+0000 7fde7f307640 1 --2- 172.21.15.31:0/846032243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde78149830 0x7fde78136420 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fde7000c760 tx=0x7fde7000cc20 comp rx=0 tx=0).stop 2023-11-27T17:53:02.423 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.422+0000 7fde7f307640 1 -- 172.21.15.31:0/846032243 shutdown_connections 2023-11-27T17:53:02.424 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.422+0000 7fde7f307640 1 --2- 172.21.15.31:0/846032243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde78149830 0x7fde78136420 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:02.424 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.422+0000 7fde7f307640 1 --2- 172.21.15.31:0/846032243 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde78142de0 0x7fde78135ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:02.424 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.422+0000 7fde7f307640 1 --2- 172.21.15.31:0/846032243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde780b80b0 0x7fde781e7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:02.424 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.422+0000 7fde7f307640 1 -- 172.21.15.31:0/846032243 >> 172.21.15.31:0/846032243 conn(0x7fde7806a560 msgr2=0x7fde78066410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:02.424 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.422+0000 7fde7f307640 1 -- 172.21.15.31:0/846032243 shutdown_connections 2023-11-27T17:53:02.424 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:02.422+0000 7fde7f307640 1 -- 172.21.15.31:0/846032243 wait complete. 2023-11-27T17:53:02.437 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-27T17:53:02.445 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:02.442+0000 7fae4f41d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T17:53:02.623 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:02.622+0000 7fae4f41d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T17:53:02.699 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:02.698+0000 7fae4f41d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T17:53:02.941 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:02.934+0000 7f88d941f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-27T17:53:03.002 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:02.998+0000 7fae4f41d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T17:53:03.016 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:03.010+0000 7f88d941f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-27T17:53:03.064 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:03.062+0000 7fae4f41d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T17:53:03.193 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:03.186+0000 7f88d941f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-27T17:53:03.268 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:03.262+0000 7f88d941f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-27T17:53:03.556 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:03.550+0000 7f88d941f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-27T17:53:03.615 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-27T17:53:03.610+0000 7f88d941f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-27T17:53:04.111 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:04.110+0000 7fadf6ba2640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-27T17:53:04.112 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-27T17:53:04.110+0000 7fadf6ba2640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-27T17:53:05.585 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-11-27T17:53:05.578+0000 7f7f83714640 -1 osd.7 0 log_to_monitors true 2023-11-27T17:53:05.607 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-11-27T17:53:05.606+0000 7efc13b65640 -1 osd.0 0 log_to_monitors true 2023-11-27T17:53:05.693 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-11-27T17:53:05.690+0000 7f021f16c640 -1 osd.1 0 log_to_monitors true 2023-11-27T17:53:05.698 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-11-27T17:53:05.694+0000 7fbfaa74d640 -1 osd.5 0 log_to_monitors true 2023-11-27T17:53:05.700 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-11-27T17:53:05.698+0000 7f62e1a90640 -1 osd.2 0 log_to_monitors true 2023-11-27T17:53:05.717 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-11-27T17:53:05.710+0000 7f22c5bd3640 -1 osd.6 0 log_to_monitors true 2023-11-27T17:53:05.743 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-11-27T17:53:05.738+0000 7f38e2331640 -1 osd.4 0 log_to_monitors true 2023-11-27T17:53:05.770 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-11-27T17:53:05.766+0000 7f9853613640 -1 osd.3 0 log_to_monitors true 2023-11-27T17:53:09.246 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:09.421 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f062b4c2640 1 Processor -- start 2023-11-27T17:53:09.421 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f062b4c2640 1 -- start start 2023-11-27T17:53:09.422 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f062b4c2640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f062406d440 0x7f06240b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:09.422 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f062b4c2640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06240b2710 con 0x7f0624071730 2023-11-27T17:53:09.423 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f062b4c2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06240b8e60 con 0x7f06240ba360 2023-11-27T17:53:09.423 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f062b4c2640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062406d8d0 con 0x7f062406d440 2023-11-27T17:53:09.423 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f0629a5f640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0624071730 0x7f06240b8750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48352/0 (socket says 172.21.15.31:48352) 2023-11-27T17:53:09.423 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f0629a5f640 1 -- 172.21.15.31:0/3315899882 learned_addr learned my addr 172.21.15.31:0/3315899882 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:09.423 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f062925e640 1 --2- 172.21.15.31:0/3315899882 >> v2:172.21.15.31:3300/0 conn(0x7f062406d440 0x7f06240b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:09.423 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f061bfff640 1 -- 172.21.15.31:0/3315899882 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486465521 0 0) 0x7f06240b2710 con 0x7f0624071730 2023-11-27T17:53:09.424 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f061bfff640 1 -- 172.21.15.31:0/3315899882 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0610003530 con 0x7f0624071730 2023-11-27T17:53:09.424 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f062925e640 1 -- 172.21.15.31:0/3315899882 >> v1:172.21.15.81:6789/0 conn(0x7f06240ba360 legacy=0x7f06240b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:09.424 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.418+0000 7f062925e640 1 -- 172.21.15.31:0/3315899882 >> v1:172.21.15.31:6789/0 conn(0x7f0624071730 legacy=0x7f06240b8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:09.424 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.422+0000 7f062925e640 1 -- 172.21.15.31:0/3315899882 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062406dbb0 con 0x7f062406d440 2023-11-27T17:53:09.426 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.422+0000 7f062925e640 1 --2- 172.21.15.31:0/3315899882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f062406d440 0x7f06240b1d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f061c009d90 tx=0x7f061c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cef180a9674a1c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:09.426 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.422+0000 7f061bfff640 1 -- 172.21.15.31:0/3315899882 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0af600 con 0x7f062406d440 2023-11-27T17:53:09.426 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.422+0000 7f061bfff640 1 -- 172.21.15.31:0/3315899882 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c0ab050 con 0x7f062406d440 2023-11-27T17:53:09.426 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.422+0000 7f061bfff640 1 -- 172.21.15.31:0/3315899882 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0af980 con 0x7f062406d440 2023-11-27T17:53:09.427 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 -- 172.21.15.31:0/3315899882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f062406d440 msgr2=0x7f06240b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:09.428 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 --2- 172.21.15.31:0/3315899882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f062406d440 0x7f06240b1d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f061c009d90 tx=0x7f061c01f130 comp rx=0 tx=0).stop 2023-11-27T17:53:09.428 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 -- 172.21.15.31:0/3315899882 shutdown_connections 2023-11-27T17:53:09.428 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 --2- 172.21.15.31:0/3315899882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f062406d440 0x7f06240b1d60 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f061c009d90 tx=0x7f061c01f130 comp rx=0 tx=0).stop 2023-11-27T17:53:09.428 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 -- 172.21.15.31:0/3315899882 >> 172.21.15.31:0/3315899882 conn(0x7f06240b9840 msgr2=0x7f06240b9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:09.428 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 -- 172.21.15.31:0/3315899882 shutdown_connections 2023-11-27T17:53:09.428 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 -- 172.21.15.31:0/3315899882 wait complete. 2023-11-27T17:53:09.429 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 Processor -- start 2023-11-27T17:53:09.430 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 -- start start 2023-11-27T17:53:09.431 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0624071730 0x7f0624147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:09.431 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06240ba360 0x7f062413fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:09.431 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062413de50 0x7f06241deda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:09.431 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.426+0000 7f062b4c2640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624148350 con 0x7f0624071730 2023-11-27T17:53:09.431 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062b4c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624145550 con 0x7f06240ba360 2023-11-27T17:53:09.431 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062b4c2640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06241e5450 con 0x7f062413de50 2023-11-27T17:53:09.431 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062925e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0624071730 0x7f0624147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:09.432 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062925e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0624071730 0x7f0624147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:59022/0 (socket says 172.21.15.31:59022) 2023-11-27T17:53:09.432 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062925e640 1 -- 172.21.15.31:0/3040504866 learned_addr learned my addr 172.21.15.31:0/3040504866 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:09.432 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f0629a5f640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062413de50 0x7f06241deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:09.432 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f0628a5d640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06240ba360 0x7f062413fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:09.432 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062925e640 1 -- 172.21.15.31:0/3040504866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062413de50 msgr2=0x7f06241deda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:09.432 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062925e640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062413de50 0x7f06241deda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:09.433 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062925e640 1 -- 172.21.15.31:0/3040504866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06240ba360 msgr2=0x7f062413fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:09.433 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062925e640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06240ba360 0x7f062413fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:09.433 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062925e640 1 -- 172.21.15.31:0/3040504866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c009a70 con 0x7f0624071730 2023-11-27T17:53:09.433 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f0628a5d640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06240ba360 0x7f062413fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:09.433 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f0629a5f640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062413de50 0x7f06241deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:09.434 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062925e640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0624071730 0x7f0624147e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f061c01cd60 tx=0x7f061c01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:09.434 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f0619ffb640 1 -- 172.21.15.31:0/3040504866 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c009450 con 0x7f0624071730 2023-11-27T17:53:09.434 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f0619ffb640 1 -- 172.21.15.31:0/3040504866 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c0b9410 con 0x7f0624071730 2023-11-27T17:53:09.434 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f0619ffb640 1 -- 172.21.15.31:0/3040504866 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c0b97c0 con 0x7f0624071730 2023-11-27T17:53:09.434 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062b4c2640 1 -- 172.21.15.31:0/3040504866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06241e5730 con 0x7f0624071730 2023-11-27T17:53:09.434 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.430+0000 7f062b4c2640 1 -- 172.21.15.31:0/3040504866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06241e5120 con 0x7f0624071730 2023-11-27T17:53:09.436 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.434+0000 7f062b4c2640 1 -- 172.21.15.31:0/3040504866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06241e5c50 con 0x7f0624071730 2023-11-27T17:53:09.439 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.438+0000 7f0619ffb640 1 -- 172.21.15.31:0/3040504866 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) v1 ==== 85935+0+0 (secure 0 0 0) 0x7f061c0b6050 con 0x7f0624071730 2023-11-27T17:53:09.439 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.438+0000 7f0619ffb640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0608066830 0x7f0608068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:09.440 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.438+0000 7f0628a5d640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0608066830 0x7f0608068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:09.441 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.438+0000 7f0628a5d640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0608066830 0x7f0608068cf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f06241e2d10 tx=0x7f0614009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:09.441 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.438+0000 7f0619ffb640 1 -- 172.21.15.31:0/3040504866 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f061c121840 con 0x7f0624071730 2023-11-27T17:53:09.445 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.442+0000 7f0619ffb640 1 -- 172.21.15.31:0/3040504866 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f06241e5c50 con 0x7f0624071730 2023-11-27T17:53:09.466 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-11-27T17:53:09.462+0000 7f38ddab8640 -1 osd.4 0 waiting for initial osdmap 2023-11-27T17:53:09.488 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-11-27T17:53:09.482+0000 7f7f7ee9b640 -1 osd.7 0 waiting for initial osdmap 2023-11-27T17:53:09.496 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-11-27T17:53:09.490+0000 7f38d6105640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:53:09.510 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-11-27T17:53:09.506+0000 7f7f774e8640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:53:09.541 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-11-27T17:53:09.538+0000 7f22c2b90640 -1 osd.6 0 waiting for initial osdmap 2023-11-27T17:53:09.569 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-11-27T17:53:09.562+0000 7fbfa770a640 -1 osd.5 0 waiting for initial osdmap 2023-11-27T17:53:09.569 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-11-27T17:53:09.566+0000 7f22b99a7640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:53:09.606 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-11-27T17:53:09.602+0000 7fbf9e521640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:53:09.611 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-11-27T17:53:09.606+0000 7efc0f2ec640 -1 osd.0 0 waiting for initial osdmap 2023-11-27T17:53:09.640 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-11-27T17:53:09.638+0000 7efc07939640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:53:09.642 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-11-27T17:53:09.638+0000 7f62dd217640 -1 osd.2 0 waiting for initial osdmap 2023-11-27T17:53:09.680 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-11-27T17:53:09.678+0000 7f62d5864640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:53:09.713 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-11-27T17:53:09.710+0000 7f984ed9a640 -1 osd.3 0 waiting for initial osdmap 2023-11-27T17:53:09.718 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.714+0000 7f062b4c2640 1 -- 172.21.15.31:0/3040504866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f062404e850 con 0x7f0624071730 2023-11-27T17:53:09.721 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.718+0000 7f0619ffb640 1 -- 172.21.15.31:0/3040504866 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f061c0b4030 con 0x7f0624071730 2023-11-27T17:53:09.721 INFO:teuthology.misc.health.smithi031.stdout: 2023-11-27T17:53:09.722 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":12,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:07.219330+0000","last_up_change":"0.000000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:09.725 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.722+0000 7f062b4c2640 1 -- 172.21.15.31:0/3040504866 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0608066830 msgr2=0x7f0608068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:09.725 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.722+0000 7f062b4c2640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0608066830 0x7f0608068cf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f06241e2d10 tx=0x7f0614009040 comp rx=0 tx=0).stop 2023-11-27T17:53:09.725 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.722+0000 7f062b4c2640 1 -- 172.21.15.31:0/3040504866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0624071730 msgr2=0x7f0624147e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:09.725 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.722+0000 7f062b4c2640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0624071730 0x7f0624147e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f061c01cd60 tx=0x7f061c01bed0 comp rx=0 tx=0).stop 2023-11-27T17:53:09.725 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.722+0000 7f062b4c2640 1 -- 172.21.15.31:0/3040504866 shutdown_connections 2023-11-27T17:53:09.725 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.722+0000 7f062b4c2640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0608066830 0x7f0608068cf0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:09.725 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.722+0000 7f062b4c2640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f062413de50 0x7f06241deda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:09.725 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.722+0000 7f062b4c2640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06240ba360 0x7f062413fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:09.726 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.722+0000 7f062b4c2640 1 --2- 172.21.15.31:0/3040504866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0624071730 0x7f0624147e10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:09.726 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.722+0000 7f062b4c2640 1 -- 172.21.15.31:0/3040504866 >> 172.21.15.31:0/3040504866 conn(0x7f06240b9840 msgr2=0x7f06241410b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:09.726 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.722+0000 7f062b4c2640 1 -- 172.21.15.31:0/3040504866 shutdown_connections 2023-11-27T17:53:09.726 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:09.722+0000 7f062b4c2640 1 -- 172.21.15.31:0/3040504866 wait complete. 2023-11-27T17:53:09.739 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-27T17:53:09.743 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-11-27T17:53:09.742+0000 7f98473e7640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:53:09.748 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-11-27T17:53:09.746+0000 7f021a8f3640 -1 osd.1 0 waiting for initial osdmap 2023-11-27T17:53:09.788 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-11-27T17:53:09.786+0000 7f0212f40640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-27T17:53:16.545 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:16.671 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.665+0000 7eff938dc640 1 Processor -- start 2023-11-27T17:53:16.671 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.665+0000 7eff938dc640 1 -- start start 2023-11-27T17:53:16.672 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff938dc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff8c06ce30 0x7eff8c0b8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:16.672 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff938dc640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c142750 con 0x7eff8c0b3a30 2023-11-27T17:53:16.672 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff938dc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c06d350 con 0x7eff8c14bb60 2023-11-27T17:53:16.672 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff938dc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c06d630 con 0x7eff8c06ce30 2023-11-27T17:53:16.672 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff91678640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7eff8c0b3a30 0x7eff8c142040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38154/0 (socket says 172.21.15.31:38154) 2023-11-27T17:53:16.672 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff91678640 1 -- 172.21.15.31:0/4008886100 learned_addr learned my addr 172.21.15.31:0/4008886100 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:16.674 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff90e77640 1 --2- 172.21.15.31:0/4008886100 >> v2:172.21.15.81:3300/0 conn(0x7eff8c06ce30 0x7eff8c0b8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:16.674 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940117097 0 0) 0x7eff8c142750 con 0x7eff8c0b3a30 2023-11-27T17:53:16.674 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff74003530 con 0x7eff8c0b3a30 2023-11-27T17:53:16.674 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 427809105 0 0) 0x7eff74003530 con 0x7eff8c0b3a30 2023-11-27T17:53:16.674 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 >> v2:172.21.15.81:3300/0 conn(0x7eff8c06ce30 msgr2=0x7eff8c0b8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:16.674 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 --2- 172.21.15.31:0/4008886100 >> v2:172.21.15.81:3300/0 conn(0x7eff8c06ce30 0x7eff8c0b8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:16.674 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 >> v1:172.21.15.81:6789/0 conn(0x7eff8c14bb60 legacy=0x7eff8c152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:16.675 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c14b640 con 0x7eff8c0b3a30 2023-11-27T17:53:16.675 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7eff80001680 con 0x7eff8c0b3a30 2023-11-27T17:53:16.675 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 >> v1:172.21.15.31:6789/0 conn(0x7eff8c0b3a30 legacy=0x7eff8c142040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:16.675 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 --2- 172.21.15.31:0/4008886100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff740039b0 0x7eff74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:16.675 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 --2- 172.21.15.31:0/4008886100 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff740047d0 0x7eff74004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:16.675 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 --2- 172.21.15.31:0/4008886100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 0x7eff7400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:16.675 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c06d630 con 0x7eff74005190 2023-11-27T17:53:16.675 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7400c040 con 0x7eff740039b0 2023-11-27T17:53:16.675 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7400c200 con 0x7eff740047d0 2023-11-27T17:53:16.675 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff91e79640 1 --2- 172.21.15.31:0/4008886100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 0x7eff7400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:16.675 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff91678640 1 --2- 172.21.15.31:0/4008886100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff740039b0 0x7eff74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:16.675 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff90e77640 1 --2- 172.21.15.31:0/4008886100 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff740047d0 0x7eff74004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:16.676 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff91e79640 1 -- 172.21.15.31:0/4008886100 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff740047d0 msgr2=0x7eff74004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:16.676 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff91e79640 1 --2- 172.21.15.31:0/4008886100 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff740047d0 0x7eff74004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:16.676 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff91e79640 1 -- 172.21.15.31:0/4008886100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff740039b0 msgr2=0x7eff74003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:16.676 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff91e79640 1 --2- 172.21.15.31:0/4008886100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff740039b0 0x7eff74003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:16.676 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff91e79640 1 -- 172.21.15.31:0/4008886100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff74003530 con 0x7eff74005190 2023-11-27T17:53:16.676 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.669+0000 7eff91678640 1 --2- 172.21.15.31:0/4008886100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff740039b0 0x7eff74003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:16.677 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff91e79640 1 -- 172.21.15.31:0/4008886100 reap_dead start 2023-11-27T17:53:16.677 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff91e79640 1 --2- 172.21.15.31:0/4008886100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 0x7eff7400b990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff84001780 tx=0x7eff8401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21199ec3addebd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:16.677 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff840052d0 con 0x7eff74005190 2023-11-27T17:53:16.678 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff840a7050 con 0x7eff74005190 2023-11-27T17:53:16.678 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff8bfff640 1 -- 172.21.15.31:0/4008886100 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff84003600 con 0x7eff74005190 2023-11-27T17:53:16.678 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 -- 172.21.15.31:0/4008886100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 msgr2=0x7eff7400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:16.678 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 --2- 172.21.15.31:0/4008886100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 0x7eff7400b990 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7eff84001780 tx=0x7eff8401c400 comp rx=0 tx=0).stop 2023-11-27T17:53:16.678 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 -- 172.21.15.31:0/4008886100 shutdown_connections 2023-11-27T17:53:16.678 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 --2- 172.21.15.31:0/4008886100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 0x7eff7400b990 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:16.678 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 -- 172.21.15.31:0/4008886100 >> 172.21.15.31:0/4008886100 conn(0x7eff8c0b9840 msgr2=0x7eff8c0b9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:16.678 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 -- 172.21.15.31:0/4008886100 shutdown_connections 2023-11-27T17:53:16.678 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 -- 172.21.15.31:0/4008886100 wait complete. 2023-11-27T17:53:16.678 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 Processor -- start 2023-11-27T17:53:16.678 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 -- start start 2023-11-27T17:53:16.680 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 0x7eff8c144b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:16.680 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff8c145050 0x7eff8c0b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:16.680 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff8c0b5c50 0x7eff8c1d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:16.680 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c0b6100 con 0x7eff74005190 2023-11-27T17:53:16.680 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c1d29d0 con 0x7eff8c0b5c50 2023-11-27T17:53:16.680 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff938dc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c0b5230 con 0x7eff8c145050 2023-11-27T17:53:16.681 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff91678640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 0x7eff8c144b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:16.681 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff91678640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 0x7eff8c144b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55428/0 (socket says 172.21.15.31:55428) 2023-11-27T17:53:16.681 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff91678640 1 -- 172.21.15.31:0/1503363669 learned_addr learned my addr 172.21.15.31:0/1503363669 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:16.681 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff91e79640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff8c0b5c50 0x7eff8c1d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:16.681 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff90e77640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff8c145050 0x7eff8c0b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:16.681 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff91678640 1 -- 172.21.15.31:0/1503363669 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff8c145050 msgr2=0x7eff8c0b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:16.681 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff91678640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff8c145050 0x7eff8c0b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:16.681 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff91678640 1 -- 172.21.15.31:0/1503363669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff8c0b5c50 msgr2=0x7eff8c1d3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:16.681 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff91678640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff8c0b5c50 0x7eff8c1d3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:16.681 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff91678640 1 -- 172.21.15.31:0/1503363669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c1df600 con 0x7eff74005190 2023-11-27T17:53:16.681 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff91678640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 0x7eff8c144b10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7eff80001bc0 tx=0x7eff8000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:16.681 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.673+0000 7eff89ffb640 1 -- 172.21.15.31:0/1503363669 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8000ee60 con 0x7eff74005190 2023-11-27T17:53:16.682 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.677+0000 7eff89ffb640 1 -- 172.21.15.31:0/1503363669 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8000c8a0 con 0x7eff74005190 2023-11-27T17:53:16.682 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.677+0000 7eff938dc640 1 -- 172.21.15.31:0/1503363669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c1df8e0 con 0x7eff74005190 2023-11-27T17:53:16.682 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.677+0000 7eff89ffb640 1 -- 172.21.15.31:0/1503363669 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8000cc10 con 0x7eff74005190 2023-11-27T17:53:16.682 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.677+0000 7eff938dc640 1 -- 172.21.15.31:0/1503363669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c0b6c30 con 0x7eff74005190 2023-11-27T17:53:16.682 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.677+0000 7eff938dc640 1 -- 172.21.15.31:0/1503363669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8c0b53f0 con 0x7eff74005190 2023-11-27T17:53:16.682 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.677+0000 7eff89ffb640 1 -- 172.21.15.31:0/1503363669 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7eff8001d460 con 0x7eff74005190 2023-11-27T17:53:16.683 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.677+0000 7eff89ffb640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7eff780667f0 0x7eff78068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:16.683 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.677+0000 7eff89ffb640 1 -- 172.21.15.31:0/1503363669 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff80083e60 con 0x7eff74005190 2023-11-27T17:53:16.683 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.677+0000 7eff90e77640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7eff780667f0 0x7eff78068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:16.683 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.677+0000 7eff90e77640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7eff780667f0 0x7eff78068cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7eff8c142980 tx=0x7eff7c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:16.685 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.681+0000 7eff89ffb640 1 -- 172.21.15.31:0/1503363669 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7eff800512b0 con 0x7eff74005190 2023-11-27T17:53:16.841 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.837+0000 7eff938dc640 1 -- 172.21.15.31:0/1503363669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff8c04e850 con 0x7eff74005190 2023-11-27T17:53:16.843 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff89ffb640 1 -- 172.21.15.31:0/1503363669 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12779 (secure 0 0 0) 0x7eff800548d0 con 0x7eff74005190 2023-11-27T17:53:16.844 INFO:teuthology.misc.health.smithi031.stdout: 2023-11-27T17:53:16.844 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":16,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:13.513861+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:16.846 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff938dc640 1 -- 172.21.15.31:0/1503363669 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7eff780667f0 msgr2=0x7eff78068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:16.846 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff938dc640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7eff780667f0 0x7eff78068cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7eff8c142980 tx=0x7eff7c00b040 comp rx=0 tx=0).stop 2023-11-27T17:53:16.846 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff938dc640 1 -- 172.21.15.31:0/1503363669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 msgr2=0x7eff8c144b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:16.846 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff938dc640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 0x7eff8c144b10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7eff80001bc0 tx=0x7eff8000ec10 comp rx=0 tx=0).stop 2023-11-27T17:53:16.846 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff938dc640 1 -- 172.21.15.31:0/1503363669 shutdown_connections 2023-11-27T17:53:16.846 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff938dc640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7eff780667f0 0x7eff78068cb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:16.846 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff938dc640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff8c0b5c50 0x7eff8c1d3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:16.846 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff938dc640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7eff8c145050 0x7eff8c0b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:16.846 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff938dc640 1 --2- 172.21.15.31:0/1503363669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff74005190 0x7eff8c144b10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:16.847 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff938dc640 1 -- 172.21.15.31:0/1503363669 >> 172.21.15.31:0/1503363669 conn(0x7eff8c0b9840 msgr2=0x7eff8c1d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:16.847 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff938dc640 1 -- 172.21.15.31:0/1503363669 shutdown_connections 2023-11-27T17:53:16.847 INFO:teuthology.misc.health.smithi031.stderr:2023-11-27T17:53:16.841+0000 7eff938dc640 1 -- 172.21.15.31:0/1503363669 wait complete. 2023-11-27T17:53:16.862 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-27T17:53:16.862 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-27T17:53:16.862 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-27T17:53:16.862 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-27T17:53:16.864 INFO:tasks.ceph.mds.a:Started 2023-11-27T17:53:16.864 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-27T17:53:16.865 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-27T17:53:16.866 INFO:tasks.ceph.mds.c:Started 2023-11-27T17:53:16.866 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-27T17:53:16.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-27T17:53:16.870 INFO:tasks.ceph.mds.b:Started 2023-11-27T17:53:16.870 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-27T17:53:16.873 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:16.937 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-11-27T17:53:16.937 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:53:16.938 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-11-27T17:53:16.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:53:16.941 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:53:16.962 INFO:tasks.ceph.mds.b.smithi081.stdout:starting mds.b at 2023-11-27T17:53:16.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.993+0000 7f95212ab640 1 Processor -- start 2023-11-27T17:53:16.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.993+0000 7f95212ab640 1 -- start start 2023-11-27T17:53:17.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f95212ab640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f951c0b7480 0x7f951c14e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f95212ab640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f951c0b5fd0 0x7f951c14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f95212ab640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951c145ad0 con 0x7f951c1456f0 2023-11-27T17:53:17.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f95212ab640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0bbcf0 con 0x7f951c0b7480 2023-11-27T17:53:17.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f95212ab640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0b66c0 con 0x7f951c0b5fd0 2023-11-27T17:53:17.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f951affd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f951c1456f0 0x7f951c0bb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38170/0 (socket says 172.21.15.31:38170) 2023-11-27T17:53:17.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f951affd640 1 -- 172.21.15.31:0/1240911287 learned_addr learned my addr 172.21.15.31:0/1240911287 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:17.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f951a7fc640 1 --2- 172.21.15.31:0/1240911287 >> v2:172.21.15.81:3300/0 conn(0x7f951c0b7480 0x7f951c14e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f951b7fe640 1 --2- 172.21.15.31:0/1240911287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f951c0b5fd0 0x7f951c14eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f9519ffb640 1 -- 172.21.15.31:0/1240911287 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100911652 0 0) 0x7f951c145ad0 con 0x7f951c1456f0 2023-11-27T17:53:17.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f9519ffb640 1 -- 172.21.15.31:0/1240911287 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9504003530 con 0x7f951c1456f0 2023-11-27T17:53:17.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f951a7fc640 1 -- 172.21.15.31:0/1240911287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f951c0b5fd0 msgr2=0x7f951c14eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:17.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f951a7fc640 1 --2- 172.21.15.31:0/1240911287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f951c0b5fd0 0x7f951c14eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f951a7fc640 1 -- 172.21.15.31:0/1240911287 >> v1:172.21.15.31:6789/0 conn(0x7f951c1456f0 legacy=0x7f951c0bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f951a7fc640 1 -- 172.21.15.31:0/1240911287 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0b69a0 con 0x7f951c0b7480 2023-11-27T17:53:17.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f951a7fc640 1 --2- 172.21.15.31:0/1240911287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951c0b7480 0x7f951c14e990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f95100097c0 tx=0x7f951001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38e2482f3c59e9e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f9519ffb640 1 -- 172.21.15.31:0/1240911287 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95100ab670 con 0x7f951c0b7480 2023-11-27T17:53:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f9519ffb640 1 -- 172.21.15.31:0/1240911287 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95100ab7d0 con 0x7f951c0b7480 2023-11-27T17:53:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:16.997+0000 7f9519ffb640 1 -- 172.21.15.31:0/1240911287 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95100abb60 con 0x7f951c0b7480 2023-11-27T17:53:17.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 -- 172.21.15.31:0/1240911287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951c0b7480 msgr2=0x7f951c14e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 --2- 172.21.15.31:0/1240911287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951c0b7480 0x7f951c14e990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f95100097c0 tx=0x7f951001c450 comp rx=0 tx=0).stop 2023-11-27T17:53:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 -- 172.21.15.31:0/1240911287 shutdown_connections 2023-11-27T17:53:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 --2- 172.21.15.31:0/1240911287 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f951c0b5fd0 0x7f951c14eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 --2- 172.21.15.31:0/1240911287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951c0b7480 0x7f951c14e990 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 -- 172.21.15.31:0/1240911287 >> 172.21.15.31:0/1240911287 conn(0x7f951c0bd6e0 msgr2=0x7f951c0bdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 -- 172.21.15.31:0/1240911287 shutdown_connections 2023-11-27T17:53:17.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 -- 172.21.15.31:0/1240911287 wait complete. 2023-11-27T17:53:17.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 Processor -- start 2023-11-27T17:53:17.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 -- start start 2023-11-27T17:53:17.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f951c0b5fd0 0x7f951c0bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951c0b7480 0x7f951c13b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c1456f0 0x7f951c0b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c13ad70 con 0x7f951c1456f0 2023-11-27T17:53:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c13a6b0 con 0x7f951c0b7480 2023-11-27T17:53:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c13a990 con 0x7f951c0b5fd0 2023-11-27T17:53:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f951b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c1456f0 0x7f951c0b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f951b7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c1456f0 0x7f951c0b8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55456/0 (socket says 172.21.15.31:55456) 2023-11-27T17:53:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f951b7fe640 1 -- 172.21.15.31:0/157803607 learned_addr learned my addr 172.21.15.31:0/157803607 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f951a7fc640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951c0b7480 0x7f951c13b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f951affd640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f951c0b5fd0 0x7f951c0bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f951b7fe640 1 -- 172.21.15.31:0/157803607 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f951c0b5fd0 msgr2=0x7f951c0bf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f951b7fe640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f951c0b5fd0 0x7f951c0bf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f951b7fe640 1 -- 172.21.15.31:0/157803607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951c0b7480 msgr2=0x7f951c13b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f951b7fe640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951c0b7480 0x7f951c13b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f951b7fe640 1 -- 172.21.15.31:0/157803607 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9510009420 con 0x7f951c1456f0 2023-11-27T17:53:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f951b7fe640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c1456f0 0x7f951c0b8fa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f951400ef90 tx=0x7f951400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95037fe640 1 -- 172.21.15.31:0/157803607 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9514009b20 con 0x7f951c1456f0 2023-11-27T17:53:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95037fe640 1 -- 172.21.15.31:0/157803607 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951400f040 con 0x7f951c1456f0 2023-11-27T17:53:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 -- 172.21.15.31:0/157803607 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c13f270 con 0x7f951c1456f0 2023-11-27T17:53:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95037fe640 1 -- 172.21.15.31:0/157803607 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95140146c0 con 0x7f951c1456f0 2023-11-27T17:53:17.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 -- 172.21.15.31:0/157803607 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c0bea60 con 0x7f951c1456f0 2023-11-27T17:53:17.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.001+0000 7f95212ab640 1 -- 172.21.15.31:0/157803607 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c13aeb0 con 0x7f951c1456f0 2023-11-27T17:53:17.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.005+0000 7f95037fe640 1 -- 172.21.15.31:0/157803607 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9514014820 con 0x7f951c1456f0 2023-11-27T17:53:17.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.005+0000 7f95037fe640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f95080667f0 0x7f9508068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.005+0000 7f95037fe640 1 -- 172.21.15.31:0/157803607 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9514084cf0 con 0x7f951c1456f0 2023-11-27T17:53:17.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.005+0000 7f951affd640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f95080667f0 0x7f9508068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.005+0000 7f951affd640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f95080667f0 0x7f9508068cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f950c0011f0 tx=0x7f950c007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:17.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.009+0000 7f95037fe640 1 -- 172.21.15.31:0/157803607 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f951c13aeb0 con 0x7f951c1456f0 2023-11-27T17:53:17.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.165+0000 7f95212ab640 1 -- 172.21.15.31:0/157803607 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f951c13aeb0 con 0x7f951c1456f0 2023-11-27T17:53:17.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.165+0000 7f95037fe640 1 -- 172.21.15.31:0/157803607 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12779 (secure 0 0 0) 0x7f951c13aeb0 con 0x7f951c1456f0 2023-11-27T17:53:17.244 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:17.244 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:13.513861+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:17.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.169+0000 7f95212ab640 1 -- 172.21.15.31:0/157803607 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f95080667f0 msgr2=0x7f9508068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.169+0000 7f95212ab640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f95080667f0 0x7f9508068cb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f950c0011f0 tx=0x7f950c007d40 comp rx=0 tx=0).stop 2023-11-27T17:53:17.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.169+0000 7f95212ab640 1 -- 172.21.15.31:0/157803607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c1456f0 msgr2=0x7f951c0b8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.169+0000 7f95212ab640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c1456f0 0x7f951c0b8fa0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f951400ef90 tx=0x7f951400c490 comp rx=0 tx=0).stop 2023-11-27T17:53:17.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.169+0000 7f95212ab640 1 -- 172.21.15.31:0/157803607 shutdown_connections 2023-11-27T17:53:17.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.169+0000 7f95212ab640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f95080667f0 0x7f9508068cb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.169+0000 7f95212ab640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f951c1456f0 0x7f951c0b8fa0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.169+0000 7f95212ab640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f951c0b7480 0x7f951c13b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.169+0000 7f95212ab640 1 --2- 172.21.15.31:0/157803607 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f951c0b5fd0 0x7f951c0bf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.169+0000 7f95212ab640 1 -- 172.21.15.31:0/157803607 >> 172.21.15.31:0/157803607 conn(0x7f951c0bd6e0 msgr2=0x7f951c140500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:17.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.169+0000 7f95212ab640 1 -- 172.21.15.31:0/157803607 shutdown_connections 2023-11-27T17:53:17.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.169+0000 7f95212ab640 1 -- 172.21.15.31:0/157803607 wait complete. 2023-11-27T17:53:17.247 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:53:11.177026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:53:17.247 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:53:17.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.425+0000 7ff63d978640 1 Processor -- start 2023-11-27T17:53:17.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.425+0000 7ff63d978640 1 -- start start 2023-11-27T17:53:17.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff63d978640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff638145240 0x7ff638145660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff63d978640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff63814eb60 0x7ff63814efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff63d978640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6380b4740 con 0x7ff6380bd4a0 2023-11-27T17:53:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff63d978640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6380b6420 con 0x7ff638145240 2023-11-27T17:53:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff63d978640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63814f4f0 con 0x7ff63814eb60 2023-11-27T17:53:17.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff6367fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff638145240 0x7ff638145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff6367fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff638145240 0x7ff638145660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55458/0 (socket says 172.21.15.31:55458) 2023-11-27T17:53:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff6367fc640 1 -- 172.21.15.31:0/445483697 learned_addr learned my addr 172.21.15.31:0/445483697 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff6377fe640 1 --2- 172.21.15.31:0/445483697 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff63814eb60 0x7ff63814efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff6367fc640 1 -- 172.21.15.31:0/445483697 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff63814eb60 msgr2=0x7ff63814efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff6367fc640 1 --2- 172.21.15.31:0/445483697 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff63814eb60 0x7ff63814efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff6367fc640 1 -- 172.21.15.31:0/445483697 >> v1:172.21.15.81:6789/0 conn(0x7ff6380bd4a0 legacy=0x7ff6380b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff6367fc640 1 -- 172.21.15.31:0/445483697 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6380b5fe0 con 0x7ff638145240 2023-11-27T17:53:17.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.429+0000 7ff6367fc640 1 --2- 172.21.15.31:0/445483697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff638145240 0x7ff638145660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff620009870 tx=0x7ff62001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0450a57e8431980 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:17.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff635ffb640 1 -- 172.21.15.31:0/445483697 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6200ab680 con 0x7ff638145240 2023-11-27T17:53:17.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff635ffb640 1 -- 172.21.15.31:0/445483697 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6200ab7e0 con 0x7ff638145240 2023-11-27T17:53:17.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff635ffb640 1 -- 172.21.15.31:0/445483697 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6200abb70 con 0x7ff638145240 2023-11-27T17:53:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 -- 172.21.15.31:0/445483697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff638145240 msgr2=0x7ff638145660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 --2- 172.21.15.31:0/445483697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff638145240 0x7ff638145660 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff620009870 tx=0x7ff62001c480 comp rx=0 tx=0).stop 2023-11-27T17:53:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 -- 172.21.15.31:0/445483697 shutdown_connections 2023-11-27T17:53:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 --2- 172.21.15.31:0/445483697 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff63814eb60 0x7ff63814efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 --2- 172.21.15.31:0/445483697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff638145240 0x7ff638145660 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 -- 172.21.15.31:0/445483697 >> 172.21.15.31:0/445483697 conn(0x7ff63806ab60 msgr2=0x7ff6380bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:17.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 -- 172.21.15.31:0/445483697 shutdown_connections 2023-11-27T17:53:17.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 -- 172.21.15.31:0/445483697 wait complete. 2023-11-27T17:53:17.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 Processor -- start 2023-11-27T17:53:17.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 -- start start 2023-11-27T17:53:17.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6380bd4a0 0x7ff6380b92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff638145240 0x7ff63814c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff63814eb60 0x7ff6381dd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6380b9810 con 0x7ff6380bd4a0 2023-11-27T17:53:17.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6381e3a60 con 0x7ff63814eb60 2023-11-27T17:53:17.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6381e3ce0 con 0x7ff638145240 2023-11-27T17:53:17.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff636ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6380bd4a0 0x7ff6380b92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff636ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6380bd4a0 0x7ff6380b92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55462/0 (socket says 172.21.15.31:55462) 2023-11-27T17:53:17.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff636ffd640 1 -- 172.21.15.31:0/3969121745 learned_addr learned my addr 172.21.15.31:0/3969121745 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff6377fe640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff63814eb60 0x7ff6381dd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff636ffd640 1 -- 172.21.15.31:0/3969121745 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff638145240 msgr2=0x7ff63814c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff636ffd640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff638145240 0x7ff63814c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff636ffd640 1 -- 172.21.15.31:0/3969121745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff63814eb60 msgr2=0x7ff6381dd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff636ffd640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff63814eb60 0x7ff6381dd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff636ffd640 1 -- 172.21.15.31:0/3969121745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6200094d0 con 0x7ff6380bd4a0 2023-11-27T17:53:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff6377fe640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff63814eb60 0x7ff6381dd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff636ffd640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6380bd4a0 0x7ff6380b92d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff62800c7a0 tx=0x7ff62800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff62ffff640 1 -- 172.21.15.31:0/3969121745 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628003b80 con 0x7ff6380bd4a0 2023-11-27T17:53:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff62ffff640 1 -- 172.21.15.31:0/3969121745 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff628003ce0 con 0x7ff6380bd4a0 2023-11-27T17:53:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 -- 172.21.15.31:0/3969121745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6381e3fc0 con 0x7ff6380bd4a0 2023-11-27T17:53:17.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff62ffff640 1 -- 172.21.15.31:0/3969121745 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62800aa90 con 0x7ff6380bd4a0 2023-11-27T17:53:17.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.433+0000 7ff63d978640 1 -- 172.21.15.31:0/3969121745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6381e4580 con 0x7ff6380bd4a0 2023-11-27T17:53:17.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.437+0000 7ff63d978640 1 -- 172.21.15.31:0/3969121745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63804e850 con 0x7ff6380bd4a0 2023-11-27T17:53:17.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.437+0000 7ff62ffff640 1 -- 172.21.15.31:0/3969121745 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7ff62800abf0 con 0x7ff6380bd4a0 2023-11-27T17:53:17.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.437+0000 7ff62ffff640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ff6180667f0 0x7ff618068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.437+0000 7ff62ffff640 1 -- 172.21.15.31:0/3969121745 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff628083d90 con 0x7ff6380bd4a0 2023-11-27T17:53:17.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.437+0000 7ff6367fc640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ff6180667f0 0x7ff618068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.437+0000 7ff6367fc640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ff6180667f0 0x7ff618068cb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6200af000 tx=0x7ff620008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:17.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.441+0000 7ff62ffff640 1 -- 172.21.15.31:0/3969121745 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7ff6280511d0 con 0x7ff6380bd4a0 2023-11-27T17:53:17.598 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.593+0000 7ff63d978640 1 -- 172.21.15.31:0/3969121745 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6380b5180 con 0x7ff6380bd4a0 2023-11-27T17:53:17.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.593+0000 7ff62ffff640 1 -- 172.21.15.31:0/3969121745 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6280547f0 con 0x7ff6380bd4a0 2023-11-27T17:53:17.599 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-11-27T17:53:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.597+0000 7ff63d978640 1 -- 172.21.15.31:0/3969121745 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ff6180667f0 msgr2=0x7ff618068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.597+0000 7ff63d978640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ff6180667f0 0x7ff618068cb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6200af000 tx=0x7ff620008040 comp rx=0 tx=0).stop 2023-11-27T17:53:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.597+0000 7ff63d978640 1 -- 172.21.15.31:0/3969121745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6380bd4a0 msgr2=0x7ff6380b92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.597+0000 7ff63d978640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6380bd4a0 0x7ff6380b92d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff62800c7a0 tx=0x7ff62800cc60 comp rx=0 tx=0).stop 2023-11-27T17:53:17.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.597+0000 7ff63d978640 1 -- 172.21.15.31:0/3969121745 shutdown_connections 2023-11-27T17:53:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.597+0000 7ff63d978640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ff6180667f0 0x7ff618068cb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.597+0000 7ff63d978640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff63814eb60 0x7ff6381dd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.597+0000 7ff63d978640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff638145240 0x7ff63814c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.597+0000 7ff63d978640 1 --2- 172.21.15.31:0/3969121745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6380bd4a0 0x7ff6380b92d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.597+0000 7ff63d978640 1 -- 172.21.15.31:0/3969121745 >> 172.21.15.31:0/3969121745 conn(0x7ff63806ab60 msgr2=0x7ff6381436c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.597+0000 7ff63d978640 1 -- 172.21.15.31:0/3969121745 shutdown_connections 2023-11-27T17:53:17.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.597+0000 7ff63d978640 1 -- 172.21.15.31:0/3969121745 wait complete. 2023-11-27T17:53:17.617 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:53:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.721+0000 7f9dcd6bc640 1 Processor -- start 2023-11-27T17:53:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.721+0000 7f9dcd6bc640 1 -- start start 2023-11-27T17:53:17.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dcd6bc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9dc81454e0 0x7f9dc80b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dcd6bc640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc80b8d90 con 0x7f9dc814e880 2023-11-27T17:53:17.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dcd6bc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc80c1b70 con 0x7f9dc80b8440 2023-11-27T17:53:17.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dcd6bc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc80ba130 con 0x7f9dc81454e0 2023-11-27T17:53:17.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc67fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9dc814e880 0x7f9dc8144dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38186/0 (socket says 172.21.15.31:38186) 2023-11-27T17:53:17.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc67fc640 1 -- 172.21.15.31:0/3096933542 learned_addr learned my addr 172.21.15.31:0/3096933542 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:17.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc77fe640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9dc81454e0 0x7f9dc80b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506695977 0 0) 0x7f9dc80b8d90 con 0x7f9dc814e880 2023-11-27T17:53:17.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9db0003530 con 0x7f9dc814e880 2023-11-27T17:53:17.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 972674162 0 0) 0x7f9db0003530 con 0x7f9dc814e880 2023-11-27T17:53:17.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9dc81454e0 msgr2=0x7f9dc80b9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:17.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9dc81454e0 0x7f9dc80b9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 >> v1:172.21.15.81:6789/0 conn(0x7f9dc80b8440 legacy=0x7f9dc80bcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc806be20 con 0x7f9dc814e880 2023-11-27T17:53:17.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f9dbc001680 con 0x7f9dc814e880 2023-11-27T17:53:17.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 >> v1:172.21.15.31:6789/0 conn(0x7f9dc814e880 legacy=0x7f9dc8144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db0003a20 0x7f9db0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9db00047d0 0x7f9db0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9db00051e0 0x7f9db000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db000c060 con 0x7f9db00047d0 2023-11-27T17:53:17.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db000c1d0 con 0x7f9db0003a20 2023-11-27T17:53:17.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db000c390 con 0x7f9db00051e0 2023-11-27T17:53:17.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc77fe640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9dc81454e0 0x7f9dc80b9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:17.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc67fc640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9db00047d0 0x7f9db0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc6ffd640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db0003a20 0x7f9db0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc67fc640 1 -- 172.21.15.31:0/3096933542 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9db00051e0 msgr2=0x7f9db000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:17.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc67fc640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9db00051e0 0x7f9db000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc67fc640 1 -- 172.21.15.31:0/3096933542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db0003a20 msgr2=0x7f9db0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:17.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc67fc640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db0003a20 0x7f9db0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc67fc640 1 -- 172.21.15.31:0/3096933542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db0003530 con 0x7f9db00047d0 2023-11-27T17:53:17.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc6ffd640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9db0003a20 0x7f9db0003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:17.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.725+0000 7f9dc67fc640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9db00047d0 0x7f9db0004c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00c240 tx=0x7f9dbc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a81ffc62f9f65 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:17.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0a5b40 con 0x7f9db00047d0 2023-11-27T17:53:17.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc0a5ca0 con 0x7f9db00047d0 2023-11-27T17:53:17.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc5ffb640 1 -- 172.21.15.31:0/3096933542 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc005b20 con 0x7f9db00047d0 2023-11-27T17:53:17.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3096933542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9db00047d0 msgr2=0x7f9db0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 --2- 172.21.15.31:0/3096933542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9db00047d0 0x7f9db0004c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00c240 tx=0x7f9dbc01cc40 comp rx=0 tx=0).stop 2023-11-27T17:53:17.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc77fe640 1 -- 172.21.15.31:0/3096933542 reap_dead start 2023-11-27T17:53:17.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3096933542 shutdown_connections 2023-11-27T17:53:17.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3096933542 >> 172.21.15.31:0/3096933542 conn(0x7f9dc80c0ce0 msgr2=0x7f9dc80c10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:17.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3096933542 shutdown_connections 2023-11-27T17:53:17.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3096933542 wait complete. 2023-11-27T17:53:17.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 Processor -- start 2023-11-27T17:53:17.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 -- start start 2023-11-27T17:53:17.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9db00047d0 0x7f9dc81492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc80c0060 0x7f9dc8149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dc814a0a0 0x7f9dc8137130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.738 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc81497e0 con 0x7f9dc814a0a0 2023-11-27T17:53:17.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc814bb20 con 0x7f9dc80c0060 2023-11-27T17:53:17.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc814dd90 con 0x7f9db00047d0 2023-11-27T17:53:17.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc77fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dc814a0a0 0x7f9dc8137130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc77fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dc814a0a0 0x7f9dc8137130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55486/0 (socket says 172.21.15.31:55486) 2023-11-27T17:53:17.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc77fe640 1 -- 172.21.15.31:0/3238098087 learned_addr learned my addr 172.21.15.31:0/3238098087 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:17.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc67fc640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc80c0060 0x7f9dc8149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc6ffd640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9db00047d0 0x7f9dc81492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc77fe640 1 -- 172.21.15.31:0/3238098087 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9db00047d0 msgr2=0x7f9dc81492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc77fe640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9db00047d0 0x7f9dc81492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc77fe640 1 -- 172.21.15.31:0/3238098087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc80c0060 msgr2=0x7f9dc8149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc77fe640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc80c0060 0x7f9dc8149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc77fe640 1 -- 172.21.15.31:0/3238098087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc81e0ce0 con 0x7f9dc814a0a0 2023-11-27T17:53:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dc77fe640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dc814a0a0 0x7f9dc8137130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9dc81458c0 tx=0x7f9dc000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9daf7fe640 1 -- 172.21.15.31:0/3238098087 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000dcb0 con 0x7f9dc814a0a0 2023-11-27T17:53:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9daf7fe640 1 -- 172.21.15.31:0/3238098087 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc000f040 con 0x7f9dc814a0a0 2023-11-27T17:53:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3238098087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc814e180 con 0x7f9dc814a0a0 2023-11-27T17:53:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9daf7fe640 1 -- 172.21.15.31:0/3238098087 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00039a0 con 0x7f9dc814a0a0 2023-11-27T17:53:17.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.729+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3238098087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc81e1210 con 0x7f9dc814a0a0 2023-11-27T17:53:17.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.733+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3238098087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc804e850 con 0x7f9dc814a0a0 2023-11-27T17:53:17.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.733+0000 7f9daf7fe640 1 -- 172.21.15.31:0/3238098087 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9dc0003b00 con 0x7f9dc814a0a0 2023-11-27T17:53:17.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.733+0000 7f9daf7fe640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9db40667f0 0x7f9db4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:17.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.733+0000 7f9dc6ffd640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9db40667f0 0x7f9db4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:17.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.733+0000 7f9daf7fe640 1 -- 172.21.15.31:0/3238098087 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9dc0083e80 con 0x7f9dc814a0a0 2023-11-27T17:53:17.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.733+0000 7f9dc6ffd640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9db40667f0 0x7f9db4068cb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9db8001760 tx=0x7f9db8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:17.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.737+0000 7f9daf7fe640 1 -- 172.21.15.31:0/3238098087 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9dc00512d0 con 0x7f9dc814a0a0 2023-11-27T17:53:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.917+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3238098087 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9dc80bc7a0 con 0x7f9dc814a0a0 2023-11-27T17:53:17.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.917+0000 7f9daf7fe640 1 -- 172.21.15.31:0/3238098087 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f9dc001a540 con 0x7f9dc814a0a0 2023-11-27T17:53:17.921 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:17.921 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/1250401972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1250401972},{"type":"v1","addr":"172.21.15.31:6836","nonce":1250401972}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-27T17:53:17.922 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 2 2023-11-27T17:53:17.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.921+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3238098087 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9db40667f0 msgr2=0x7f9db4068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.921+0000 7f9dcd6bc640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9db40667f0 0x7f9db4068cb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9db8001760 tx=0x7f9db8009040 comp rx=0 tx=0).stop 2023-11-27T17:53:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.921+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3238098087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dc814a0a0 msgr2=0x7f9dc8137130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.921+0000 7f9dcd6bc640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dc814a0a0 0x7f9dc8137130 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9dc81458c0 tx=0x7f9dc000d4a0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.921+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3238098087 shutdown_connections 2023-11-27T17:53:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.921+0000 7f9dcd6bc640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9db40667f0 0x7f9db4068cb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.921+0000 7f9dcd6bc640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dc814a0a0 0x7f9dc8137130 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.921+0000 7f9dcd6bc640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9dc80c0060 0x7f9dc8149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.921+0000 7f9dcd6bc640 1 --2- 172.21.15.31:0/3238098087 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9db00047d0 0x7f9dc81492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.921+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3238098087 >> 172.21.15.31:0/3238098087 conn(0x7f9dc80c0ce0 msgr2=0x7f9dc8143840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:17.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.921+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3238098087 shutdown_connections 2023-11-27T17:53:17.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:17.921+0000 7f9dcd6bc640 1 -- 172.21.15.31:0/3238098087 wait complete. 2023-11-27T17:53:19.940 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:53:20.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.069+0000 7f51459ca640 1 Processor -- start 2023-11-27T17:53:20.075 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.069+0000 7f51459ca640 1 -- start start 2023-11-27T17:53:20.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f51459ca640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f51401430a0 0x7f51400b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f51459ca640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f51400bd680 0x7f5140153980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f51459ca640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51400b5d00 con 0x7f51400bd240 2023-11-27T17:53:20.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f51459ca640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5140143750 con 0x7f51400bd680 2023-11-27T17:53:20.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f51459ca640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5140143480 con 0x7f51401430a0 2023-11-27T17:53:20.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513f7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f51400bd680 0x7f5140153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513f7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f51400bd680 0x7f5140153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55500/0 (socket says 172.21.15.31:55500) 2023-11-27T17:53:20.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513f7fe640 1 -- 172.21.15.31:0/882348958 learned_addr learned my addr 172.21.15.31:0/882348958 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:20.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513effd640 1 --2- 172.21.15.31:0/882348958 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f51401430a0 0x7f51400b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513f7fe640 1 -- 172.21.15.31:0/882348958 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f51401430a0 msgr2=0x7f51400b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:20.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513f7fe640 1 --2- 172.21.15.31:0/882348958 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f51401430a0 0x7f51400b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513f7fe640 1 -- 172.21.15.31:0/882348958 >> v1:172.21.15.81:6789/0 conn(0x7f51400bd240 legacy=0x7f5140149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:20.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513f7fe640 1 -- 172.21.15.31:0/882348958 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400b4f40 con 0x7f51400bd680 2023-11-27T17:53:20.079 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513effd640 1 --2- 172.21.15.31:0/882348958 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f51401430a0 0x7f51400b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:20.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513f7fe640 1 --2- 172.21.15.31:0/882348958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51400bd680 0x7f5140153980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5138009870 tx=0x7f513801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c072b0ac5485e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513dffb640 1 -- 172.21.15.31:0/882348958 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380a89b0 con 0x7f51400bd680 2023-11-27T17:53:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513dffb640 1 -- 172.21.15.31:0/882348958 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51380a8b10 con 0x7f51400bd680 2023-11-27T17:53:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.073+0000 7f513dffb640 1 -- 172.21.15.31:0/882348958 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380a8ea0 con 0x7f51400bd680 2023-11-27T17:53:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 -- 172.21.15.31:0/882348958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51400bd680 msgr2=0x7f5140153980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 --2- 172.21.15.31:0/882348958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51400bd680 0x7f5140153980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5138009870 tx=0x7f513801ecf0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 -- 172.21.15.31:0/882348958 shutdown_connections 2023-11-27T17:53:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 --2- 172.21.15.31:0/882348958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51400bd680 0x7f5140153980 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 --2- 172.21.15.31:0/882348958 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f51401430a0 0x7f51400b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 -- 172.21.15.31:0/882348958 >> 172.21.15.31:0/882348958 conn(0x7f514006ab60 msgr2=0x7f51400bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 -- 172.21.15.31:0/882348958 shutdown_connections 2023-11-27T17:53:20.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 -- 172.21.15.31:0/882348958 wait complete. 2023-11-27T17:53:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 Processor -- start 2023-11-27T17:53:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 -- start start 2023-11-27T17:53:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f51400bd240 0x7f5140070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51400bd680 0x7f514006fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51401430a0 0x7f5140145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5140070b30 con 0x7f51401430a0 2023-11-27T17:53:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5140070380 con 0x7f51400bd680 2023-11-27T17:53:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514006f800 con 0x7f51400bd240 2023-11-27T17:53:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f513f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51401430a0 0x7f5140145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f513f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51401430a0 0x7f5140145a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55506/0 (socket says 172.21.15.31:55506) 2023-11-27T17:53:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f513f7fe640 1 -- 172.21.15.31:0/2500551241 learned_addr learned my addr 172.21.15.31:0/2500551241 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:20.085 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f513effd640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f51400bd240 0x7f5140070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f513e7fc640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51400bd680 0x7f514006fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f513f7fe640 1 -- 172.21.15.31:0/2500551241 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f51400bd240 msgr2=0x7f5140070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f513f7fe640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f51400bd240 0x7f5140070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f513f7fe640 1 -- 172.21.15.31:0/2500551241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51400bd680 msgr2=0x7f514006fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f513f7fe640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51400bd680 0x7f514006fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f513f7fe640 1 -- 172.21.15.31:0/2500551241 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380094d0 con 0x7f51401430a0 2023-11-27T17:53:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f513f7fe640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51401430a0 0x7f5140145a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f513801d3a0 tx=0x7f513801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f5127fff640 1 -- 172.21.15.31:0/2500551241 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380b0e20 con 0x7f51401430a0 2023-11-27T17:53:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f5127fff640 1 -- 172.21.15.31:0/2500551241 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51380bb480 con 0x7f51401430a0 2023-11-27T17:53:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 -- 172.21.15.31:0/2500551241 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5140072370 con 0x7f51401430a0 2023-11-27T17:53:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f5127fff640 1 -- 172.21.15.31:0/2500551241 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380bb810 con 0x7f51401430a0 2023-11-27T17:53:20.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.077+0000 7f51459ca640 1 -- 172.21.15.31:0/2500551241 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514006fa10 con 0x7f51401430a0 2023-11-27T17:53:20.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.081+0000 7f51459ca640 1 -- 172.21.15.31:0/2500551241 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514004e850 con 0x7f51401430a0 2023-11-27T17:53:20.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.081+0000 7f5127fff640 1 -- 172.21.15.31:0/2500551241 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f51380bb970 con 0x7f51401430a0 2023-11-27T17:53:20.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.081+0000 7f5127fff640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f512c0667f0 0x7f512c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.081+0000 7f5127fff640 1 -- 172.21.15.31:0/2500551241 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5138122500 con 0x7f51401430a0 2023-11-27T17:53:20.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.081+0000 7f513effd640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f512c0667f0 0x7f512c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.081+0000 7f513effd640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f512c0667f0 0x7f512c068cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5130006fd0 tx=0x7f5130008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:20.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.085+0000 7f5127fff640 1 -- 172.21.15.31:0/2500551241 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f51380efa70 con 0x7f51401430a0 2023-11-27T17:53:20.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.273+0000 7f51459ca640 1 -- 172.21.15.31:0/2500551241 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51400b5d00 con 0x7f51401430a0 2023-11-27T17:53:20.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f5127fff640 1 -- 172.21.15.31:0/2500551241 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2898 (secure 0 0 0) 0x7f51400b5d00 con 0x7f51401430a0 2023-11-27T17:53:20.280 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:20.280 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/1250401972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1250401972},{"type":"v1","addr":"172.21.15.31:6836","nonce":1250401972}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1133939246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1133939246},{"type":"v1","addr":"172.21.15.31:6837","nonce":1133939246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/88283146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":88283146},{"type":"v1","addr":"172.21.15.81:6833","nonce":88283146}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-27T17:53:20.280 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 3 2023-11-27T17:53:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f51459ca640 1 -- 172.21.15.31:0/2500551241 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f512c0667f0 msgr2=0x7f512c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f51459ca640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f512c0667f0 0x7f512c068cb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5130006fd0 tx=0x7f5130008040 comp rx=0 tx=0).stop 2023-11-27T17:53:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f51459ca640 1 -- 172.21.15.31:0/2500551241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51401430a0 msgr2=0x7f5140145a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f51459ca640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51401430a0 0x7f5140145a00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f513801d3a0 tx=0x7f513801ba90 comp rx=0 tx=0).stop 2023-11-27T17:53:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f51459ca640 1 -- 172.21.15.31:0/2500551241 shutdown_connections 2023-11-27T17:53:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f51459ca640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f512c0667f0 0x7f512c068cb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f51459ca640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f51401430a0 0x7f5140145a00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f51459ca640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51400bd680 0x7f514006fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f51459ca640 1 --2- 172.21.15.31:0/2500551241 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f51400bd240 0x7f5140070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f51459ca640 1 -- 172.21.15.31:0/2500551241 >> 172.21.15.31:0/2500551241 conn(0x7f514006ab60 msgr2=0x7f51400bc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:20.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f51459ca640 1 -- 172.21.15.31:0/2500551241 shutdown_connections 2023-11-27T17:53:20.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.277+0000 7f51459ca640 1 -- 172.21.15.31:0/2500551241 wait complete. 2023-11-27T17:53:20.298 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:20.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280cab0640 1 Processor -- start 2023-11-27T17:53:20.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280cab0640 1 -- start start 2023-11-27T17:53:20.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280cab0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28080b8440 0x7f280814e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280cab0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2808144dd0 0x7f2808145260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280cab0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28080b8d90 con 0x7f28080b9220 2023-11-27T17:53:20.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280cab0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28080ba130 con 0x7f28080b8440 2023-11-27T17:53:20.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280cab0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280806bc10 con 0x7f2808144dd0 2023-11-27T17:53:20.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280659c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28080b8440 0x7f280814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280659c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28080b8440 0x7f280814e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55510/0 (socket says 172.21.15.31:55510) 2023-11-27T17:53:20.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280659c640 1 -- 172.21.15.31:0/3571673 learned_addr learned my addr 172.21.15.31:0/3571673 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:20.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f2806d9d640 1 --2- 172.21.15.31:0/3571673 >> v2:172.21.15.81:3300/0 conn(0x7f2808144dd0 0x7f2808145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280659c640 1 -- 172.21.15.31:0/3571673 >> v2:172.21.15.81:3300/0 conn(0x7f2808144dd0 msgr2=0x7f2808145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:20.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280659c640 1 --2- 172.21.15.31:0/3571673 >> v2:172.21.15.81:3300/0 conn(0x7f2808144dd0 0x7f2808145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280659c640 1 -- 172.21.15.31:0/3571673 >> v1:172.21.15.81:6789/0 conn(0x7f28080b9220 legacy=0x7f28080bcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.417+0000 7f280659c640 1 -- 172.21.15.31:0/3571673 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28081457a0 con 0x7f28080b8440 2023-11-27T17:53:20.423 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280659c640 1 --2- 172.21.15.31:0/3571673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28080b8440 0x7f280814e880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2808148e60 tx=0x7f27f801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e7f844a11987ca server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:20.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280559a640 1 -- 172.21.15.31:0/3571673 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f80a89f0 con 0x7f28080b8440 2023-11-27T17:53:20.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280559a640 1 -- 172.21.15.31:0/3571673 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f80a8b50 con 0x7f28080b8440 2023-11-27T17:53:20.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280559a640 1 -- 172.21.15.31:0/3571673 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f80b0440 con 0x7f28080b8440 2023-11-27T17:53:20.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 -- 172.21.15.31:0/3571673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28080b8440 msgr2=0x7f280814e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 --2- 172.21.15.31:0/3571673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28080b8440 0x7f280814e880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2808148e60 tx=0x7f27f801ecf0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 -- 172.21.15.31:0/3571673 shutdown_connections 2023-11-27T17:53:20.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 --2- 172.21.15.31:0/3571673 >> v2:172.21.15.81:3300/0 conn(0x7f2808144dd0 0x7f2808145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 --2- 172.21.15.31:0/3571673 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28080b8440 0x7f280814e880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 -- 172.21.15.31:0/3571673 >> 172.21.15.31:0/3571673 conn(0x7f28080c0ce0 msgr2=0x7f28080c10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:20.425 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 -- 172.21.15.31:0/3571673 shutdown_connections 2023-11-27T17:53:20.426 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 -- 172.21.15.31:0/3571673 wait complete. 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 Processor -- start 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 -- start start 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f28080b8440 0x7f2808139050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28080b9220 0x7f28081e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808144dd0 0x7f28081e4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280813a7f0 con 0x7f28080b9220 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28081e3f70 con 0x7f2808144dd0 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f280cab0640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28081e2070 con 0x7f28080b8440 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f2805d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28080b9220 0x7f28081e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f2805d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28080b9220 0x7f28081e43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55518/0 (socket says 172.21.15.31:55518) 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.421+0000 7f2805d9b640 1 -- 172.21.15.31:0/3423751156 learned_addr learned my addr 172.21.15.31:0/3423751156 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f2806d9d640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808144dd0 0x7f28081e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.428 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f280659c640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f28080b8440 0x7f2808139050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f2805d9b640 1 -- 172.21.15.31:0/3423751156 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f28080b8440 msgr2=0x7f2808139050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f2805d9b640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f28080b8440 0x7f2808139050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f2805d9b640 1 -- 172.21.15.31:0/3423751156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808144dd0 msgr2=0x7f28081e4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f2805d9b640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808144dd0 0x7f28081e4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f2805d9b640 1 -- 172.21.15.31:0/3423751156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f80094d0 con 0x7f28080b9220 2023-11-27T17:53:20.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f2805d9b640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28080b9220 0x7f28081e43d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27f000c820 tx=0x7f27f000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:20.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f27feffd640 1 -- 172.21.15.31:0/3423751156 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0003b80 con 0x7f28080b9220 2023-11-27T17:53:20.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f27feffd640 1 -- 172.21.15.31:0/3423751156 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0003ce0 con 0x7f28080b9220 2023-11-27T17:53:20.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f280cab0640 1 -- 172.21.15.31:0/3423751156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280814be80 con 0x7f28080b9220 2023-11-27T17:53:20.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f27feffd640 1 -- 172.21.15.31:0/3423751156 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000aa90 con 0x7f28080b9220 2023-11-27T17:53:20.429 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f280cab0640 1 -- 172.21.15.31:0/3423751156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2808149100 con 0x7f28080b9220 2023-11-27T17:53:20.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f280cab0640 1 -- 172.21.15.31:0/3423751156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280813a960 con 0x7f28080b9220 2023-11-27T17:53:20.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f27feffd640 1 -- 172.21.15.31:0/3423751156 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f27f000abf0 con 0x7f28080b9220 2023-11-27T17:53:20.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f27feffd640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f27e80667f0 0x7f27e8068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f27feffd640 1 -- 172.21.15.31:0/3423751156 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f27f0083e30 con 0x7f28080b9220 2023-11-27T17:53:20.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f280659c640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f27e80667f0 0x7f27e8068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.431 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.425+0000 7f280659c640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f27e80667f0 0x7f27e8068cb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27f80b2000 tx=0x7f27f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:20.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.429+0000 7f27feffd640 1 -- 172.21.15.31:0/3423751156 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f280813a960 con 0x7f28080b9220 2023-11-27T17:53:20.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.581+0000 7f280cab0640 1 -- 172.21.15.31:0/3423751156 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f280813a930 con 0x7f28080b9220 2023-11-27T17:53:20.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f27feffd640 1 -- 172.21.15.31:0/3423751156 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12779 (secure 0 0 0) 0x7f27f0059e60 con 0x7f28080b9220 2023-11-27T17:53:20.588 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:20.588 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":16,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:13.513861+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f280cab0640 1 -- 172.21.15.31:0/3423751156 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f27e80667f0 msgr2=0x7f27e8068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f280cab0640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f27e80667f0 0x7f27e8068cb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27f80b2000 tx=0x7f27f8008040 comp rx=0 tx=0).stop 2023-11-27T17:53:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f280cab0640 1 -- 172.21.15.31:0/3423751156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28080b9220 msgr2=0x7f28081e43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f280cab0640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28080b9220 0x7f28081e43d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f27f000c820 tx=0x7f27f000cce0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f280cab0640 1 -- 172.21.15.31:0/3423751156 shutdown_connections 2023-11-27T17:53:20.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f280cab0640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f27e80667f0 0x7f27e8068cb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f280cab0640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2808144dd0 0x7f28081e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f280cab0640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28080b9220 0x7f28081e43d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f280cab0640 1 --2- 172.21.15.31:0/3423751156 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f28080b8440 0x7f2808139050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f280cab0640 1 -- 172.21.15.31:0/3423751156 >> 172.21.15.31:0/3423751156 conn(0x7f28080c0ce0 msgr2=0x7f28080bacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:20.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f280cab0640 1 -- 172.21.15.31:0/3423751156 shutdown_connections 2023-11-27T17:53:20.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.585+0000 7f280cab0640 1 -- 172.21.15.31:0/3423751156 wait complete. 2023-11-27T17:53:20.605 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:53:11.177026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:53:20.606 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:53:20.721 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a9bb8640 1 Processor -- start 2023-11-27T17:53:20.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a9bb8640 1 -- start start 2023-11-27T17:53:20.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a9bb8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f96a40b6a70 0x7f96a40b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a9bb8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96a41420f0 0x7f96a4142510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a9bb8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96a4148470 0x7f96a41488c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a9bb8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a406f630 con 0x7f96a40b6a70 2023-11-27T17:53:20.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a9bb8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a40b8640 con 0x7f96a4148470 2023-11-27T17:53:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a9bb8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40b63e0 con 0x7f96a41420f0 2023-11-27T17:53:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f96a40b6a70 0x7f96a40b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f96a40b6a70 0x7f96a40b5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55526/0 (socket says 172.21.15.31:55526) 2023-11-27T17:53:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a37fe640 1 -- 172.21.15.31:0/1150956178 learned_addr learned my addr 172.21.15.31:0/1150956178 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a2ffd640 1 --2- 172.21.15.31:0/1150956178 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96a41420f0 0x7f96a4142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a3fff640 1 --2- 172.21.15.31:0/1150956178 >> v2:172.21.15.81:3300/0 conn(0x7f96a4148470 0x7f96a41488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a37fe640 1 -- 172.21.15.31:0/1150956178 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96a41420f0 msgr2=0x7f96a4142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a37fe640 1 --2- 172.21.15.31:0/1150956178 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96a41420f0 0x7f96a4142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a37fe640 1 -- 172.21.15.31:0/1150956178 >> v2:172.21.15.81:3300/0 conn(0x7f96a4148470 msgr2=0x7f96a41488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:20.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a37fe640 1 --2- 172.21.15.31:0/1150956178 >> v2:172.21.15.81:3300/0 conn(0x7f96a4148470 0x7f96a41488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.717+0000 7f96a37fe640 1 -- 172.21.15.31:0/1150956178 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a4148e00 con 0x7f96a40b6a70 2023-11-27T17:53:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a37fe640 1 --2- 172.21.15.31:0/1150956178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a40b6a70 0x7f96a40b5ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f96a40ba9c0 tx=0x7f969401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124de0422444ed81 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:20.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a27fc640 1 -- 172.21.15.31:0/1150956178 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940aa5f0 con 0x7f96a40b6a70 2023-11-27T17:53:20.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a27fc640 1 -- 172.21.15.31:0/1150956178 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96940aa750 con 0x7f96a40b6a70 2023-11-27T17:53:20.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a27fc640 1 -- 172.21.15.31:0/1150956178 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940aaae0 con 0x7f96a40b6a70 2023-11-27T17:53:20.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a9bb8640 1 -- 172.21.15.31:0/1150956178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a40b6a70 msgr2=0x7f96a40b5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a9bb8640 1 --2- 172.21.15.31:0/1150956178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a40b6a70 0x7f96a40b5ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f96a40ba9c0 tx=0x7f969401c4d0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a9bb8640 1 -- 172.21.15.31:0/1150956178 shutdown_connections 2023-11-27T17:53:20.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a9bb8640 1 --2- 172.21.15.31:0/1150956178 >> v2:172.21.15.81:3300/0 conn(0x7f96a4148470 0x7f96a41488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a9bb8640 1 --2- 172.21.15.31:0/1150956178 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96a41420f0 0x7f96a4142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a9bb8640 1 --2- 172.21.15.31:0/1150956178 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a40b6a70 0x7f96a40b5ea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a9bb8640 1 -- 172.21.15.31:0/1150956178 >> 172.21.15.31:0/1150956178 conn(0x7f96a406ab60 msgr2=0x7f96a40bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:20.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a9bb8640 1 -- 172.21.15.31:0/1150956178 shutdown_connections 2023-11-27T17:53:20.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.721+0000 7f96a9bb8640 1 -- 172.21.15.31:0/1150956178 wait complete. 2023-11-27T17:53:20.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a9bb8640 1 Processor -- start 2023-11-27T17:53:20.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a9bb8640 1 -- start start 2023-11-27T17:53:20.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a9bb8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a40b6a70 0x7f96a413c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a9bb8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96a41420f0 0x7f96a4149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a9bb8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4148470 0x7f96a414a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a9bb8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a413b190 con 0x7f96a4148470 2023-11-27T17:53:20.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a9bb8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a413ca80 con 0x7f96a40b6a70 2023-11-27T17:53:20.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a9bb8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a413e940 con 0x7f96a41420f0 2023-11-27T17:53:20.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4148470 0x7f96a414a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4148470 0x7f96a414a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55530/0 (socket says 172.21.15.31:55530) 2023-11-27T17:53:20.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a3fff640 1 -- 172.21.15.31:0/330714197 learned_addr learned my addr 172.21.15.31:0/330714197 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a37fe640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a40b6a70 0x7f96a413c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a2ffd640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96a41420f0 0x7f96a4149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a3fff640 1 -- 172.21.15.31:0/330714197 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96a41420f0 msgr2=0x7f96a4149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a3fff640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96a41420f0 0x7f96a4149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a3fff640 1 -- 172.21.15.31:0/330714197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a40b6a70 msgr2=0x7f96a413c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a3fff640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a40b6a70 0x7f96a413c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a3fff640 1 -- 172.21.15.31:0/330714197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96940094d0 con 0x7f96a4148470 2023-11-27T17:53:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a3fff640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4148470 0x7f96a414a0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f969c00d560 tx=0x7f969c00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f969bfff640 1 -- 172.21.15.31:0/330714197 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c0125f0 con 0x7f96a4148470 2023-11-27T17:53:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f969bfff640 1 -- 172.21.15.31:0/330714197 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c012770 con 0x7f96a4148470 2023-11-27T17:53:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f969bfff640 1 -- 172.21.15.31:0/330714197 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c012b20 con 0x7f96a4148470 2023-11-27T17:53:20.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a9bb8640 1 -- 172.21.15.31:0/330714197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a414b170 con 0x7f96a4148470 2023-11-27T17:53:20.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a9bb8640 1 -- 172.21.15.31:0/330714197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a414b410 con 0x7f96a4148470 2023-11-27T17:53:20.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a9bb8640 1 -- 172.21.15.31:0/330714197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a40b9330 con 0x7f96a4148470 2023-11-27T17:53:20.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f969bfff640 1 -- 172.21.15.31:0/330714197 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f969c012c80 con 0x7f96a4148470 2023-11-27T17:53:20.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f969bfff640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f96840667f0 0x7f9684068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:20.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f969bfff640 1 -- 172.21.15.31:0/330714197 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f969c0842b0 con 0x7f96a4148470 2023-11-27T17:53:20.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.725+0000 7f96a37fe640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f96840667f0 0x7f9684068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:20.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.729+0000 7f96a37fe640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f96840667f0 0x7f9684068cb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f96940ae000 tx=0x7f96940a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:20.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.729+0000 7f969bfff640 1 -- 172.21.15.31:0/330714197 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f969c051790 con 0x7f96a4148470 2023-11-27T17:53:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.885+0000 7f96a9bb8640 1 -- 172.21.15.31:0/330714197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96a404e850 con 0x7f96a4148470 2023-11-27T17:53:20.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.885+0000 7f969bfff640 1 -- 172.21.15.31:0/330714197 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f969c054db0 con 0x7f96a4148470 2023-11-27T17:53:20.890 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-11-27T17:53:20.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.889+0000 7f96a9bb8640 1 -- 172.21.15.31:0/330714197 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f96840667f0 msgr2=0x7f9684068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.889+0000 7f96a9bb8640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f96840667f0 0x7f9684068cb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f96940ae000 tx=0x7f96940a7000 comp rx=0 tx=0).stop 2023-11-27T17:53:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.889+0000 7f96a9bb8640 1 -- 172.21.15.31:0/330714197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4148470 msgr2=0x7f96a414a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.889+0000 7f96a9bb8640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4148470 0x7f96a414a0f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f969c00d560 tx=0x7f969c00da20 comp rx=0 tx=0).stop 2023-11-27T17:53:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.889+0000 7f96a9bb8640 1 -- 172.21.15.31:0/330714197 shutdown_connections 2023-11-27T17:53:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.889+0000 7f96a9bb8640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f96840667f0 0x7f9684068cb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.889+0000 7f96a9bb8640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4148470 0x7f96a414a0f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.889+0000 7f96a9bb8640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f96a41420f0 0x7f96a4149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.889+0000 7f96a9bb8640 1 --2- 172.21.15.31:0/330714197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96a40b6a70 0x7f96a413c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.889+0000 7f96a9bb8640 1 -- 172.21.15.31:0/330714197 >> 172.21.15.31:0/330714197 conn(0x7f96a406ab60 msgr2=0x7f96a40b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.889+0000 7f96a9bb8640 1 -- 172.21.15.31:0/330714197 shutdown_connections 2023-11-27T17:53:20.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:20.889+0000 7f96a9bb8640 1 -- 172.21.15.31:0/330714197 wait complete. 2023-11-27T17:53:20.908 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T17:53:21.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.025+0000 7f011b253640 1 Processor -- start 2023-11-27T17:53:21.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.025+0000 7f011b253640 1 -- start start 2023-11-27T17:53:21.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f011b253640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f01140726e0 0x7f01141480c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f011b253640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01140b5460 con 0x7f0114148600 2023-11-27T17:53:21.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f011b253640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01140b3650 con 0x7f01140b20e0 2023-11-27T17:53:21.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f011b253640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01140b38b0 con 0x7f01140726e0 2023-11-27T17:53:21.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f0113fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0114148600 0x7f01140b60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38194/0 (socket says 172.21.15.31:38194) 2023-11-27T17:53:21.032 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f0113fff640 1 -- 172.21.15.31:0/1045231739 learned_addr learned my addr 172.21.15.31:0/1045231739 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:21.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178130583 0 0) 0x7f01140b5460 con 0x7f0114148600 2023-11-27T17:53:21.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00fc004640 con 0x7f0114148600 2023-11-27T17:53:21.034 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f0118fef640 1 --2- 172.21.15.31:0/1045231739 >> v2:172.21.15.81:3300/0 conn(0x7f01140726e0 0x7f01141480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3368199447 0 0) 0x7f00fc004640 con 0x7f0114148600 2023-11-27T17:53:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 >> v2:172.21.15.81:3300/0 conn(0x7f01140726e0 msgr2=0x7f01141480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 --2- 172.21.15.31:0/1045231739 >> v2:172.21.15.81:3300/0 conn(0x7f01140726e0 0x7f01141480c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 >> v1:172.21.15.81:6789/0 conn(0x7f01140b20e0 legacy=0x7f0114152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01140b3b90 con 0x7f0114148600 2023-11-27T17:53:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f0108001680 con 0x7f0114148600 2023-11-27T17:53:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 >> v1:172.21.15.31:6789/0 conn(0x7f0114148600 legacy=0x7f01140b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00fc004b00 0x7f00fc004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc0058e0 0x7f00fc005d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f00fc0063c0 0x7f00fc003450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.035 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01140b38b0 con 0x7f00fc004b00 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc003d00 con 0x7f00fc0058e0 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00fc003e70 con 0x7f00fc0063c0 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f0118fef640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00fc004b00 0x7f00fc004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f0113fff640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc0058e0 0x7f00fc005d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01197f0640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f00fc0063c0 0x7f00fc003450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f0118fef640 1 -- 172.21.15.31:0/1045231739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f00fc0063c0 msgr2=0x7f00fc003450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f0118fef640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f00fc0063c0 0x7f00fc003450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f0118fef640 1 -- 172.21.15.31:0/1045231739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc0058e0 msgr2=0x7f00fc005d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f0118fef640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc0058e0 0x7f00fc005d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f0118fef640 1 -- 172.21.15.31:0/1045231739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00fc004640 con 0x7f00fc004b00 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f0113fff640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc0058e0 0x7f00fc005d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01197f0640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f00fc0063c0 0x7f00fc003450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:21.036 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.029+0000 7f01197f0640 1 -- 172.21.15.31:0/1045231739 reap_dead start 2023-11-27T17:53:21.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f0118fef640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00fc004b00 0x7f00fc004f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0104007360 tx=0x7f010401cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31daa58acbeab19e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:21.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040a5a80 con 0x7f00fc004b00 2023-11-27T17:53:21.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01040a5be0 con 0x7f00fc004b00 2023-11-27T17:53:21.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f01137fe640 1 -- 172.21.15.31:0/1045231739 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040ad440 con 0x7f00fc004b00 2023-11-27T17:53:21.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 -- 172.21.15.31:0/1045231739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00fc004b00 msgr2=0x7f00fc004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00fc004b00 0x7f00fc004f20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0104007360 tx=0x7f010401cdf0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 -- 172.21.15.31:0/1045231739 shutdown_connections 2023-11-27T17:53:21.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 --2- 172.21.15.31:0/1045231739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00fc004b00 0x7f00fc004f20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 -- 172.21.15.31:0/1045231739 >> 172.21.15.31:0/1045231739 conn(0x7f011406ab60 msgr2=0x7f01140bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:21.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 -- 172.21.15.31:0/1045231739 shutdown_connections 2023-11-27T17:53:21.038 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 -- 172.21.15.31:0/1045231739 wait complete. 2023-11-27T17:53:21.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 Processor -- start 2023-11-27T17:53:21.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 -- start start 2023-11-27T17:53:21.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc004b00 0x7f01140703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.040 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f011406f4a0 0x7f01141dfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01141e0010 0x7f011413bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01141d4ce0 con 0x7f011406f4a0 2023-11-27T17:53:21.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01141e0490 con 0x7f00fc004b00 2023-11-27T17:53:21.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f011b253640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f011406f900 con 0x7f01141e0010 2023-11-27T17:53:21.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f0113fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f011406f4a0 0x7f01141dfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f0113fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f011406f4a0 0x7f01141dfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55536/0 (socket says 172.21.15.31:55536) 2023-11-27T17:53:21.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f0113fff640 1 -- 172.21.15.31:0/1535182635 learned_addr learned my addr 172.21.15.31:0/1535182635 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:21.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f0118fef640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc004b00 0x7f01140703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f01197f0640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01141e0010 0x7f011413bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f0113fff640 1 -- 172.21.15.31:0/1535182635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01141e0010 msgr2=0x7f011413bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f0113fff640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01141e0010 0x7f011413bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.041 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f0113fff640 1 -- 172.21.15.31:0/1535182635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc004b00 msgr2=0x7f01140703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f0113fff640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc004b00 0x7f01140703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.033+0000 7f0113fff640 1 -- 172.21.15.31:0/1535182635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01141d35f0 con 0x7f011406f4a0 2023-11-27T17:53:21.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f0118fef640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc004b00 0x7f01140703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:21.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f0113fff640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f011406f4a0 0x7f01141dfad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0108007fd0 tx=0x7f010800dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:21.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f01117fa640 1 -- 172.21.15.31:0/1535182635 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01080074e0 con 0x7f011406f4a0 2023-11-27T17:53:21.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f01117fa640 1 -- 172.21.15.31:0/1535182635 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0108007640 con 0x7f011406f4a0 2023-11-27T17:53:21.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f011b253640 1 -- 172.21.15.31:0/1535182635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01141d4690 con 0x7f011406f4a0 2023-11-27T17:53:21.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f01117fa640 1 -- 172.21.15.31:0/1535182635 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108004a30 con 0x7f011406f4a0 2023-11-27T17:53:21.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f011b253640 1 -- 172.21.15.31:0/1535182635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0114141b30 con 0x7f011406f4a0 2023-11-27T17:53:21.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f011b253640 1 -- 172.21.15.31:0/1535182635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011404e850 con 0x7f011406f4a0 2023-11-27T17:53:21.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f01117fa640 1 -- 172.21.15.31:0/1535182635 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f0108004b90 con 0x7f011406f4a0 2023-11-27T17:53:21.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f01117fa640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0100066820 0x7f0100068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f01117fa640 1 -- 172.21.15.31:0/1535182635 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0108084140 con 0x7f011406f4a0 2023-11-27T17:53:21.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f0118fef640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0100066820 0x7f0100068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.037+0000 7f0118fef640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0100066820 0x7f0100068ce0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f01040af000 tx=0x7f010400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:21.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.041+0000 7f01117fa640 1 -- 172.21.15.31:0/1535182635 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f01080517b0 con 0x7f011406f4a0 2023-11-27T17:53:21.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.189+0000 7f011b253640 1 -- 172.21.15.31:0/1535182635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f01140b1e10 con 0x7f011406f4a0 2023-11-27T17:53:21.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.189+0000 7f01117fa640 1 -- 172.21.15.31:0/1535182635 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0108019090 con 0x7f011406f4a0 2023-11-27T17:53:21.195 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:21.195 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-11-27T17:53:21.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:53:21.195 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-11-27T17:53:21.195 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-11-27T17:53:21.195 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:53:21.195 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-11-27T17:53:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.193+0000 7f011b253640 1 -- 172.21.15.31:0/1535182635 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0100066820 msgr2=0x7f0100068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.193+0000 7f011b253640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0100066820 0x7f0100068ce0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f01040af000 tx=0x7f010400b040 comp rx=0 tx=0).stop 2023-11-27T17:53:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.193+0000 7f011b253640 1 -- 172.21.15.31:0/1535182635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f011406f4a0 msgr2=0x7f01141dfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.193+0000 7f011b253640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f011406f4a0 0x7f01141dfad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0108007fd0 tx=0x7f010800dc70 comp rx=0 tx=0).stop 2023-11-27T17:53:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.193+0000 7f011b253640 1 -- 172.21.15.31:0/1535182635 shutdown_connections 2023-11-27T17:53:21.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.193+0000 7f011b253640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0100066820 0x7f0100068ce0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.193+0000 7f011b253640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f01141e0010 0x7f011413bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.193+0000 7f011b253640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f011406f4a0 0x7f01141dfad0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.193+0000 7f011b253640 1 --2- 172.21.15.31:0/1535182635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00fc004b00 0x7f01140703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.193+0000 7f011b253640 1 -- 172.21.15.31:0/1535182635 >> 172.21.15.31:0/1535182635 conn(0x7f011406ab60 msgr2=0x7f01141d5600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.193+0000 7f011b253640 1 -- 172.21.15.31:0/1535182635 shutdown_connections 2023-11-27T17:53:21.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.193+0000 7f011b253640 1 -- 172.21.15.31:0/1535182635 wait complete. 2023-11-27T17:53:21.212 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-27T17:53:21.212 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-27T17:53:21.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.337+0000 7f618cb28640 1 Processor -- start 2023-11-27T17:53:21.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.337+0000 7f618cb28640 1 -- start start 2023-11-27T17:53:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.337+0000 7f618cb28640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61880b9ac0 0x7f61880b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.337+0000 7f618cb28640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f61880b6dd0 0x7f6188143220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.337+0000 7f618cb28640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61880b50f0 con 0x7f6188143760 2023-11-27T17:53:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.337+0000 7f618cb28640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61880b94d0 con 0x7f61880b6dd0 2023-11-27T17:53:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.337+0000 7f618cb28640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61880b53d0 con 0x7f61880b9ac0 2023-11-27T17:53:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.337+0000 7f6185d9b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f61880b6dd0 0x7f6188143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.337+0000 7f6186d9d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6188143760 0x7f618814c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38204/0 (socket says 172.21.15.31:38204) 2023-11-27T17:53:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.337+0000 7f6186d9d640 1 -- 172.21.15.31:0/1826931029 learned_addr learned my addr 172.21.15.31:0/1826931029 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:21.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.341+0000 7f618659c640 1 --2- 172.21.15.31:0/1826931029 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61880b9ac0 0x7f61880b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.341+0000 7f6185d9b640 1 -- 172.21.15.31:0/1826931029 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61880b9ac0 msgr2=0x7f61880b8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.341+0000 7f6185d9b640 1 --2- 172.21.15.31:0/1826931029 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61880b9ac0 0x7f61880b8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.341+0000 7f6185d9b640 1 -- 172.21.15.31:0/1826931029 >> v1:172.21.15.31:6789/0 conn(0x7f6188143760 legacy=0x7f618814c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.341+0000 7f618559a640 1 -- 172.21.15.31:0/1826931029 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166162948 0 0) 0x7f61880b50f0 con 0x7f6188143760 2023-11-27T17:53:21.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.341+0000 7f6185d9b640 1 -- 172.21.15.31:0/1826931029 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61880b56b0 con 0x7f61880b6dd0 2023-11-27T17:53:21.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.341+0000 7f6185d9b640 1 --2- 172.21.15.31:0/1826931029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61880b6dd0 0x7f6188143220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f617c0097c0 tx=0x7f617c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e33b6779178ac9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:21.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618559a640 1 -- 172.21.15.31:0/1826931029 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c0a8970 con 0x7f61880b6dd0 2023-11-27T17:53:21.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618559a640 1 -- 172.21.15.31:0/1826931029 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617c0a8ad0 con 0x7f61880b6dd0 2023-11-27T17:53:21.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618559a640 1 -- 172.21.15.31:0/1826931029 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c0a8e60 con 0x7f61880b6dd0 2023-11-27T17:53:21.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 -- 172.21.15.31:0/1826931029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61880b6dd0 msgr2=0x7f6188143220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 --2- 172.21.15.31:0/1826931029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61880b6dd0 0x7f6188143220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f617c0097c0 tx=0x7f617c01ec70 comp rx=0 tx=0).stop 2023-11-27T17:53:21.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 -- 172.21.15.31:0/1826931029 shutdown_connections 2023-11-27T17:53:21.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 --2- 172.21.15.31:0/1826931029 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61880b6dd0 0x7f6188143220 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 --2- 172.21.15.31:0/1826931029 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61880b9ac0 0x7f61880b8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 -- 172.21.15.31:0/1826931029 >> 172.21.15.31:0/1826931029 conn(0x7f618806a730 msgr2=0x7f618806ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:21.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 -- 172.21.15.31:0/1826931029 shutdown_connections 2023-11-27T17:53:21.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 -- 172.21.15.31:0/1826931029 wait complete. 2023-11-27T17:53:21.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 Processor -- start 2023-11-27T17:53:21.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 -- start start 2023-11-27T17:53:21.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61880b6dd0 0x7f61880bbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61880b9ac0 0x7f618813ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6188143760 0x7f61880bc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618813b0b0 con 0x7f61880b6dd0 2023-11-27T17:53:21.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61880bd860 con 0x7f61880b9ac0 2023-11-27T17:53:21.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61880bae40 con 0x7f6188143760 2023-11-27T17:53:21.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61880b6dd0 0x7f61880bbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61880b6dd0 0x7f61880bbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55548/0 (socket says 172.21.15.31:55548) 2023-11-27T17:53:21.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618659c640 1 -- 172.21.15.31:0/562676505 learned_addr learned my addr 172.21.15.31:0/562676505 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:21.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f6186d9d640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6188143760 0x7f61880bc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f6185d9b640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61880b9ac0 0x7f618813ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618659c640 1 -- 172.21.15.31:0/562676505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6188143760 msgr2=0x7f61880bc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618659c640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6188143760 0x7f61880bc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618659c640 1 -- 172.21.15.31:0/562676505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61880b9ac0 msgr2=0x7f618813ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618659c640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61880b9ac0 0x7f618813ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618659c640 1 -- 172.21.15.31:0/562676505 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c009420 con 0x7f61880b6dd0 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f6186d9d640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6188143760 0x7f61880bc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f6185d9b640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61880b9ac0 0x7f618813ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618659c640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61880b6dd0 0x7f61880bbab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f617800d800 tx=0x7f617800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f6176ffd640 1 -- 172.21.15.31:0/562676505 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617800b6c0 con 0x7f61880b6dd0 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f6176ffd640 1 -- 172.21.15.31:0/562676505 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617800b820 con 0x7f61880b6dd0 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f6176ffd640 1 -- 172.21.15.31:0/562676505 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617800bb90 con 0x7f61880b6dd0 2023-11-27T17:53:21.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.345+0000 7f618cb28640 1 -- 172.21.15.31:0/562676505 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61880bd580 con 0x7f61880b6dd0 2023-11-27T17:53:21.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.349+0000 7f618cb28640 1 -- 172.21.15.31:0/562676505 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618813b800 con 0x7f61880b6dd0 2023-11-27T17:53:21.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.349+0000 7f618cb28640 1 -- 172.21.15.31:0/562676505 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61880bb120 con 0x7f61880b6dd0 2023-11-27T17:53:21.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.349+0000 7f6176ffd640 1 -- 172.21.15.31:0/562676505 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f617800bcf0 con 0x7f61880b6dd0 2023-11-27T17:53:21.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.349+0000 7f6176ffd640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f61680667f0 0x7f6168068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:21.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.349+0000 7f6176ffd640 1 -- 172.21.15.31:0/562676505 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6178084420 con 0x7f61880b6dd0 2023-11-27T17:53:21.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.349+0000 7f6185d9b640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f61680667f0 0x7f6168068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:21.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.349+0000 7f6185d9b640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f61680667f0 0x7f6168068cb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f617c0b2000 tx=0x7f617c0aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:21.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.353+0000 7f6176ffd640 1 -- 172.21.15.31:0/562676505 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f6178051900 con 0x7f61880b6dd0 2023-11-27T17:53:21.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.501+0000 7f618cb28640 1 -- 172.21.15.31:0/562676505 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f61880ba930 con 0x7f61880b6dd0 2023-11-27T17:53:21.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.985+0000 7f6176ffd640 1 -- 172.21.15.31:0/562676505 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f61880ba930 con 0x7f61880b6dd0 2023-11-27T17:53:21.991 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-11-27T17:53:21.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.989+0000 7f618cb28640 1 -- 172.21.15.31:0/562676505 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f61680667f0 msgr2=0x7f6168068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.989+0000 7f618cb28640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f61680667f0 0x7f6168068cb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f617c0b2000 tx=0x7f617c0aa070 comp rx=0 tx=0).stop 2023-11-27T17:53:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.989+0000 7f618cb28640 1 -- 172.21.15.31:0/562676505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61880b6dd0 msgr2=0x7f61880bbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.989+0000 7f618cb28640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61880b6dd0 0x7f61880bbab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f617800d800 tx=0x7f617800dcc0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.989+0000 7f618cb28640 1 -- 172.21.15.31:0/562676505 shutdown_connections 2023-11-27T17:53:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.989+0000 7f618cb28640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f61680667f0 0x7f6168068cb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.989+0000 7f618cb28640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6188143760 0x7f61880bc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.989+0000 7f618cb28640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61880b9ac0 0x7f618813ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.989+0000 7f618cb28640 1 --2- 172.21.15.31:0/562676505 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f61880b6dd0 0x7f61880bbab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.989+0000 7f618cb28640 1 -- 172.21.15.31:0/562676505 >> 172.21.15.31:0/562676505 conn(0x7f618806a730 msgr2=0x7f61881d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:21.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.989+0000 7f618cb28640 1 -- 172.21.15.31:0/562676505 shutdown_connections 2023-11-27T17:53:21.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:21.989+0000 7f618cb28640 1 -- 172.21.15.31:0/562676505 wait complete. 2023-11-27T17:53:22.023 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T17:53:22.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6549a23640 1 Processor -- start 2023-11-27T17:53:22.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6549a23640 1 -- start start 2023-11-27T17:53:22.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6549a23640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f65440b5e90 0x7f65441477c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:22.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6549a23640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6544148050 con 0x7f6544141a10 2023-11-27T17:53:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6549a23640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6544148330 con 0x7f65440b3a50 2023-11-27T17:53:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6549a23640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6544148610 con 0x7f65440b5e90 2023-11-27T17:53:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f65437fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6544141a10 0x7f65440b4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38212/0 (socket says 172.21.15.31:38212) 2023-11-27T17:53:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f65437fe640 1 -- 172.21.15.31:0/3652730246 learned_addr learned my addr 172.21.15.31:0/3652730246 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6542ffd640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f65440b5e90 0x7f65441477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578038998 0 0) 0x7f6544148050 con 0x7f6544141a10 2023-11-27T17:53:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f652c003530 con 0x7f6544141a10 2023-11-27T17:53:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3233230927 0 0) 0x7f652c003530 con 0x7f6544141a10 2023-11-27T17:53:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f65440b5e90 msgr2=0x7f65441477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f65440b5e90 0x7f65441477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 >> v1:172.21.15.81:6789/0 conn(0x7f65440b3a50 legacy=0x7f6544141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:22.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440b4400 con 0x7f6544141a10 2023-11-27T17:53:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f653c001a00 con 0x7f6544141a10 2023-11-27T17:53:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 >> v1:172.21.15.31:6789/0 conn(0x7f6544141a10 legacy=0x7f65440b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f652c003a20 0x7f652c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f652c0047d0 0x7f652c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f65440b5e90 0x7f652c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6544148610 con 0x7f652c003a20 2023-11-27T17:53:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c00bb20 con 0x7f652c0047d0 2023-11-27T17:53:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c00def0 con 0x7f65440b5e90 2023-11-27T17:53:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6542ffd640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f652c003a20 0x7f652c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f65427fc640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f652c0047d0 0x7f652c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f65437fe640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f65440b5e90 0x7f652c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:22.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6542ffd640 1 -- 172.21.15.31:0/3652730246 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f65440b5e90 msgr2=0x7f652c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:22.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6542ffd640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f65440b5e90 0x7f652c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:22.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6542ffd640 1 -- 172.21.15.31:0/3652730246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f652c0047d0 msgr2=0x7f652c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:22.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6542ffd640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f652c0047d0 0x7f652c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:22.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f6542ffd640 1 -- 172.21.15.31:0/3652730246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c003530 con 0x7f652c003a20 2023-11-27T17:53:22.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.157+0000 7f65437fe640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f65440b5e90 0x7f652c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:22.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6542ffd640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f652c003a20 0x7f652c003e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f653400aa60 tx=0x7f653401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92f466b38b6ac1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:22.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340a5b70 con 0x7f652c003a20 2023-11-27T17:53:22.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c002100 con 0x7f652c003a20 2023-11-27T17:53:22.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6541ffb640 1 -- 172.21.15.31:0/3652730246 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340ad440 con 0x7f652c003a20 2023-11-27T17:53:22.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 -- 172.21.15.31:0/3652730246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f652c003a20 msgr2=0x7f652c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:22.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 --2- 172.21.15.31:0/3652730246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f652c003a20 0x7f652c003e40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f653400aa60 tx=0x7f653401cc10 comp rx=0 tx=0).stop 2023-11-27T17:53:22.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f65437fe640 1 -- 172.21.15.31:0/3652730246 reap_dead start 2023-11-27T17:53:22.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 -- 172.21.15.31:0/3652730246 shutdown_connections 2023-11-27T17:53:22.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 -- 172.21.15.31:0/3652730246 >> 172.21.15.31:0/3652730246 conn(0x7f654406ab60 msgr2=0x7f65440bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:22.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 -- 172.21.15.31:0/3652730246 shutdown_connections 2023-11-27T17:53:22.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 -- 172.21.15.31:0/3652730246 wait complete. 2023-11-27T17:53:22.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 Processor -- start 2023-11-27T17:53:22.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 -- start start 2023-11-27T17:53:22.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f652c003a20 0x7f65441d2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:22.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6544149170 0x7f65440b8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:22.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f654414a0f0 0x7f654414a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:22.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65441d25a0 con 0x7f6544149170 2023-11-27T17:53:22.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65440b93a0 con 0x7f652c003a20 2023-11-27T17:53:22.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6549a23640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654414b440 con 0x7f654414a0f0 2023-11-27T17:53:22.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f65427fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6544149170 0x7f65440b8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:22.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f65427fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6544149170 0x7f65440b8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55572/0 (socket says 172.21.15.31:55572) 2023-11-27T17:53:22.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f65427fc640 1 -- 172.21.15.31:0/806445407 learned_addr learned my addr 172.21.15.31:0/806445407 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:22.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f6542ffd640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f652c003a20 0x7f65441d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:22.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.161+0000 7f65437fe640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f654414a0f0 0x7f654414a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:22.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f65427fc640 1 -- 172.21.15.31:0/806445407 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f654414a0f0 msgr2=0x7f654414a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:22.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f65427fc640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f654414a0f0 0x7f654414a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:22.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f65427fc640 1 -- 172.21.15.31:0/806445407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f652c003a20 msgr2=0x7f65441d2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:22.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f65427fc640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f652c003a20 0x7f65441d2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:22.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f65427fc640 1 -- 172.21.15.31:0/806445407 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440b5330 con 0x7f6544149170 2023-11-27T17:53:22.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f6542ffd640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f652c003a20 0x7f65441d2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:22.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f65427fc640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6544149170 0x7f65440b8e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f653800e550 tx=0x7f653800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:22.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f652bfff640 1 -- 172.21.15.31:0/806445407 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380052e0 con 0x7f6544149170 2023-11-27T17:53:22.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f652bfff640 1 -- 172.21.15.31:0/806445407 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6538005440 con 0x7f6544149170 2023-11-27T17:53:22.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f6549a23640 1 -- 172.21.15.31:0/806445407 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654414b740 con 0x7f6544149170 2023-11-27T17:53:22.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f652bfff640 1 -- 172.21.15.31:0/806445407 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538003820 con 0x7f6544149170 2023-11-27T17:53:22.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f6549a23640 1 -- 172.21.15.31:0/806445407 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654414b980 con 0x7f6544149170 2023-11-27T17:53:22.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f6549a23640 1 -- 172.21.15.31:0/806445407 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6544066f30 con 0x7f6544149170 2023-11-27T17:53:22.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f652bfff640 1 -- 172.21.15.31:0/806445407 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f6538003980 con 0x7f6544149170 2023-11-27T17:53:22.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f652bfff640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f65300667f0 0x7f6530068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:22.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f652bfff640 1 -- 172.21.15.31:0/806445407 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f65380846c0 con 0x7f6544149170 2023-11-27T17:53:22.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f6542ffd640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f65300667f0 0x7f6530068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:22.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.165+0000 7f6542ffd640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f65300667f0 0x7f6530068cb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f65340af000 tx=0x7f65340046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:22.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.169+0000 7f652bfff640 1 -- 172.21.15.31:0/806445407 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f6538051b10 con 0x7f6544149170 2023-11-27T17:53:22.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.321+0000 7f6549a23640 1 -- 172.21.15.31:0/806445407 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f654414b6e0 con 0x7f6544149170 2023-11-27T17:53:23.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:22.997+0000 7f652bfff640 1 -- 172.21.15.31:0/806445407 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6538055130 con 0x7f6544149170 2023-11-27T17:53:23.001 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-11-27T17:53:23.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.001+0000 7f6549a23640 1 -- 172.21.15.31:0/806445407 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f65300667f0 msgr2=0x7f6530068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:23.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.001+0000 7f6549a23640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f65300667f0 0x7f6530068cb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f65340af000 tx=0x7f65340046d0 comp rx=0 tx=0).stop 2023-11-27T17:53:23.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.001+0000 7f6549a23640 1 -- 172.21.15.31:0/806445407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6544149170 msgr2=0x7f65440b8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:23.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.001+0000 7f6549a23640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6544149170 0x7f65440b8e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f653800e550 tx=0x7f653800ea10 comp rx=0 tx=0).stop 2023-11-27T17:53:23.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.001+0000 7f6549a23640 1 -- 172.21.15.31:0/806445407 shutdown_connections 2023-11-27T17:53:23.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.001+0000 7f6549a23640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f65300667f0 0x7f6530068cb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:23.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.001+0000 7f6549a23640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f654414a0f0 0x7f654414a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:23.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.001+0000 7f6549a23640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6544149170 0x7f65440b8e60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:23.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.001+0000 7f6549a23640 1 --2- 172.21.15.31:0/806445407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f652c003a20 0x7f65441d2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:23.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.001+0000 7f6549a23640 1 -- 172.21.15.31:0/806445407 >> 172.21.15.31:0/806445407 conn(0x7f654406ab60 msgr2=0x7f65440b9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:23.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.001+0000 7f6549a23640 1 -- 172.21.15.31:0/806445407 shutdown_connections 2023-11-27T17:53:23.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.001+0000 7f6549a23640 1 -- 172.21.15.31:0/806445407 wait complete. 2023-11-27T17:53:23.048 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-27T17:53:23.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f4955422640 1 Processor -- start 2023-11-27T17:53:23.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f4955422640 1 -- start start 2023-11-27T17:53:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f4955422640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4950143560 0x7f49500bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f4955422640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4950149c00 0x7f4950153a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f4955422640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4950071260 con 0x7f495006f1d0 2023-11-27T17:53:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f4955422640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4950143940 con 0x7f4950143560 2023-11-27T17:53:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f4955422640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495006f800 con 0x7f4950149c00 2023-11-27T17:53:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f494effd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4950143560 0x7f49500bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f494effd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4950143560 0x7f49500bd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55588/0 (socket says 172.21.15.31:55588) 2023-11-27T17:53:23.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f494effd640 1 -- 172.21.15.31:0/3084028374 learned_addr learned my addr 172.21.15.31:0/3084028374 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f494f7fe640 1 --2- 172.21.15.31:0/3084028374 >> v2:172.21.15.81:3300/0 conn(0x7f4950149c00 0x7f4950153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f494effd640 1 -- 172.21.15.31:0/3084028374 >> v2:172.21.15.81:3300/0 conn(0x7f4950149c00 msgr2=0x7f4950153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f494effd640 1 --2- 172.21.15.31:0/3084028374 >> v2:172.21.15.81:3300/0 conn(0x7f4950149c00 0x7f4950153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f494effd640 1 -- 172.21.15.31:0/3084028374 >> v1:172.21.15.31:6789/0 conn(0x7f495006f1d0 legacy=0x7f49501494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f494effd640 1 -- 172.21.15.31:0/3084028374 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495006fae0 con 0x7f4950143560 2023-11-27T17:53:23.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.177+0000 7f494dffb640 1 -- 172.21.15.31:0/3084028374 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771535534 0 0) 0x7f4950071260 con 0x7f495006f1d0 2023-11-27T17:53:23.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494effd640 1 --2- 172.21.15.31:0/3084028374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4950143560 0x7f49500bd240 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f49500b6b30 tx=0x7f493801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649794e02501582d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:23.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494dffb640 1 -- 172.21.15.31:0/3084028374 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49380a7070 con 0x7f4950143560 2023-11-27T17:53:23.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494dffb640 1 -- 172.21.15.31:0/3084028374 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49380ab430 con 0x7f4950143560 2023-11-27T17:53:23.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494dffb640 1 -- 172.21.15.31:0/3084028374 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49380ab7c0 con 0x7f4950143560 2023-11-27T17:53:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 -- 172.21.15.31:0/3084028374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4950143560 msgr2=0x7f49500bd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 --2- 172.21.15.31:0/3084028374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4950143560 0x7f49500bd240 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f49500b6b30 tx=0x7f493801c4d0 comp rx=0 tx=0).stop 2023-11-27T17:53:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 -- 172.21.15.31:0/3084028374 shutdown_connections 2023-11-27T17:53:23.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 --2- 172.21.15.31:0/3084028374 >> v2:172.21.15.81:3300/0 conn(0x7f4950149c00 0x7f4950153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:23.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 --2- 172.21.15.31:0/3084028374 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4950143560 0x7f49500bd240 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:23.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 -- 172.21.15.31:0/3084028374 >> 172.21.15.31:0/3084028374 conn(0x7f495006ab60 msgr2=0x7f49500bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:23.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 -- 172.21.15.31:0/3084028374 shutdown_connections 2023-11-27T17:53:23.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 -- 172.21.15.31:0/3084028374 wait complete. 2023-11-27T17:53:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 Processor -- start 2023-11-27T17:53:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 -- start start 2023-11-27T17:53:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f495006f1d0 0x7f4950135cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4950143560 0x7f49501471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4950149c00 0x7f49501e17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4950141c70 con 0x7f4950149c00 2023-11-27T17:53:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4950136210 con 0x7f495006f1d0 2023-11-27T17:53:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4950141e60 con 0x7f4950143560 2023-11-27T17:53:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4950149c00 0x7f49501e17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4950149c00 0x7f49501e17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55590/0 (socket says 172.21.15.31:55590) 2023-11-27T17:53:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494f7fe640 1 -- 172.21.15.31:0/370383262 learned_addr learned my addr 172.21.15.31:0/370383262 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:23.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494effd640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f495006f1d0 0x7f4950135cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:23.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494e7fc640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4950143560 0x7f49501471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:23.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494f7fe640 1 -- 172.21.15.31:0/370383262 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4950143560 msgr2=0x7f49501471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:23.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494f7fe640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4950143560 0x7f49501471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:23.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494f7fe640 1 -- 172.21.15.31:0/370383262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f495006f1d0 msgr2=0x7f4950135cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:23.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494f7fe640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f495006f1d0 0x7f4950135cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:23.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494f7fe640 1 -- 172.21.15.31:0/370383262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380094d0 con 0x7f4950149c00 2023-11-27T17:53:23.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f494f7fe640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4950149c00 0x7f49501e17b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4948007e60 tx=0x7f494800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:23.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f49477fe640 1 -- 172.21.15.31:0/370383262 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948014420 con 0x7f4950149c00 2023-11-27T17:53:23.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f49477fe640 1 -- 172.21.15.31:0/370383262 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49480145a0 con 0x7f4950149c00 2023-11-27T17:53:23.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 -- 172.21.15.31:0/370383262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4950147710 con 0x7f4950149c00 2023-11-27T17:53:23.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f49477fe640 1 -- 172.21.15.31:0/370383262 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948014950 con 0x7f4950149c00 2023-11-27T17:53:23.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.181+0000 7f4955422640 1 -- 172.21.15.31:0/370383262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49501423f0 con 0x7f4950149c00 2023-11-27T17:53:23.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.185+0000 7f4955422640 1 -- 172.21.15.31:0/370383262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4950142610 con 0x7f4950149c00 2023-11-27T17:53:23.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.185+0000 7f49477fe640 1 -- 172.21.15.31:0/370383262 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f4948014ab0 con 0x7f4950149c00 2023-11-27T17:53:23.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.185+0000 7f49477fe640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f49300667f0 0x7f4930068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:23.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.185+0000 7f49477fe640 1 -- 172.21.15.31:0/370383262 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4948084ad0 con 0x7f4950149c00 2023-11-27T17:53:23.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.185+0000 7f494effd640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f49300667f0 0x7f4930068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:23.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.185+0000 7f494effd640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f49300667f0 0x7f4930068cb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f49380af000 tx=0x7f49380a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:23.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.189+0000 7f49477fe640 1 -- 172.21.15.31:0/370383262 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4948051cc0 con 0x7f4950149c00 2023-11-27T17:53:23.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:23.377+0000 7f4955422640 1 -- 172.21.15.31:0/370383262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f495004e850 con 0x7f4950149c00 2023-11-27T17:53:24.043 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.041+0000 7f49477fe640 1 -- 172.21.15.31:0/370383262 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f49480552e0 con 0x7f4950149c00 2023-11-27T17:53:24.045 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 2 and data pool 3 2023-11-27T17:53:24.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.045+0000 7f4955422640 1 -- 172.21.15.31:0/370383262 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f49300667f0 msgr2=0x7f4930068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.045+0000 7f4955422640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f49300667f0 0x7f4930068cb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f49380af000 tx=0x7f49380a7000 comp rx=0 tx=0).stop 2023-11-27T17:53:24.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.045+0000 7f4955422640 1 -- 172.21.15.31:0/370383262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4950149c00 msgr2=0x7f49501e17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.045+0000 7f4955422640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4950149c00 0x7f49501e17b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4948007e60 tx=0x7f494800e4b0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.045+0000 7f4955422640 1 -- 172.21.15.31:0/370383262 shutdown_connections 2023-11-27T17:53:24.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.045+0000 7f4955422640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f49300667f0 0x7f4930068cb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.045+0000 7f4955422640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4950149c00 0x7f49501e17b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.045+0000 7f4955422640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4950143560 0x7f49501471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.045+0000 7f4955422640 1 --2- 172.21.15.31:0/370383262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f495006f1d0 0x7f4950135cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.045+0000 7f4955422640 1 -- 172.21.15.31:0/370383262 >> 172.21.15.31:0/370383262 conn(0x7f495006ab60 msgr2=0x7f495013f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:24.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.049+0000 7f4955422640 1 -- 172.21.15.31:0/370383262 shutdown_connections 2023-11-27T17:53:24.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.049+0000 7f4955422640 1 -- 172.21.15.31:0/370383262 wait complete. 2023-11-27T17:53:24.081 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:24.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8aa5e4640 1 Processor -- start 2023-11-27T17:53:24.201 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8aa5e4640 1 -- start start 2023-11-27T17:53:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8aa5e4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd8a40b89a0 0x7fd8a40b9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8aa5e4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8a4145750 0x7fd8a40b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8aa5e4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a406d220 con 0x7fd8a40bb050 2023-11-27T17:53:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8aa5e4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a406c5d0 con 0x7fd8a4145750 2023-11-27T17:53:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8aa5e4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a40ba3f0 con 0x7fd8a40b89a0 2023-11-27T17:53:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8a37fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd8a40bb050 0x7fd8a4145040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38218/0 (socket says 172.21.15.31:38218) 2023-11-27T17:53:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8a37fe640 1 -- 172.21.15.31:0/2969765744 learned_addr learned my addr 172.21.15.31:0/2969765744 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8a8b81640 1 --2- 172.21.15.31:0/2969765744 >> v2:172.21.15.31:3300/0 conn(0x7fd8a4145750 0x7fd8a40b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8a2ffd640 1 -- 172.21.15.31:0/2969765744 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308163399 0 0) 0x7fd8a406d220 con 0x7fd8a40bb050 2023-11-27T17:53:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8a3fff640 1 --2- 172.21.15.31:0/2969765744 >> v2:172.21.15.81:3300/0 conn(0x7fd8a40b89a0 0x7fd8a40b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8a2ffd640 1 -- 172.21.15.31:0/2969765744 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd890003530 con 0x7fd8a40bb050 2023-11-27T17:53:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8a8b81640 1 -- 172.21.15.31:0/2969765744 >> v2:172.21.15.81:3300/0 conn(0x7fd8a40b89a0 msgr2=0x7fd8a40b9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8a8b81640 1 --2- 172.21.15.31:0/2969765744 >> v2:172.21.15.81:3300/0 conn(0x7fd8a40b89a0 0x7fd8a40b9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8a8b81640 1 -- 172.21.15.31:0/2969765744 >> v1:172.21.15.31:6789/0 conn(0x7fd8a40bb050 legacy=0x7fd8a4145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.197+0000 7fd8a8b81640 1 -- 172.21.15.31:0/2969765744 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a406d500 con 0x7fd8a4145750 2023-11-27T17:53:24.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.201+0000 7fd8a8b81640 1 --2- 172.21.15.31:0/2969765744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a4145750 0x7fd8a40b9eb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40bc730 tx=0x7fd89c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef632021ec1c7784 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:24.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.201+0000 7fd8a2ffd640 1 -- 172.21.15.31:0/2969765744 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0ab600 con 0x7fd8a4145750 2023-11-27T17:53:24.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.201+0000 7fd8a2ffd640 1 -- 172.21.15.31:0/2969765744 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c0a7050 con 0x7fd8a4145750 2023-11-27T17:53:24.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.201+0000 7fd8a2ffd640 1 -- 172.21.15.31:0/2969765744 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0ab960 con 0x7fd8a4145750 2023-11-27T17:53:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.201+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/2969765744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a4145750 msgr2=0x7fd8a40b9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.201+0000 7fd8aa5e4640 1 --2- 172.21.15.31:0/2969765744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a4145750 0x7fd8a40b9eb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd8a40bc730 tx=0x7fd89c01c460 comp rx=0 tx=0).stop 2023-11-27T17:53:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.201+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/2969765744 shutdown_connections 2023-11-27T17:53:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.201+0000 7fd8aa5e4640 1 --2- 172.21.15.31:0/2969765744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a4145750 0x7fd8a40b9eb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.201+0000 7fd8aa5e4640 1 --2- 172.21.15.31:0/2969765744 >> v2:172.21.15.81:3300/0 conn(0x7fd8a40b89a0 0x7fd8a40b9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.201+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/2969765744 >> 172.21.15.31:0/2969765744 conn(0x7fd8a40beb70 msgr2=0x7fd8a40bef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.201+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/2969765744 shutdown_connections 2023-11-27T17:53:24.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.201+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/2969765744 wait complete. 2023-11-27T17:53:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8aa5e4640 1 Processor -- start 2023-11-27T17:53:24.207 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8aa5e4640 1 -- start start 2023-11-27T17:53:24.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8aa5e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a40b89a0 0x7fd8a4140160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8aa5e4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8a40bb050 0x7fd8a41e3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8aa5e4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a4145750 0x7fd8a41e3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8aa5e4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a41479b0 con 0x7fd8a4145750 2023-11-27T17:53:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8aa5e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a41406a0 con 0x7fd8a40b89a0 2023-11-27T17:53:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8aa5e4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a4144760 con 0x7fd8a40bb050 2023-11-27T17:53:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a8b81640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a4145750 0x7fd8a41e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a8b81640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a4145750 0x7fd8a41e3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55604/0 (socket says 172.21.15.31:55604) 2023-11-27T17:53:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a8b81640 1 -- 172.21.15.31:0/1180375803 learned_addr learned my addr 172.21.15.31:0/1180375803 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a3fff640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a40b89a0 0x7fd8a4140160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a37fe640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8a40bb050 0x7fd8a41e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a8b81640 1 -- 172.21.15.31:0/1180375803 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8a40bb050 msgr2=0x7fd8a41e3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a8b81640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8a40bb050 0x7fd8a41e3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a8b81640 1 -- 172.21.15.31:0/1180375803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a40b89a0 msgr2=0x7fd8a4140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a8b81640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a40b89a0 0x7fd8a4140160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a8b81640 1 -- 172.21.15.31:0/1180375803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c009420 con 0x7fd8a4145750 2023-11-27T17:53:24.210 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a8b81640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a4145750 0x7fd8a41e3cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd89c019070 tx=0x7fd89c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a0ff9640 1 -- 172.21.15.31:0/1180375803 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c003a30 con 0x7fd8a4145750 2023-11-27T17:53:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a0ff9640 1 -- 172.21.15.31:0/1180375803 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c003b90 con 0x7fd8a4145750 2023-11-27T17:53:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/1180375803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a41444e0 con 0x7fd8a4145750 2023-11-27T17:53:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a0ff9640 1 -- 172.21.15.31:0/1180375803 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0ab400 con 0x7fd8a4145750 2023-11-27T17:53:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/1180375803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a4143c40 con 0x7fd8a4145750 2023-11-27T17:53:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/1180375803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a404e850 con 0x7fd8a4145750 2023-11-27T17:53:24.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.205+0000 7fd8a0ff9640 1 -- 172.21.15.31:0/1180375803 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fd89c0b2040 con 0x7fd8a4145750 2023-11-27T17:53:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.209+0000 7fd8a0ff9640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd8840667f0 0x7fd884068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.209+0000 7fd8a0ff9640 1 -- 172.21.15.31:0/1180375803 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd89c11dd80 con 0x7fd8a4145750 2023-11-27T17:53:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.209+0000 7fd8a3fff640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd8840667f0 0x7fd884068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.212 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.209+0000 7fd8a3fff640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd8840667f0 0x7fd884068cb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8940113e0 tx=0x7fd89400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:24.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.213+0000 7fd8a0ff9640 1 -- 172.21.15.31:0/1180375803 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fd89c0eafc0 con 0x7fd8a4145750 2023-11-27T17:53:24.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.369+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/1180375803 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8a41e34d0 con 0x7fd8a4145750 2023-11-27T17:53:24.377 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.373+0000 7fd8a0ff9640 1 -- 172.21.15.31:0/1180375803 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16447 (secure 0 0 0) 0x7fd89c0ee5e0 con 0x7fd8a4145750 2023-11-27T17:53:24.377 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:24.377 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:23.382507+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.373+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/1180375803 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd8840667f0 msgr2=0x7fd884068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.373+0000 7fd8aa5e4640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd8840667f0 0x7fd884068cb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd8940113e0 tx=0x7fd89400b040 comp rx=0 tx=0).stop 2023-11-27T17:53:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.373+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/1180375803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a4145750 msgr2=0x7fd8a41e3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.373+0000 7fd8aa5e4640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a4145750 0x7fd8a41e3cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd89c019070 tx=0x7fd89c019200 comp rx=0 tx=0).stop 2023-11-27T17:53:24.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.377+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/1180375803 shutdown_connections 2023-11-27T17:53:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.377+0000 7fd8aa5e4640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd8840667f0 0x7fd884068cb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.377+0000 7fd8aa5e4640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a4145750 0x7fd8a41e3cb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.377+0000 7fd8aa5e4640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8a40bb050 0x7fd8a41e3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.377+0000 7fd8aa5e4640 1 --2- 172.21.15.31:0/1180375803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8a40b89a0 0x7fd8a4140160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.377+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/1180375803 >> 172.21.15.31:0/1180375803 conn(0x7fd8a40beb70 msgr2=0x7fd8a40bd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.377+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/1180375803 shutdown_connections 2023-11-27T17:53:24.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.377+0000 7fd8aa5e4640 1 -- 172.21.15.31:0/1180375803 wait complete. 2023-11-27T17:53:24.397 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:24.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.509+0000 7f876affb640 1 Processor -- start 2023-11-27T17:53:24.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.509+0000 7f876affb640 1 -- start start 2023-11-27T17:53:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f876affb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87640b8440 0x7f876414e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f876affb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8764144dd0 0x7f8764145260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f876affb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87640b8d90 con 0x7f87640b9220 2023-11-27T17:53:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f876affb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87640ba130 con 0x7f87640b8440 2023-11-27T17:53:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f876affb640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876406bc10 con 0x7f8764144dd0 2023-11-27T17:53:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f8768d97640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87640b8440 0x7f876414e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f8763fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f87640b9220 0x7f87640bcf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38234/0 (socket says 172.21.15.31:38234) 2023-11-27T17:53:24.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f8763fff640 1 -- 172.21.15.31:0/4174515389 learned_addr learned my addr 172.21.15.31:0/4174515389 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:24.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f8768d97640 1 --2- 172.21.15.31:0/4174515389 >> v2:172.21.15.31:3300/0 conn(0x7f87640b8440 0x7f876414e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55608/0 (socket says 172.21.15.31:55608) 2023-11-27T17:53:24.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f8769598640 1 --2- 172.21.15.31:0/4174515389 >> v2:172.21.15.81:3300/0 conn(0x7f8764144dd0 0x7f8764145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f8768d97640 1 -- 172.21.15.31:0/4174515389 >> v2:172.21.15.81:3300/0 conn(0x7f8764144dd0 msgr2=0x7f8764145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:24.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f8768d97640 1 --2- 172.21.15.31:0/4174515389 >> v2:172.21.15.81:3300/0 conn(0x7f8764144dd0 0x7f8764145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f8768d97640 1 -- 172.21.15.31:0/4174515389 >> v1:172.21.15.31:6789/0 conn(0x7f87640b9220 legacy=0x7f87640bcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f87637fe640 1 -- 172.21.15.31:0/4174515389 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229360244 0 0) 0x7f87640b8d90 con 0x7f87640b9220 2023-11-27T17:53:24.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f8768d97640 1 -- 172.21.15.31:0/4174515389 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87641457a0 con 0x7f87640b8440 2023-11-27T17:53:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.513+0000 7f8768d97640 1 --2- 172.21.15.31:0/4174515389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87640b8440 0x7f876414e880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8764148e60 tx=0x7f875401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b40d2ad2c8d2344 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f87637fe640 1 -- 172.21.15.31:0/4174515389 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540a8950 con 0x7f87640b8440 2023-11-27T17:53:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f87637fe640 1 -- 172.21.15.31:0/4174515389 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87540a8ab0 con 0x7f87640b8440 2023-11-27T17:53:24.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f87637fe640 1 -- 172.21.15.31:0/4174515389 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540a8e40 con 0x7f87640b8440 2023-11-27T17:53:24.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 -- 172.21.15.31:0/4174515389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87640b8440 msgr2=0x7f876414e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 --2- 172.21.15.31:0/4174515389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87640b8440 0x7f876414e880 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8764148e60 tx=0x7f875401ec50 comp rx=0 tx=0).stop 2023-11-27T17:53:24.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 -- 172.21.15.31:0/4174515389 shutdown_connections 2023-11-27T17:53:24.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 --2- 172.21.15.31:0/4174515389 >> v2:172.21.15.81:3300/0 conn(0x7f8764144dd0 0x7f8764145260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 --2- 172.21.15.31:0/4174515389 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87640b8440 0x7f876414e880 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 -- 172.21.15.31:0/4174515389 >> 172.21.15.31:0/4174515389 conn(0x7f87640c0ce0 msgr2=0x7f87640c10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:24.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 -- 172.21.15.31:0/4174515389 shutdown_connections 2023-11-27T17:53:24.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 -- 172.21.15.31:0/4174515389 wait complete. 2023-11-27T17:53:24.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 Processor -- start 2023-11-27T17:53:24.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 -- start start 2023-11-27T17:53:24.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87640b8440 0x7f8764145d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87640b9220 0x7f8764139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8764144dd0 0x7f87641e4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876414e040 con 0x7f87640b9220 2023-11-27T17:53:24.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87641480d0 con 0x7f87640b8440 2023-11-27T17:53:24.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87641e0d10 con 0x7f8764144dd0 2023-11-27T17:53:24.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f8763fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87640b9220 0x7f8764139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f8763fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87640b9220 0x7f8764139940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55616/0 (socket says 172.21.15.31:55616) 2023-11-27T17:53:24.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f8763fff640 1 -- 172.21.15.31:0/2532719958 learned_addr learned my addr 172.21.15.31:0/2532719958 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:24.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f8768d97640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87640b8440 0x7f8764145d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f8763fff640 1 -- 172.21.15.31:0/2532719958 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8764144dd0 msgr2=0x7f87641e4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f8769598640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8764144dd0 0x7f87641e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f8763fff640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8764144dd0 0x7f87641e4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f8763fff640 1 -- 172.21.15.31:0/2532719958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87640b8440 msgr2=0x7f8764145d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f8763fff640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87640b8440 0x7f8764145d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f8763fff640 1 -- 172.21.15.31:0/2532719958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8754009420 con 0x7f87640b9220 2023-11-27T17:53:24.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f8769598640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8764144dd0 0x7f87641e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:24.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f8763fff640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87640b9220 0x7f8764139940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f87580011f0 tx=0x7f875800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:24.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f87617fa640 1 -- 172.21.15.31:0/2532719958 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87580074e0 con 0x7f87640b9220 2023-11-27T17:53:24.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f87617fa640 1 -- 172.21.15.31:0/2532719958 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8758007640 con 0x7f87640b9220 2023-11-27T17:53:24.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 -- 172.21.15.31:0/2532719958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87641e0ff0 con 0x7f87640b9220 2023-11-27T17:53:24.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f87617fa640 1 -- 172.21.15.31:0/2532719958 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8758004a10 con 0x7f87640b9220 2023-11-27T17:53:24.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 -- 172.21.15.31:0/2532719958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876414dbf0 con 0x7f87640b9220 2023-11-27T17:53:24.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.517+0000 7f876affb640 1 -- 172.21.15.31:0/2532719958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876404e850 con 0x7f87640b9220 2023-11-27T17:53:24.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.521+0000 7f87617fa640 1 -- 172.21.15.31:0/2532719958 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f8758004b70 con 0x7f87640b9220 2023-11-27T17:53:24.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.521+0000 7f87617fa640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8750066820 0x7f8750068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.521+0000 7f8768d97640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8750066820 0x7f8750068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.521+0000 7f87617fa640 1 -- 172.21.15.31:0/2532719958 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8758083410 con 0x7f87640b9220 2023-11-27T17:53:24.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.521+0000 7f8768d97640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8750066820 0x7f8750068ce0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f87540b2000 tx=0x7f87540aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:24.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.525+0000 7f87617fa640 1 -- 172.21.15.31:0/2532719958 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f8758050510 con 0x7f87640b9220 2023-11-27T17:53:24.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.681+0000 7f876affb640 1 -- 172.21.15.31:0/2532719958 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8764144860 con 0x7f87640b9220 2023-11-27T17:53:24.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f87617fa640 1 -- 172.21.15.31:0/2532719958 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16447 (secure 0 0 0) 0x7f8758053b30 con 0x7f87640b9220 2023-11-27T17:53:24.688 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:24.688 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":19,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:23.382507+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:24.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f876affb640 1 -- 172.21.15.31:0/2532719958 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8750066820 msgr2=0x7f8750068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f876affb640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8750066820 0x7f8750068ce0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f87540b2000 tx=0x7f87540aa070 comp rx=0 tx=0).stop 2023-11-27T17:53:24.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f876affb640 1 -- 172.21.15.31:0/2532719958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87640b9220 msgr2=0x7f8764139940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f876affb640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87640b9220 0x7f8764139940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f87580011f0 tx=0x7f875800c9b0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f876affb640 1 -- 172.21.15.31:0/2532719958 shutdown_connections 2023-11-27T17:53:24.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f876affb640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8750066820 0x7f8750068ce0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f876affb640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8764144dd0 0x7f87641e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f876affb640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87640b9220 0x7f8764139940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f876affb640 1 --2- 172.21.15.31:0/2532719958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87640b8440 0x7f8764145d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f876affb640 1 -- 172.21.15.31:0/2532719958 >> 172.21.15.31:0/2532719958 conn(0x7f87640c0ce0 msgr2=0x7f87640bcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:24.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f876affb640 1 -- 172.21.15.31:0/2532719958 shutdown_connections 2023-11-27T17:53:24.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.685+0000 7f876affb640 1 -- 172.21.15.31:0/2532719958 wait complete. 2023-11-27T17:53:24.707 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-27T17:53:24.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d35161640 1 Processor -- start 2023-11-27T17:53:24.828 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d35161640 1 -- start start 2023-11-27T17:53:24.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d35161640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d300ba830 0x7f1d300b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d35161640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1d30148160 0x7f1d300b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d35161640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d30071ef0 con 0x7f1d300714b0 2023-11-27T17:53:24.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d35161640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300b4da0 con 0x7f1d30148160 2023-11-27T17:53:24.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d35161640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30070430 con 0x7f1d300ba830 2023-11-27T17:53:24.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d2ed9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d300ba830 0x7f1d300b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d2e59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1d30148160 0x7f1d300b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d2ed9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d300ba830 0x7f1d300b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:38362/0 (socket says 172.21.15.31:38362) 2023-11-27T17:53:24.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d2ed9d640 1 -- 172.21.15.31:0/1512629695 learned_addr learned my addr 172.21.15.31:0/1512629695 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:24.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d2f59e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1d300714b0 0x7f1d30141ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.31:48028/0 (socket says 172.21.15.31:48028) 2023-11-27T17:53:24.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d2ed9d640 1 -- 172.21.15.31:0/1512629695 >> v2:172.21.15.81:3300/0 conn(0x7f1d30148160 msgr2=0x7f1d300b99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:24.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d2ed9d640 1 --2- 172.21.15.31:0/1512629695 >> v2:172.21.15.81:3300/0 conn(0x7f1d30148160 0x7f1d300b99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d2ed9d640 1 -- 172.21.15.31:0/1512629695 >> v1:172.21.15.81:6789/0 conn(0x7f1d300714b0 legacy=0x7f1d30141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.825+0000 7f1d2ed9d640 1 -- 172.21.15.31:0/1512629695 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30070710 con 0x7f1d300ba830 2023-11-27T17:53:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.829+0000 7f1d2ed9d640 1 --2- 172.21.15.31:0/1512629695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d300ba830 0x7f1d300b47a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009870 tx=0x7f1d1801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2fc7d8f713f7ec4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.829+0000 7f1d2dd9b640 1 -- 172.21.15.31:0/1512629695 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d180aa430 con 0x7f1d300ba830 2023-11-27T17:53:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.829+0000 7f1d2dd9b640 1 -- 172.21.15.31:0/1512629695 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d180aa590 con 0x7f1d300ba830 2023-11-27T17:53:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.829+0000 7f1d2dd9b640 1 -- 172.21.15.31:0/1512629695 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d180aa920 con 0x7f1d300ba830 2023-11-27T17:53:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.829+0000 7f1d35161640 1 -- 172.21.15.31:0/1512629695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d300ba830 msgr2=0x7f1d300b47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.829+0000 7f1d35161640 1 --2- 172.21.15.31:0/1512629695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d300ba830 0x7f1d300b47a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009870 tx=0x7f1d1801c470 comp rx=0 tx=0).stop 2023-11-27T17:53:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.829+0000 7f1d35161640 1 -- 172.21.15.31:0/1512629695 shutdown_connections 2023-11-27T17:53:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.829+0000 7f1d35161640 1 --2- 172.21.15.31:0/1512629695 >> v2:172.21.15.81:3300/0 conn(0x7f1d30148160 0x7f1d300b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.829+0000 7f1d35161640 1 --2- 172.21.15.31:0/1512629695 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d300ba830 0x7f1d300b47a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.829+0000 7f1d35161640 1 -- 172.21.15.31:0/1512629695 >> 172.21.15.31:0/1512629695 conn(0x7f1d3006e8a0 msgr2=0x7f1d3006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.829+0000 7f1d35161640 1 -- 172.21.15.31:0/1512629695 shutdown_connections 2023-11-27T17:53:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.829+0000 7f1d35161640 1 -- 172.21.15.31:0/1512629695 wait complete. 2023-11-27T17:53:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d35161640 1 Processor -- start 2023-11-27T17:53:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d35161640 1 -- start start 2023-11-27T17:53:24.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d35161640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d300714b0 0x7f1d30146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d35161640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d300ba830 0x7f1d30137d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d35161640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d30148160 0x7f1d301475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d35161640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30138250 con 0x7f1d30148160 2023-11-27T17:53:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d35161640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30146bf0 con 0x7f1d300714b0 2023-11-27T17:53:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d35161640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30133780 con 0x7f1d300ba830 2023-11-27T17:53:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d2f59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d30148160 0x7f1d301475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d2f59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d30148160 0x7f1d301475f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50816/0 (socket says 172.21.15.31:50816) 2023-11-27T17:53:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d2f59e640 1 -- 172.21.15.31:0/492591205 learned_addr learned my addr 172.21.15.31:0/492591205 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d2e59c640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d300ba830 0x7f1d30137d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d2ed9d640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d300714b0 0x7f1d30146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d2f59e640 1 -- 172.21.15.31:0/492591205 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d300ba830 msgr2=0x7f1d30137d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d2f59e640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d300ba830 0x7f1d30137d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d2f59e640 1 -- 172.21.15.31:0/492591205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d300714b0 msgr2=0x7f1d30146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d2f59e640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d300714b0 0x7f1d30146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d2f59e640 1 -- 172.21.15.31:0/492591205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d180094d0 con 0x7f1d30148160 2023-11-27T17:53:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d2ed9d640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d300714b0 0x7f1d30146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d2f59e640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d30148160 0x7f1d301475f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c410 tx=0x7f1d2800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d277fe640 1 -- 172.21.15.31:0/492591205 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280074e0 con 0x7f1d30148160 2023-11-27T17:53:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d35161640 1 -- 172.21.15.31:0/492591205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d30146df0 con 0x7f1d30148160 2023-11-27T17:53:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d277fe640 1 -- 172.21.15.31:0/492591205 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28007640 con 0x7f1d30148160 2023-11-27T17:53:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d277fe640 1 -- 172.21.15.31:0/492591205 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28004a10 con 0x7f1d30148160 2023-11-27T17:53:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d35161640 1 -- 172.21.15.31:0/492591205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3013c7a0 con 0x7f1d30148160 2023-11-27T17:53:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.833+0000 7f1d35161640 1 -- 172.21.15.31:0/492591205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d301339a0 con 0x7f1d30148160 2023-11-27T17:53:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.837+0000 7f1d277fe640 1 -- 172.21.15.31:0/492591205 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1d28004b70 con 0x7f1d30148160 2023-11-27T17:53:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.837+0000 7f1d277fe640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1d100667f0 0x7f1d10068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.837+0000 7f1d277fe640 1 -- 172.21.15.31:0/492591205 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d28083b00 con 0x7f1d30148160 2023-11-27T17:53:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.837+0000 7f1d2ed9d640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1d100667f0 0x7f1d10068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.837+0000 7f1d2ed9d640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1d100667f0 0x7f1d10068cb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1d180ae000 tx=0x7f1d180a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:24.841+0000 7f1d277fe640 1 -- 172.21.15.31:0/492591205 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1d28050b80 con 0x7f1d30148160 2023-11-27T17:53:25.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.025+0000 7f1d35161640 1 -- 172.21.15.31:0/492591205 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1d30071ef0 con 0x7f1d30148160 2023-11-27T17:53:25.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.041+0000 7f1d277fe640 1 -- 172.21.15.31:0/492591205 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1d30071ef0 con 0x7f1d30148160 2023-11-27T17:53:25.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.045+0000 7f1d35161640 1 -- 172.21.15.31:0/492591205 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1d100667f0 msgr2=0x7f1d10068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:25.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.045+0000 7f1d35161640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1d100667f0 0x7f1d10068cb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1d180ae000 tx=0x7f1d180a7000 comp rx=0 tx=0).stop 2023-11-27T17:53:25.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.045+0000 7f1d35161640 1 -- 172.21.15.31:0/492591205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d30148160 msgr2=0x7f1d301475f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:25.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.045+0000 7f1d35161640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d30148160 0x7f1d301475f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c410 tx=0x7f1d2800c8d0 comp rx=0 tx=0).stop 2023-11-27T17:53:25.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.045+0000 7f1d35161640 1 -- 172.21.15.31:0/492591205 shutdown_connections 2023-11-27T17:53:25.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.045+0000 7f1d35161640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1d100667f0 0x7f1d10068cb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:25.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.045+0000 7f1d35161640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d30148160 0x7f1d301475f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:25.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.045+0000 7f1d35161640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d300ba830 0x7f1d30137d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:25.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.045+0000 7f1d35161640 1 --2- 172.21.15.31:0/492591205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d300714b0 0x7f1d30146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:25.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.045+0000 7f1d35161640 1 -- 172.21.15.31:0/492591205 >> 172.21.15.31:0/492591205 conn(0x7f1d3006e8a0 msgr2=0x7f1d30140a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:25.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.045+0000 7f1d35161640 1 -- 172.21.15.31:0/492591205 shutdown_connections 2023-11-27T17:53:25.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.045+0000 7f1d35161640 1 -- 172.21.15.31:0/492591205 wait complete. 2023-11-27T17:53:25.065 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T17:53:25.065 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-27T17:53:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c67104640 1 Processor -- start 2023-11-27T17:53:25.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c67104640 1 -- start start 2023-11-27T17:53:25.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c67104640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3c600b6a70 0x7f3c600b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:25.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c67104640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3c601420f0 0x7f3c60142540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:25.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c67104640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c600b8640 con 0x7f3c60148470 2023-11-27T17:53:25.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c67104640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6006f630 con 0x7f3c601420f0 2023-11-27T17:53:25.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c67104640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c600b63e0 con 0x7f3c600b6a70 2023-11-27T17:53:25.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c5ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3c601420f0 0x7f3c60142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:25.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c656a1640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3c60148470 0x7f3c60148880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45996/0 (socket says 172.21.15.31:45996) 2023-11-27T17:53:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c656a1640 1 -- 172.21.15.31:0/872857044 learned_addr learned my addr 172.21.15.31:0/872857044 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c64ea0640 1 --2- 172.21.15.31:0/872857044 >> v2:172.21.15.81:3300/0 conn(0x7f3c600b6a70 0x7f3c600b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c5ffff640 1 -- 172.21.15.31:0/872857044 >> v2:172.21.15.81:3300/0 conn(0x7f3c600b6a70 msgr2=0x7f3c600b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c5ffff640 1 --2- 172.21.15.31:0/872857044 >> v2:172.21.15.81:3300/0 conn(0x7f3c600b6a70 0x7f3c600b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c5ffff640 1 -- 172.21.15.31:0/872857044 >> v1:172.21.15.31:6789/0 conn(0x7f3c60148470 legacy=0x7f3c60148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c5ffff640 1 -- 172.21.15.31:0/872857044 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c600b8890 con 0x7f3c601420f0 2023-11-27T17:53:25.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c64ea0640 1 --2- 172.21.15.31:0/872857044 >> v2:172.21.15.81:3300/0 conn(0x7f3c600b6a70 0x7f3c600b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:25.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c5ffff640 1 --2- 172.21.15.31:0/872857044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c601420f0 0x7f3c60142540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c6006b3f0 tx=0x7f3c4c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f10ee7a64ef697e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:25.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.177+0000 7f3c5f7fe640 1 -- 172.21.15.31:0/872857044 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0a7070 con 0x7f3c601420f0 2023-11-27T17:53:25.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c5f7fe640 1 -- 172.21.15.31:0/872857044 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c0ab430 con 0x7f3c601420f0 2023-11-27T17:53:25.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c5f7fe640 1 -- 172.21.15.31:0/872857044 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0ab7c0 con 0x7f3c601420f0 2023-11-27T17:53:25.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 -- 172.21.15.31:0/872857044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c601420f0 msgr2=0x7f3c60142540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:25.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 --2- 172.21.15.31:0/872857044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c601420f0 0x7f3c60142540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3c6006b3f0 tx=0x7f3c4c01c430 comp rx=0 tx=0).stop 2023-11-27T17:53:25.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 -- 172.21.15.31:0/872857044 shutdown_connections 2023-11-27T17:53:25.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 --2- 172.21.15.31:0/872857044 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c601420f0 0x7f3c60142540 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:25.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 --2- 172.21.15.31:0/872857044 >> v2:172.21.15.81:3300/0 conn(0x7f3c600b6a70 0x7f3c600b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 -- 172.21.15.31:0/872857044 >> 172.21.15.31:0/872857044 conn(0x7f3c6006ab60 msgr2=0x7f3c600bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 -- 172.21.15.31:0/872857044 shutdown_connections 2023-11-27T17:53:25.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 -- 172.21.15.31:0/872857044 wait complete. 2023-11-27T17:53:25.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 Processor -- start 2023-11-27T17:53:25.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 -- start start 2023-11-27T17:53:25.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c600b6a70 0x7f3c6014d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:25.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3c601420f0 0x7f3c60071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:25.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c60148470 0x7f3c60142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:25.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c60072050 con 0x7f3c600b6a70 2023-11-27T17:53:25.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c60144fc0 con 0x7f3c60148470 2023-11-27T17:53:25.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c60151ff0 con 0x7f3c601420f0 2023-11-27T17:53:25.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c64ea0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c600b6a70 0x7f3c6014d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:25.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c64ea0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c600b6a70 0x7f3c6014d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50826/0 (socket says 172.21.15.31:50826) 2023-11-27T17:53:25.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c64ea0640 1 -- 172.21.15.31:0/3115169105 learned_addr learned my addr 172.21.15.31:0/3115169105 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:25.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c656a1640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c60148470 0x7f3c60142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:25.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c64ea0640 1 -- 172.21.15.31:0/3115169105 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3c601420f0 msgr2=0x7f3c60071b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:25.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c64ea0640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3c601420f0 0x7f3c60071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:25.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c64ea0640 1 -- 172.21.15.31:0/3115169105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c60148470 msgr2=0x7f3c60142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:25.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c64ea0640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c60148470 0x7f3c60142e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:25.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c64ea0640 1 -- 172.21.15.31:0/3115169105 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c009420 con 0x7f3c600b6a70 2023-11-27T17:53:25.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c64ea0640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c600b6a70 0x7f3c6014d8a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c7c0 tx=0x7f3c5400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:25.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c5d7fa640 1 -- 172.21.15.31:0/3115169105 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54007a30 con 0x7f3c600b6a70 2023-11-27T17:53:25.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c5d7fa640 1 -- 172.21.15.31:0/3115169105 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c54007b90 con 0x7f3c600b6a70 2023-11-27T17:53:25.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 -- 172.21.15.31:0/3115169105 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c601522d0 con 0x7f3c600b6a70 2023-11-27T17:53:25.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c5d7fa640 1 -- 172.21.15.31:0/3115169105 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400ce70 con 0x7f3c600b6a70 2023-11-27T17:53:25.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 -- 172.21.15.31:0/3115169105 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c60072230 con 0x7f3c600b6a70 2023-11-27T17:53:25.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.181+0000 7f3c67104640 1 -- 172.21.15.31:0/3115169105 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6004e850 con 0x7f3c600b6a70 2023-11-27T17:53:25.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.185+0000 7f3c5d7fa640 1 -- 172.21.15.31:0/3115169105 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3c540113f0 con 0x7f3c600b6a70 2023-11-27T17:53:25.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.185+0000 7f3c5d7fa640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3c440667f0 0x7f3c44068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:25.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.185+0000 7f3c5d7fa640 1 -- 172.21.15.31:0/3115169105 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c540847a0 con 0x7f3c600b6a70 2023-11-27T17:53:25.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.185+0000 7f3c5ffff640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3c440667f0 0x7f3c44068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:25.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.185+0000 7f3c5ffff640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3c440667f0 0x7f3c44068cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0af000 tx=0x7f3c4c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:25.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.189+0000 7f3c5d7fa640 1 -- 172.21.15.31:0/3115169105 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f3c54051890 con 0x7f3c600b6a70 2023-11-27T17:53:25.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:25.369+0000 7f3c67104640 1 -- 172.21.15.31:0/3115169105 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3c601415f0 con 0x7f3c600b6a70 2023-11-27T17:53:26.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.065+0000 7f3c5d7fa640 1 -- 172.21.15.31:0/3115169105 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3c54054eb0 con 0x7f3c600b6a70 2023-11-27T17:53:26.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.065+0000 7f3c67104640 1 -- 172.21.15.31:0/3115169105 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3c440667f0 msgr2=0x7f3c44068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.073 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.065+0000 7f3c67104640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3c440667f0 0x7f3c44068cb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0af000 tx=0x7f3c4c008040 comp rx=0 tx=0).stop 2023-11-27T17:53:26.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.065+0000 7f3c67104640 1 -- 172.21.15.31:0/3115169105 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c600b6a70 msgr2=0x7f3c6014d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.076 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.065+0000 7f3c67104640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c600b6a70 0x7f3c6014d8a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c7c0 tx=0x7f3c5400cc80 comp rx=0 tx=0).stop 2023-11-27T17:53:26.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.065+0000 7f3c67104640 1 -- 172.21.15.31:0/3115169105 shutdown_connections 2023-11-27T17:53:26.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.065+0000 7f3c67104640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3c440667f0 0x7f3c44068cb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.065+0000 7f3c67104640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c60148470 0x7f3c60142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.065+0000 7f3c67104640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3c601420f0 0x7f3c60071b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.065+0000 7f3c67104640 1 --2- 172.21.15.31:0/3115169105 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3c600b6a70 0x7f3c6014d8a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.065+0000 7f3c67104640 1 -- 172.21.15.31:0/3115169105 >> 172.21.15.31:0/3115169105 conn(0x7f3c6006ab60 msgr2=0x7f3c6013f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:26.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.065+0000 7f3c67104640 1 -- 172.21.15.31:0/3115169105 shutdown_connections 2023-11-27T17:53:26.077 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.069+0000 7f3c67104640 1 -- 172.21.15.31:0/3115169105 wait complete. 2023-11-27T17:53:26.091 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-27T17:53:26.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:53:26.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.209+0000 7f85ad14f640 1 Processor -- start 2023-11-27T17:53:26.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.209+0000 7f85ad14f640 1 -- start start 2023-11-27T17:53:26.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.209+0000 7f85ad14f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f85a80bab00 0x7f85a80b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.209+0000 7f85ad14f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f85a80baee0 0x7f85a81430b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.209+0000 7f85ad14f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a80b6670 con 0x7f85a81435f0 2023-11-27T17:53:26.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.209+0000 7f85ad14f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80b6cf0 con 0x7f85a80baee0 2023-11-27T17:53:26.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.209+0000 7f85ad14f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80b9570 con 0x7f85a80bab00 2023-11-27T17:53:26.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.209+0000 7f85a759e640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f85a81435f0 0x7f85a81491c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46000/0 (socket says 172.21.15.31:46000) 2023-11-27T17:53:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.209+0000 7f85a759e640 1 -- 172.21.15.31:0/3996741502 learned_addr learned my addr 172.21.15.31:0/3996741502 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.209+0000 7f85a659c640 1 --2- 172.21.15.31:0/3996741502 >> v2:172.21.15.31:3300/0 conn(0x7f85a80baee0 0x7f85a81430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85a6d9d640 1 --2- 172.21.15.31:0/3996741502 >> v2:172.21.15.81:3300/0 conn(0x7f85a80bab00 0x7f85a80b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85a5d9b640 1 -- 172.21.15.31:0/3996741502 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757545406 0 0) 0x7f85a80b6670 con 0x7f85a81435f0 2023-11-27T17:53:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85a5d9b640 1 -- 172.21.15.31:0/3996741502 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8590003530 con 0x7f85a81435f0 2023-11-27T17:53:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85a659c640 1 -- 172.21.15.31:0/3996741502 >> v2:172.21.15.81:3300/0 conn(0x7f85a80bab00 msgr2=0x7f85a80b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85a659c640 1 --2- 172.21.15.31:0/3996741502 >> v2:172.21.15.81:3300/0 conn(0x7f85a80bab00 0x7f85a80b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85a659c640 1 -- 172.21.15.31:0/3996741502 >> v1:172.21.15.31:6789/0 conn(0x7f85a81435f0 legacy=0x7f85a81491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85a659c640 1 -- 172.21.15.31:0/3996741502 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a80b9e10 con 0x7f85a80baee0 2023-11-27T17:53:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85a659c640 1 --2- 172.21.15.31:0/3996741502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85a80baee0 0x7f85a81430b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f85a80bc730 tx=0x7f859c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384dfbd3ae690456 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85a5d9b640 1 -- 172.21.15.31:0/3996741502 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c004230 con 0x7f85a80baee0 2023-11-27T17:53:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85a5d9b640 1 -- 172.21.15.31:0/3996741502 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859c0a7050 con 0x7f85a80baee0 2023-11-27T17:53:26.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85a5d9b640 1 -- 172.21.15.31:0/3996741502 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859c003620 con 0x7f85a80baee0 2023-11-27T17:53:26.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85ad14f640 1 -- 172.21.15.31:0/3996741502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85a80baee0 msgr2=0x7f85a81430b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85ad14f640 1 --2- 172.21.15.31:0/3996741502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85a80baee0 0x7f85a81430b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f85a80bc730 tx=0x7f859c01c460 comp rx=0 tx=0).stop 2023-11-27T17:53:26.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85ad14f640 1 -- 172.21.15.31:0/3996741502 shutdown_connections 2023-11-27T17:53:26.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85ad14f640 1 --2- 172.21.15.31:0/3996741502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85a80baee0 0x7f85a81430b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85ad14f640 1 --2- 172.21.15.31:0/3996741502 >> v2:172.21.15.81:3300/0 conn(0x7f85a80bab00 0x7f85a80b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85ad14f640 1 -- 172.21.15.31:0/3996741502 >> 172.21.15.31:0/3996741502 conn(0x7f85a80beb70 msgr2=0x7f85a80bef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:26.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85ad14f640 1 -- 172.21.15.31:0/3996741502 shutdown_connections 2023-11-27T17:53:26.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.213+0000 7f85ad14f640 1 -- 172.21.15.31:0/3996741502 wait complete. 2023-11-27T17:53:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85ad14f640 1 Processor -- start 2023-11-27T17:53:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85ad14f640 1 -- start start 2023-11-27T17:53:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85ad14f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85a80bab00 0x7f85a806cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85ad14f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85a80baee0 0x7f85a81442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85ad14f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a81435f0 0x7f85a8144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85ad14f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a806d280 con 0x7f85a80bab00 2023-11-27T17:53:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85ad14f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a81457c0 con 0x7f85a81435f0 2023-11-27T17:53:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85ad14f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a8143b30 con 0x7f85a80baee0 2023-11-27T17:53:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85a6d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85a80bab00 0x7f85a806cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85a6d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85a80bab00 0x7f85a806cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50846/0 (socket says 172.21.15.31:50846) 2023-11-27T17:53:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85a6d9d640 1 -- 172.21.15.31:0/1300450246 learned_addr learned my addr 172.21.15.31:0/1300450246 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85a759e640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a81435f0 0x7f85a8144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85a6d9d640 1 -- 172.21.15.31:0/1300450246 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85a80baee0 msgr2=0x7f85a81442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85a6d9d640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85a80baee0 0x7f85a81442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85a6d9d640 1 -- 172.21.15.31:0/1300450246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a81435f0 msgr2=0x7f85a8144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85a6d9d640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a81435f0 0x7f85a8144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85a6d9d640 1 -- 172.21.15.31:0/1300450246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c009420 con 0x7f85a80bab00 2023-11-27T17:53:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85a759e640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a81435f0 0x7f85a8144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85a6d9d640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85a80bab00 0x7f85a806cd40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f859800e930 tx=0x7f859800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f858f7fe640 1 -- 172.21.15.31:0/1300450246 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800c9a0 con 0x7f85a80bab00 2023-11-27T17:53:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f858f7fe640 1 -- 172.21.15.31:0/1300450246 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859800cb00 con 0x7f85a80bab00 2023-11-27T17:53:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f858f7fe640 1 -- 172.21.15.31:0/1300450246 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800ce70 con 0x7f85a80bab00 2023-11-27T17:53:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85ad14f640 1 -- 172.21.15.31:0/1300450246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a8143d80 con 0x7f85a80bab00 2023-11-27T17:53:26.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85ad14f640 1 -- 172.21.15.31:0/1300450246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a8145450 con 0x7f85a80bab00 2023-11-27T17:53:26.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85ad14f640 1 -- 172.21.15.31:0/1300450246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a80b68b0 con 0x7f85a80bab00 2023-11-27T17:53:26.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f858f7fe640 1 -- 172.21.15.31:0/1300450246 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f8598013470 con 0x7f85a80bab00 2023-11-27T17:53:26.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f858f7fe640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8594066820 0x7f8594068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f858f7fe640 1 -- 172.21.15.31:0/1300450246 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8598084480 con 0x7f85a80bab00 2023-11-27T17:53:26.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.217+0000 7f85a659c640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8594066820 0x7f8594068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.221+0000 7f85a659c640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8594066820 0x7f8594068ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f859c0ad000 tx=0x7f859c004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:26.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.221+0000 7f858f7fe640 1 -- 172.21.15.31:0/1300450246 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f8598051640 con 0x7f85a80bab00 2023-11-27T17:53:26.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.409+0000 7f85ad14f640 1 -- 172.21.15.31:0/1300450246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85a804e850 con 0x7f85a80bab00 2023-11-27T17:53:26.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.409+0000 7f858f7fe640 1 -- 172.21.15.31:0/1300450246 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4111 (secure 0 0 0) 0x7f8598054c60 con 0x7f85a80bab00 2023-11-27T17:53:26.414 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:26.414 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/1250401972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1250401972},{"type":"v1","addr":"172.21.15.31:6836","nonce":1250401972}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1133939246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1133939246},{"type":"v1","addr":"172.21.15.31:6837","nonce":1133939246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:53:23.383311+0000","modified":"2023-11-27T17:53:25.372630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6833/88283146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":88283146},{"type":"v1","addr":"172.21.15.81:6833","nonce":88283146}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:53:26.415 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2023-11-27T17:53:26.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.413+0000 7f85ad14f640 1 -- 172.21.15.31:0/1300450246 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8594066820 msgr2=0x7f8594068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.413+0000 7f85ad14f640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8594066820 0x7f8594068ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f859c0ad000 tx=0x7f859c004740 comp rx=0 tx=0).stop 2023-11-27T17:53:26.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.413+0000 7f85ad14f640 1 -- 172.21.15.31:0/1300450246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85a80bab00 msgr2=0x7f85a806cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.413+0000 7f85ad14f640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85a80bab00 0x7f85a806cd40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f859800e930 tx=0x7f859800edf0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.413+0000 7f85ad14f640 1 -- 172.21.15.31:0/1300450246 shutdown_connections 2023-11-27T17:53:26.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.413+0000 7f85ad14f640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8594066820 0x7f8594068ce0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.413+0000 7f85ad14f640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85a81435f0 0x7f85a8144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.413+0000 7f85ad14f640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f85a80baee0 0x7f85a81442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.413+0000 7f85ad14f640 1 --2- 172.21.15.31:0/1300450246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f85a80bab00 0x7f85a806cd40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.413+0000 7f85ad14f640 1 -- 172.21.15.31:0/1300450246 >> 172.21.15.31:0/1300450246 conn(0x7f85a80beb70 msgr2=0x7f85a8141170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:26.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.413+0000 7f85ad14f640 1 -- 172.21.15.31:0/1300450246 shutdown_connections 2023-11-27T17:53:26.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.413+0000 7f85ad14f640 1 -- 172.21.15.31:0/1300450246 wait complete. 2023-11-27T17:53:26.432 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:26.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.545+0000 7f1ecd544640 1 Processor -- start 2023-11-27T17:53:26.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.545+0000 7f1ecd544640 1 -- start start 2023-11-27T17:53:26.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ecd544640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ec80b7480 0x7f1ec814e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ecd544640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec8145ad0 con 0x7f1ec80b5fd0 2023-11-27T17:53:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ecd544640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec80b66c0 con 0x7f1ec81456f0 2023-11-27T17:53:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ecd544640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec80bbcf0 con 0x7f1ec80b7480 2023-11-27T17:53:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec77fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1ec80b5fd0 0x7f1ec814eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46014/0 (socket says 172.21.15.31:46014) 2023-11-27T17:53:26.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec77fe640 1 -- 172.21.15.31:0/1781216691 learned_addr learned my addr 172.21.15.31:0/1781216691 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec67fc640 1 --2- 172.21.15.31:0/1781216691 >> v2:172.21.15.81:3300/0 conn(0x7f1ec80b7480 0x7f1ec814e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511706312 0 0) 0x7f1ec8145ad0 con 0x7f1ec80b5fd0 2023-11-27T17:53:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eb0003530 con 0x7f1ec80b5fd0 2023-11-27T17:53:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3623514176 0 0) 0x7f1eb0003530 con 0x7f1ec80b5fd0 2023-11-27T17:53:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 >> v2:172.21.15.81:3300/0 conn(0x7f1ec80b7480 msgr2=0x7f1ec814e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 --2- 172.21.15.31:0/1781216691 >> v2:172.21.15.81:3300/0 conn(0x7f1ec80b7480 0x7f1ec814e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 >> v1:172.21.15.81:6789/0 conn(0x7f1ec81456f0 legacy=0x7f1ec80bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec80b69a0 con 0x7f1ec80b5fd0 2023-11-27T17:53:26.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f1ec0001a00 con 0x7f1ec80b5fd0 2023-11-27T17:53:26.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 >> v1:172.21.15.31:6789/0 conn(0x7f1ec80b5fd0 legacy=0x7f1ec814eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 --2- 172.21.15.31:0/1781216691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb00039f0 0x7f1eb0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 --2- 172.21.15.31:0/1781216691 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1eb00047d0 0x7f1eb0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 --2- 172.21.15.31:0/1781216691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb0005190 0x7f1eb000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec80bbcf0 con 0x7f1eb0005190 2023-11-27T17:53:26.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb000c0c0 con 0x7f1eb00039f0 2023-11-27T17:53:26.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb000c280 con 0x7f1eb00047d0 2023-11-27T17:53:26.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec77fe640 1 --2- 172.21.15.31:0/1781216691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb0005190 0x7f1eb000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec6ffd640 1 --2- 172.21.15.31:0/1781216691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb00039f0 0x7f1eb0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec67fc640 1 --2- 172.21.15.31:0/1781216691 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1eb00047d0 0x7f1eb0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec77fe640 1 -- 172.21.15.31:0/1781216691 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1eb00047d0 msgr2=0x7f1eb0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:26.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec77fe640 1 --2- 172.21.15.31:0/1781216691 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1eb00047d0 0x7f1eb0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec77fe640 1 -- 172.21.15.31:0/1781216691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb00039f0 msgr2=0x7f1eb0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:26.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec77fe640 1 --2- 172.21.15.31:0/1781216691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb00039f0 0x7f1eb0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec77fe640 1 -- 172.21.15.31:0/1781216691 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb0003530 con 0x7f1eb0005190 2023-11-27T17:53:26.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.549+0000 7f1ec6ffd640 1 --2- 172.21.15.31:0/1781216691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb00039f0 0x7f1eb0003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:26.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec77fe640 1 -- 172.21.15.31:0/1781216691 reap_dead start 2023-11-27T17:53:26.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec77fe640 1 --2- 172.21.15.31:0/1781216691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb0005190 0x7f1eb000b990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000a800 tx=0x7f1ec001d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3609e0eeafbbe0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:26.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec00072d0 con 0x7f1eb0005190 2023-11-27T17:53:26.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec00a8070 con 0x7f1eb0005190 2023-11-27T17:53:26.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec5ffb640 1 -- 172.21.15.31:0/1781216691 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0007690 con 0x7f1eb0005190 2023-11-27T17:53:26.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 -- 172.21.15.31:0/1781216691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb0005190 msgr2=0x7f1eb000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 --2- 172.21.15.31:0/1781216691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb0005190 0x7f1eb000b990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000a800 tx=0x7f1ec001d300 comp rx=0 tx=0).stop 2023-11-27T17:53:26.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 -- 172.21.15.31:0/1781216691 shutdown_connections 2023-11-27T17:53:26.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 --2- 172.21.15.31:0/1781216691 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1eb0005190 0x7f1eb000b990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 -- 172.21.15.31:0/1781216691 >> 172.21.15.31:0/1781216691 conn(0x7f1ec80bd6e0 msgr2=0x7f1ec80bdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:26.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 -- 172.21.15.31:0/1781216691 shutdown_connections 2023-11-27T17:53:26.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 -- 172.21.15.31:0/1781216691 wait complete. 2023-11-27T17:53:26.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 Processor -- start 2023-11-27T17:53:26.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 -- start start 2023-11-27T17:53:26.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb0005190 0x7f1ec8144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ec81e4520 0x7f1ec8147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ec8148160 0x7f1ec813d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec80b99a0 con 0x7f1ec81e4520 2023-11-27T17:53:26.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec81e3d20 con 0x7f1eb0005190 2023-11-27T17:53:26.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ecd544640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec81e4000 con 0x7f1ec8148160 2023-11-27T17:53:26.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec67fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ec81e4520 0x7f1ec8147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec67fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ec81e4520 0x7f1ec8147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50858/0 (socket says 172.21.15.31:50858) 2023-11-27T17:53:26.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec67fc640 1 -- 172.21.15.31:0/362052885 learned_addr learned my addr 172.21.15.31:0/362052885 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:26.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec77fe640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ec8148160 0x7f1ec813d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec6ffd640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb0005190 0x7f1ec8144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec67fc640 1 -- 172.21.15.31:0/362052885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ec8148160 msgr2=0x7f1ec813d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec67fc640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ec8148160 0x7f1ec813d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec67fc640 1 -- 172.21.15.31:0/362052885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb0005190 msgr2=0x7f1ec8144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec67fc640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb0005190 0x7f1ec8144770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec67fc640 1 -- 172.21.15.31:0/362052885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec81d8210 con 0x7f1ec81e4520 2023-11-27T17:53:26.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1ec67fc640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ec81e4520 0x7f1ec8147c20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc011960 tx=0x7f1ebc011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:26.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1eaf7fe640 1 -- 172.21.15.31:0/362052885 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00faf0 con 0x7f1ec81e4520 2023-11-27T17:53:26.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1eaf7fe640 1 -- 172.21.15.31:0/362052885 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ebc00fc50 con 0x7f1ec81e4520 2023-11-27T17:53:26.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.553+0000 7f1eaf7fe640 1 -- 172.21.15.31:0/362052885 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc014440 con 0x7f1ec81e4520 2023-11-27T17:53:26.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.557+0000 7f1ecd544640 1 -- 172.21.15.31:0/362052885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec80ba600 con 0x7f1ec81e4520 2023-11-27T17:53:26.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.557+0000 7f1ecd544640 1 -- 172.21.15.31:0/362052885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec8145cf0 con 0x7f1ec81e4520 2023-11-27T17:53:26.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.557+0000 7f1ecd544640 1 -- 172.21.15.31:0/362052885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec81e41c0 con 0x7f1ec81e4520 2023-11-27T17:53:26.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.557+0000 7f1eaf7fe640 1 -- 172.21.15.31:0/362052885 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1ebc0145a0 con 0x7f1ec81e4520 2023-11-27T17:53:26.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.557+0000 7f1eaf7fe640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1eb40667f0 0x7f1eb4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.557+0000 7f1eaf7fe640 1 -- 172.21.15.31:0/362052885 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ebc084aa0 con 0x7f1ec81e4520 2023-11-27T17:53:26.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.557+0000 7f1ec6ffd640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1eb40667f0 0x7f1eb4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.557+0000 7f1ec6ffd640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1eb40667f0 0x7f1eb4068cb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8000c10 tx=0x7f1eb8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:26.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.561+0000 7f1eaf7fe640 1 -- 172.21.15.31:0/362052885 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1ebc051c30 con 0x7f1ec81e4520 2023-11-27T17:53:26.722 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.717+0000 7f1ecd544640 1 -- 172.21.15.31:0/362052885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ec8066f60 con 0x7f1ec81e4520 2023-11-27T17:53:26.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1eaf7fe640 1 -- 172.21.15.31:0/362052885 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7f1ebc022020 con 0x7f1ec81e4520 2023-11-27T17:53:26.723 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:26.723 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:26.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1ecd544640 1 -- 172.21.15.31:0/362052885 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1eb40667f0 msgr2=0x7f1eb4068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1ecd544640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1eb40667f0 0x7f1eb4068cb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8000c10 tx=0x7f1eb8009040 comp rx=0 tx=0).stop 2023-11-27T17:53:26.725 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1ecd544640 1 -- 172.21.15.31:0/362052885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ec81e4520 msgr2=0x7f1ec8147c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1ecd544640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ec81e4520 0x7f1ec8147c20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc011960 tx=0x7f1ebc011e20 comp rx=0 tx=0).stop 2023-11-27T17:53:26.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1ecd544640 1 -- 172.21.15.31:0/362052885 shutdown_connections 2023-11-27T17:53:26.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1ecd544640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1eb40667f0 0x7f1eb4068cb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1ecd544640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ec8148160 0x7f1ec813d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1ecd544640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ec81e4520 0x7f1ec8147c20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1ecd544640 1 --2- 172.21.15.31:0/362052885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb0005190 0x7f1ec8144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1ecd544640 1 -- 172.21.15.31:0/362052885 >> 172.21.15.31:0/362052885 conn(0x7f1ec80bd6e0 msgr2=0x7f1ec813f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:26.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1ecd544640 1 -- 172.21.15.31:0/362052885 shutdown_connections 2023-11-27T17:53:26.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.721+0000 7f1ecd544640 1 -- 172.21.15.31:0/362052885 wait complete. 2023-11-27T17:53:26.742 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T17:53:26.743 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:53:26.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.853+0000 7fbf25d5a640 1 Processor -- start 2023-11-27T17:53:26.859 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.853+0000 7fbf25d5a640 1 -- start start 2023-11-27T17:53:26.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf25d5a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbf201430a0 0x7fbf200b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf25d5a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf200bd240 0x7fbf20149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf25d5a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf200b5d00 con 0x7fbf200bd6b0 2023-11-27T17:53:26.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf25d5a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf20143750 con 0x7fbf200bd240 2023-11-27T17:53:26.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf25d5a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf20143480 con 0x7fbf201430a0 2023-11-27T17:53:26.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1effd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf200bd240 0x7fbf20149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1effd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbf200bd240 0x7fbf20149070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50874/0 (socket says 172.21.15.31:50874) 2023-11-27T17:53:26.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1effd640 1 -- 172.21.15.31:0/694852815 learned_addr learned my addr 172.21.15.31:0/694852815 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:26.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1ffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbf200bd6b0 0x7fbf2014c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46028/0 (socket says 172.21.15.31:46028) 2023-11-27T17:53:26.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1f7fe640 1 --2- 172.21.15.31:0/694852815 >> v2:172.21.15.81:3300/0 conn(0x7fbf201430a0 0x7fbf200b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1effd640 1 -- 172.21.15.31:0/694852815 >> v2:172.21.15.81:3300/0 conn(0x7fbf201430a0 msgr2=0x7fbf200b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:26.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1effd640 1 --2- 172.21.15.31:0/694852815 >> v2:172.21.15.81:3300/0 conn(0x7fbf201430a0 0x7fbf200b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1effd640 1 -- 172.21.15.31:0/694852815 >> v1:172.21.15.31:6789/0 conn(0x7fbf200bd6b0 legacy=0x7fbf2014c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1effd640 1 -- 172.21.15.31:0/694852815 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf200b4f40 con 0x7fbf200bd240 2023-11-27T17:53:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1effd640 1 --2- 172.21.15.31:0/694852815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf200bd240 0x7fbf20149070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbf200b3f00 tx=0x7fbf1401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58cfceae02d629fe server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1e7fc640 1 -- 172.21.15.31:0/694852815 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf140af400 con 0x7fbf200bd240 2023-11-27T17:53:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1e7fc640 1 -- 172.21.15.31:0/694852815 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf140ab050 con 0x7fbf200bd240 2023-11-27T17:53:26.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.857+0000 7fbf1e7fc640 1 -- 172.21.15.31:0/694852815 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf140af780 con 0x7fbf200bd240 2023-11-27T17:53:26.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 -- 172.21.15.31:0/694852815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf200bd240 msgr2=0x7fbf20149070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 --2- 172.21.15.31:0/694852815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf200bd240 0x7fbf20149070 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbf200b3f00 tx=0x7fbf1401f1c0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 -- 172.21.15.31:0/694852815 shutdown_connections 2023-11-27T17:53:26.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 --2- 172.21.15.31:0/694852815 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf200bd240 0x7fbf20149070 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 --2- 172.21.15.31:0/694852815 >> v2:172.21.15.81:3300/0 conn(0x7fbf201430a0 0x7fbf200b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 -- 172.21.15.31:0/694852815 >> 172.21.15.31:0/694852815 conn(0x7fbf2006ab60 msgr2=0x7fbf200bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:26.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 -- 172.21.15.31:0/694852815 shutdown_connections 2023-11-27T17:53:26.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 -- 172.21.15.31:0/694852815 wait complete. 2023-11-27T17:53:26.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 Processor -- start 2023-11-27T17:53:26.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 -- start start 2023-11-27T17:53:26.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf200bd240 0x7fbf2013b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf200bd6b0 0x7fbf2013c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf201430a0 0x7fbf2013d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2013b820 con 0x7fbf200bd240 2023-11-27T17:53:26.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf201e10e0 con 0x7fbf200bd6b0 2023-11-27T17:53:26.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf201e1350 con 0x7fbf201430a0 2023-11-27T17:53:26.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf1f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf200bd240 0x7fbf2013b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf1f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf200bd240 0x7fbf2013b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50888/0 (socket says 172.21.15.31:50888) 2023-11-27T17:53:26.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf1f7fe640 1 -- 172.21.15.31:0/3007755929 learned_addr learned my addr 172.21.15.31:0/3007755929 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:26.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf1effd640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf200bd6b0 0x7fbf2013c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf1ffff640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf201430a0 0x7fbf2013d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf1f7fe640 1 -- 172.21.15.31:0/3007755929 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf201430a0 msgr2=0x7fbf2013d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf1f7fe640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf201430a0 0x7fbf2013d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf1f7fe640 1 -- 172.21.15.31:0/3007755929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf200bd6b0 msgr2=0x7fbf2013c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:26.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf1f7fe640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf200bd6b0 0x7fbf2013c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:26.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf1f7fe640 1 -- 172.21.15.31:0/3007755929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14009b30 con 0x7fbf200bd240 2023-11-27T17:53:26.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf1ffff640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf201430a0 0x7fbf2013d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:26.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf1f7fe640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf200bd240 0x7fbf2013b2e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000d620 tx=0x7fbf1000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:26.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf07fff640 1 -- 172.21.15.31:0/3007755929 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000b620 con 0x7fbf200bd240 2023-11-27T17:53:26.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf07fff640 1 -- 172.21.15.31:0/3007755929 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1000b780 con 0x7fbf200bd240 2023-11-27T17:53:26.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 -- 172.21.15.31:0/3007755929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf201e1630 con 0x7fbf200bd240 2023-11-27T17:53:26.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf07fff640 1 -- 172.21.15.31:0/3007755929 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000bb10 con 0x7fbf200bd240 2023-11-27T17:53:26.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 -- 172.21.15.31:0/3007755929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2013c690 con 0x7fbf200bd240 2023-11-27T17:53:26.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.861+0000 7fbf25d5a640 1 -- 172.21.15.31:0/3007755929 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf2013cda0 con 0x7fbf200bd240 2023-11-27T17:53:26.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.865+0000 7fbf07fff640 1 -- 172.21.15.31:0/3007755929 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fbf1000bc70 con 0x7fbf200bd240 2023-11-27T17:53:26.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.865+0000 7fbf07fff640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbf0c0667f0 0x7fbf0c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:26.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.865+0000 7fbf07fff640 1 -- 172.21.15.31:0/3007755929 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf10084810 con 0x7fbf200bd240 2023-11-27T17:53:26.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.865+0000 7fbf1effd640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbf0c0667f0 0x7fbf0c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:26.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.865+0000 7fbf1effd640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbf0c0667f0 0x7fbf0c068cb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf140b1000 tx=0x7fbf140aa000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:26.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:26.869+0000 7fbf07fff640 1 -- 172.21.15.31:0/3007755929 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fbf10051880 con 0x7fbf200bd240 2023-11-27T17:53:27.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.025+0000 7fbf25d5a640 1 -- 172.21.15.31:0/3007755929 --> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf200b57e0 con 0x7fbf0c0667f0 2023-11-27T17:53:27.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.041+0000 7fbf07fff640 1 -- 172.21.15.31:0/3007755929 <== mgr.4101 v2:172.21.15.31:6832/1886714170 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249665 (secure 0 0 0) 0x7fbf140bf090 con 0x7fbf0c0667f0 2023-11-27T17:53:27.046 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:27.050 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-11-27T17:53:27.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.045+0000 7fbf25d5a640 1 -- 172.21.15.31:0/3007755929 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbf0c0667f0 msgr2=0x7fbf0c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.045+0000 7fbf25d5a640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbf0c0667f0 0x7fbf0c068cb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbf140b1000 tx=0x7fbf140aa000 comp rx=0 tx=0).stop 2023-11-27T17:53:27.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.045+0000 7fbf25d5a640 1 -- 172.21.15.31:0/3007755929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf200bd240 msgr2=0x7fbf2013b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.045+0000 7fbf25d5a640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf200bd240 0x7fbf2013b2e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000d620 tx=0x7fbf1000dae0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.045+0000 7fbf25d5a640 1 -- 172.21.15.31:0/3007755929 shutdown_connections 2023-11-27T17:53:27.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.045+0000 7fbf25d5a640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbf0c0667f0 0x7fbf0c068cb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.045+0000 7fbf25d5a640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf201430a0 0x7fbf2013d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.045+0000 7fbf25d5a640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf200bd6b0 0x7fbf2013c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.045+0000 7fbf25d5a640 1 --2- 172.21.15.31:0/3007755929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf200bd240 0x7fbf2013b2e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.045+0000 7fbf25d5a640 1 -- 172.21.15.31:0/3007755929 >> 172.21.15.31:0/3007755929 conn(0x7fbf2006ab60 msgr2=0x7fbf200bbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:27.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.045+0000 7fbf25d5a640 1 -- 172.21.15.31:0/3007755929 shutdown_connections 2023-11-27T17:53:27.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.045+0000 7fbf25d5a640 1 -- 172.21.15.31:0/3007755929 wait complete. 2023-11-27T17:53:27.065 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-11-27T17:53:25.098855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218796,"kb_used_data":2368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755924,"statfs":{"total":773094113280,"available":772870066176,"internally_reserved":0,"allocated":2424832,"data_stored":1544642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000978"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-11-27T17:53:14.325255+0000","last_change":"2023-11-27T17:53:12.619175+0000","last_active":"2023-11-27T17:53:14.325255+0000","last_peered":"2023-11-27T17:53:14.325255+0000","last_clean":"2023-11-27T17:53:14.325255+0000","last_became_active":"2023-11-27T17:53:12.617047+0000","last_became_peered":"2023-11-27T17:53:12.617047+0000","last_unstale":"2023-11-27T17:53:14.325255+0000","last_undegraded":"2023-11-27T17:53:14.325255+0000","last_fullsized":"2023-11-27T17:53:14.325255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_clean_scrub_stamp":"2023-11-27T17:53:11.496632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:23:56.619761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:22.990747+0000","last_change":"2023-11-27T17:53:22.990747+0000","last_active":"2023-11-27T17:53:22.990747+0000","last_peered":"2023-11-27T17:53:22.990747+0000","last_clean":"2023-11-27T17:53:22.990747+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:22.990747+0000","last_undegraded":"2023-11-27T17:53:22.990747+0000","last_fullsized":"2023-11-27T17:53:22.990747+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:53:21.979267+0000","last_change":"2023-11-27T17:53:21.979267+0000","last_active":"2023-11-27T17:53:21.979267+0000","last_peered":"2023-11-27T17:53:21.979267+0000","last_clean":"2023-11-27T17:53:21.979267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:53:21.979267+0000","last_undegraded":"2023-11-27T17:53:21.979267+0000","last_fullsized":"2023-11-27T17:53:21.979267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":749568,"data_stored":636111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27168,"kb_used_data":148,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344672,"statfs":{"total":96636764160,"available":96608944128,"internally_reserved":0,"allocated":151552,"data_stored":44724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0660000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3859999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":745472,"data_stored":635092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:53:27.070 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:53:27.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f1861c81640 1 Processor -- start 2023-11-27T17:53:27.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f1861c81640 1 -- start start 2023-11-27T17:53:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f1861c81640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f185c1430a0 0x7f185c0b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f1861c81640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f185c0bd6b0 0x7f185c153980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f1861c81640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c0b5d00 con 0x7f185c0bd240 2023-11-27T17:53:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f1861c81640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c143750 con 0x7f185c0bd6b0 2023-11-27T17:53:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f1861c81640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c143480 con 0x7f185c1430a0 2023-11-27T17:53:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f185bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f185c0bd6b0 0x7f185c153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f185affd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f185c0bd240 0x7f185c149070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46040/0 (socket says 172.21.15.31:46040) 2023-11-27T17:53:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f185affd640 1 -- 172.21.15.31:0/2704379584 learned_addr learned my addr 172.21.15.31:0/2704379584 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f185bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f185c0bd6b0 0x7f185c153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50890/0 (socket says 172.21.15.31:50890) 2023-11-27T17:53:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f185b7fe640 1 --2- 172.21.15.31:0/2704379584 >> v2:172.21.15.81:3300/0 conn(0x7f185c1430a0 0x7f185c0b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.218 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f185bfff640 1 -- 172.21.15.31:0/2704379584 >> v2:172.21.15.81:3300/0 conn(0x7f185c1430a0 msgr2=0x7f185c0b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:27.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f185bfff640 1 --2- 172.21.15.31:0/2704379584 >> v2:172.21.15.81:3300/0 conn(0x7f185c1430a0 0x7f185c0b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f185bfff640 1 -- 172.21.15.31:0/2704379584 >> v1:172.21.15.31:6789/0 conn(0x7f185c0bd240 legacy=0x7f185c149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f185a7fc640 1 -- 172.21.15.31:0/2704379584 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186715958 0 0) 0x7f18540014a0 con 0x7f185c0bd240 2023-11-27T17:53:27.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.213+0000 7f185bfff640 1 -- 172.21.15.31:0/2704379584 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c0b4f40 con 0x7f185c0bd6b0 2023-11-27T17:53:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f185bfff640 1 --2- 172.21.15.31:0/2704379584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f185c0bd6b0 0x7f185c153980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f185c0b3f00 tx=0x7f184401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bcae71e3d122f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f185a7fc640 1 -- 172.21.15.31:0/2704379584 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440a8950 con 0x7f185c0bd6b0 2023-11-27T17:53:27.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f185a7fc640 1 -- 172.21.15.31:0/2704379584 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18440a8ab0 con 0x7f185c0bd6b0 2023-11-27T17:53:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f185a7fc640 1 -- 172.21.15.31:0/2704379584 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440a8e40 con 0x7f185c0bd6b0 2023-11-27T17:53:27.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 -- 172.21.15.31:0/2704379584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f185c0bd6b0 msgr2=0x7f185c153980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 --2- 172.21.15.31:0/2704379584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f185c0bd6b0 0x7f185c153980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f185c0b3f00 tx=0x7f184401ec50 comp rx=0 tx=0).stop 2023-11-27T17:53:27.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 -- 172.21.15.31:0/2704379584 shutdown_connections 2023-11-27T17:53:27.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 --2- 172.21.15.31:0/2704379584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f185c0bd6b0 0x7f185c153980 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 --2- 172.21.15.31:0/2704379584 >> v2:172.21.15.81:3300/0 conn(0x7f185c1430a0 0x7f185c0b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 -- 172.21.15.31:0/2704379584 >> 172.21.15.31:0/2704379584 conn(0x7f185c06ab60 msgr2=0x7f185c0bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:27.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 -- 172.21.15.31:0/2704379584 shutdown_connections 2023-11-27T17:53:27.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 -- 172.21.15.31:0/2704379584 wait complete. 2023-11-27T17:53:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 Processor -- start 2023-11-27T17:53:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 -- start start 2023-11-27T17:53:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f185c0bd240 0x7f185c13b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f185c0bd6b0 0x7f185c1e1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f185c1430a0 0x7f185c139d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c148db0 con 0x7f185c1430a0 2023-11-27T17:53:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c13b5f0 con 0x7f185c0bd6b0 2023-11-27T17:53:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.217+0000 7f1861c81640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c13ce20 con 0x7f185c0bd240 2023-11-27T17:53:27.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f185c1430a0 0x7f185c139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f185c1430a0 0x7f185c139d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50892/0 (socket says 172.21.15.31:50892) 2023-11-27T17:53:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185bfff640 1 -- 172.21.15.31:0/3471949928 learned_addr learned my addr 172.21.15.31:0/3471949928 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185affd640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f185c0bd6b0 0x7f185c1e1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185b7fe640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f185c0bd240 0x7f185c13b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185bfff640 1 -- 172.21.15.31:0/3471949928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f185c0bd240 msgr2=0x7f185c13b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185bfff640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f185c0bd240 0x7f185c13b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185bfff640 1 -- 172.21.15.31:0/3471949928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f185c0bd6b0 msgr2=0x7f185c1e1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185bfff640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f185c0bd6b0 0x7f185c1e1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185bfff640 1 -- 172.21.15.31:0/3471949928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844009420 con 0x7f185c1430a0 2023-11-27T17:53:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185affd640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f185c0bd6b0 0x7f185c1e1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185b7fe640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f185c0bd240 0x7f185c13b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:27.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185bfff640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f185c1430a0 0x7f185c139d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f184401c880 tx=0x7f184401d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f1853fff640 1 -- 172.21.15.31:0/3471949928 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440b1e30 con 0x7f185c1430a0 2023-11-27T17:53:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f1853fff640 1 -- 172.21.15.31:0/3471949928 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1844004030 con 0x7f185c1430a0 2023-11-27T17:53:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f1853fff640 1 -- 172.21.15.31:0/3471949928 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440043a0 con 0x7f185c1430a0 2023-11-27T17:53:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f1861c81640 1 -- 172.21.15.31:0/3471949928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c148ad0 con 0x7f185c1430a0 2023-11-27T17:53:27.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f1861c81640 1 -- 172.21.15.31:0/3471949928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c13c900 con 0x7f185c1430a0 2023-11-27T17:53:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f1861c81640 1 -- 172.21.15.31:0/3471949928 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c13c480 con 0x7f185c1430a0 2023-11-27T17:53:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f1853fff640 1 -- 172.21.15.31:0/3471949928 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1844003620 con 0x7f185c1430a0 2023-11-27T17:53:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f1853fff640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f183c0667f0 0x7f183c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f1853fff640 1 -- 172.21.15.31:0/3471949928 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1844121ce0 con 0x7f185c1430a0 2023-11-27T17:53:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185b7fe640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f183c0667f0 0x7f183c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.221+0000 7f185b7fe640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f183c0667f0 0x7f183c068cb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f184c0097a0 tx=0x7f184c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:27.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.225+0000 7f1853fff640 1 -- 172.21.15.31:0/3471949928 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f185c13c480 con 0x7f185c1430a0 2023-11-27T17:53:27.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.377+0000 7f1861c81640 1 -- 172.21.15.31:0/3471949928 --> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f185c0b4c90 con 0x7f183c0667f0 2023-11-27T17:53:27.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.389+0000 7f1853fff640 1 -- 172.21.15.31:0/3471949928 <== mgr.4101 v2:172.21.15.31:6832/1886714170 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264547 (secure 0 0 0) 0x7f185c0b4c90 con 0x7f183c0667f0 2023-11-27T17:53:27.394 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:27.395 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-11-27T17:53:27.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.393+0000 7f1861c81640 1 -- 172.21.15.31:0/3471949928 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f183c0667f0 msgr2=0x7f183c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.393+0000 7f1861c81640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f183c0667f0 0x7f183c068cb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f184c0097a0 tx=0x7f184c008040 comp rx=0 tx=0).stop 2023-11-27T17:53:27.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.393+0000 7f1861c81640 1 -- 172.21.15.31:0/3471949928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f185c1430a0 msgr2=0x7f185c139d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.393+0000 7f1861c81640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f185c1430a0 0x7f185c139d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f184401c880 tx=0x7f184401d490 comp rx=0 tx=0).stop 2023-11-27T17:53:27.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.393+0000 7f1861c81640 1 -- 172.21.15.31:0/3471949928 shutdown_connections 2023-11-27T17:53:27.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.393+0000 7f1861c81640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f183c0667f0 0x7f183c068cb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.393+0000 7f1861c81640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f185c1430a0 0x7f185c139d40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.393+0000 7f1861c81640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f185c0bd6b0 0x7f185c1e1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.393+0000 7f1861c81640 1 --2- 172.21.15.31:0/3471949928 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f185c0bd240 0x7f185c13b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.393+0000 7f1861c81640 1 -- 172.21.15.31:0/3471949928 >> 172.21.15.31:0/3471949928 conn(0x7f185c06ab60 msgr2=0x7f185c141b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:27.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.393+0000 7f1861c81640 1 -- 172.21.15.31:0/3471949928 shutdown_connections 2023-11-27T17:53:27.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.393+0000 7f1861c81640 1 -- 172.21.15.31:0/3471949928 wait complete. 2023-11-27T17:53:27.411 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-11-27T17:53:27.099270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2792,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2859008,"data_stored":1738198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.107887"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395865+0000","last_change":"2023-11-27T17:53:24.062894+0000","last_active":"2023-11-27T17:53:25.395865+0000","last_peered":"2023-11-27T17:53:25.395865+0000","last_clean":"2023-11-27T17:53:25.395865+0000","last_became_active":"2023-11-27T17:53:24.062500+0000","last_became_peered":"2023-11-27T17:53:24.062500+0000","last_unstale":"2023-11-27T17:53:25.395865+0000","last_undegraded":"2023-11-27T17:53:25.395865+0000","last_fullsized":"2023-11-27T17:53:25.395865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:29:16.084481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011846+0000","last_change":"2023-11-27T17:53:24.036794+0000","last_active":"2023-11-27T17:53:25.011846+0000","last_peered":"2023-11-27T17:53:25.011846+0000","last_clean":"2023-11-27T17:53:25.011846+0000","last_became_active":"2023-11-27T17:53:24.036027+0000","last_became_peered":"2023-11-27T17:53:24.036027+0000","last_unstale":"2023-11-27T17:53:25.011846+0000","last_undegraded":"2023-11-27T17:53:25.011846+0000","last_fullsized":"2023-11-27T17:53:25.011846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:05.212482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003604+0000","last_change":"2023-11-27T17:53:24.029493+0000","last_active":"2023-11-27T17:53:26.003604+0000","last_peered":"2023-11-27T17:53:26.003604+0000","last_clean":"2023-11-27T17:53:26.003604+0000","last_became_active":"2023-11-27T17:53:24.028728+0000","last_became_peered":"2023-11-27T17:53:24.028728+0000","last_unstale":"2023-11-27T17:53:26.003604+0000","last_undegraded":"2023-11-27T17:53:26.003604+0000","last_fullsized":"2023-11-27T17:53:26.003604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:02:45.456945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016367+0000","last_change":"2023-11-27T17:53:24.051148+0000","last_active":"2023-11-27T17:53:25.016367+0000","last_peered":"2023-11-27T17:53:25.016367+0000","last_clean":"2023-11-27T17:53:25.016367+0000","last_became_active":"2023-11-27T17:53:24.050514+0000","last_became_peered":"2023-11-27T17:53:24.050514+0000","last_unstale":"2023-11-27T17:53:25.016367+0000","last_undegraded":"2023-11-27T17:53:25.016367+0000","last_fullsized":"2023-11-27T17:53:25.016367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:31:47.833242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395427+0000","last_change":"2023-11-27T17:53:24.058848+0000","last_active":"2023-11-27T17:53:25.395427+0000","last_peered":"2023-11-27T17:53:25.395427+0000","last_clean":"2023-11-27T17:53:25.395427+0000","last_became_active":"2023-11-27T17:53:24.057769+0000","last_became_peered":"2023-11-27T17:53:24.057769+0000","last_unstale":"2023-11-27T17:53:25.395427+0000","last_undegraded":"2023-11-27T17:53:25.395427+0000","last_fullsized":"2023-11-27T17:53:25.395427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:42.148671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016789+0000","last_change":"2023-11-27T17:53:24.033343+0000","last_active":"2023-11-27T17:53:25.016789+0000","last_peered":"2023-11-27T17:53:25.016789+0000","last_clean":"2023-11-27T17:53:25.016789+0000","last_became_active":"2023-11-27T17:53:24.032589+0000","last_became_peered":"2023-11-27T17:53:24.032589+0000","last_unstale":"2023-11-27T17:53:25.016789+0000","last_undegraded":"2023-11-27T17:53:25.016789+0000","last_fullsized":"2023-11-27T17:53:25.016789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:18.581213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.394947+0000","last_change":"2023-11-27T17:53:24.058949+0000","last_active":"2023-11-27T17:53:25.394947+0000","last_peered":"2023-11-27T17:53:25.394947+0000","last_clean":"2023-11-27T17:53:25.394947+0000","last_became_active":"2023-11-27T17:53:24.058569+0000","last_became_peered":"2023-11-27T17:53:24.058569+0000","last_unstale":"2023-11-27T17:53:25.394947+0000","last_undegraded":"2023-11-27T17:53:25.394947+0000","last_fullsized":"2023-11-27T17:53:25.394947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:00.496330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478419+0000","last_change":"2023-11-27T17:53:24.072983+0000","last_active":"2023-11-27T17:53:25.478419+0000","last_peered":"2023-11-27T17:53:25.478419+0000","last_clean":"2023-11-27T17:53:25.478419+0000","last_became_active":"2023-11-27T17:53:24.072703+0000","last_became_peered":"2023-11-27T17:53:24.072703+0000","last_unstale":"2023-11-27T17:53:25.478419+0000","last_undegraded":"2023-11-27T17:53:25.478419+0000","last_fullsized":"2023-11-27T17:53:25.478419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:09.583099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395982+0000","last_change":"2023-11-27T17:53:24.072810+0000","last_active":"2023-11-27T17:53:25.395982+0000","last_peered":"2023-11-27T17:53:25.395982+0000","last_clean":"2023-11-27T17:53:25.395982+0000","last_became_active":"2023-11-27T17:53:24.072518+0000","last_became_peered":"2023-11-27T17:53:24.072518+0000","last_unstale":"2023-11-27T17:53:25.395982+0000","last_undegraded":"2023-11-27T17:53:25.395982+0000","last_fullsized":"2023-11-27T17:53:25.395982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:05:46.880825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004775+0000","last_change":"2023-11-27T17:53:24.053163+0000","last_active":"2023-11-27T17:53:26.004775+0000","last_peered":"2023-11-27T17:53:26.004775+0000","last_clean":"2023-11-27T17:53:26.004775+0000","last_became_active":"2023-11-27T17:53:24.052872+0000","last_became_peered":"2023-11-27T17:53:24.052872+0000","last_unstale":"2023-11-27T17:53:26.004775+0000","last_undegraded":"2023-11-27T17:53:26.004775+0000","last_fullsized":"2023-11-27T17:53:26.004775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004476+0000","last_change":"2023-11-27T17:53:24.053130+0000","last_active":"2023-11-27T17:53:26.004476+0000","last_peered":"2023-11-27T17:53:26.004476+0000","last_clean":"2023-11-27T17:53:26.004476+0000","last_became_active":"2023-11-27T17:53:24.052787+0000","last_became_peered":"2023-11-27T17:53:24.052787+0000","last_unstale":"2023-11-27T17:53:26.004476+0000","last_undegraded":"2023-11-27T17:53:26.004476+0000","last_fullsized":"2023-11-27T17:53:26.004476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:05.212482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018380+0000","last_change":"2023-11-27T17:53:24.056001+0000","last_active":"2023-11-27T17:53:25.018380+0000","last_peered":"2023-11-27T17:53:25.018380+0000","last_clean":"2023-11-27T17:53:25.018380+0000","last_became_active":"2023-11-27T17:53:24.055416+0000","last_became_peered":"2023-11-27T17:53:24.055416+0000","last_unstale":"2023-11-27T17:53:25.018380+0000","last_undegraded":"2023-11-27T17:53:25.018380+0000","last_fullsized":"2023-11-27T17:53:25.018380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:55.367408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479176+0000","last_change":"2023-11-27T17:53:24.049800+0000","last_active":"2023-11-27T17:53:25.479176+0000","last_peered":"2023-11-27T17:53:25.479176+0000","last_clean":"2023-11-27T17:53:25.479176+0000","last_became_active":"2023-11-27T17:53:24.049305+0000","last_became_peered":"2023-11-27T17:53:24.049305+0000","last_unstale":"2023-11-27T17:53:25.479176+0000","last_undegraded":"2023-11-27T17:53:25.479176+0000","last_fullsized":"2023-11-27T17:53:25.479176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:31:47.833242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003229+0000","last_change":"2023-11-27T17:53:24.044494+0000","last_active":"2023-11-27T17:53:26.003229+0000","last_peered":"2023-11-27T17:53:26.003229+0000","last_clean":"2023-11-27T17:53:26.003229+0000","last_became_active":"2023-11-27T17:53:24.043437+0000","last_became_peered":"2023-11-27T17:53:24.043437+0000","last_unstale":"2023-11-27T17:53:26.003229+0000","last_undegraded":"2023-11-27T17:53:26.003229+0000","last_fullsized":"2023-11-27T17:53:26.003229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:58:40.376602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011549+0000","last_change":"2023-11-27T17:53:24.068179+0000","last_active":"2023-11-27T17:53:25.011549+0000","last_peered":"2023-11-27T17:53:25.011549+0000","last_clean":"2023-11-27T17:53:25.011549+0000","last_became_active":"2023-11-27T17:53:24.067950+0000","last_became_peered":"2023-11-27T17:53:24.067950+0000","last_unstale":"2023-11-27T17:53:25.011549+0000","last_undegraded":"2023-11-27T17:53:25.011549+0000","last_fullsized":"2023-11-27T17:53:25.011549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:08.111590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.015927+0000","last_change":"2023-11-27T17:53:24.039650+0000","last_active":"2023-11-27T17:53:25.015927+0000","last_peered":"2023-11-27T17:53:25.015927+0000","last_clean":"2023-11-27T17:53:25.015927+0000","last_became_active":"2023-11-27T17:53:24.032492+0000","last_became_peered":"2023-11-27T17:53:24.032492+0000","last_unstale":"2023-11-27T17:53:25.015927+0000","last_undegraded":"2023-11-27T17:53:25.015927+0000","last_fullsized":"2023-11-27T17:53:25.015927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016918+0000","last_change":"2023-11-27T17:53:24.044455+0000","last_active":"2023-11-27T17:53:25.016918+0000","last_peered":"2023-11-27T17:53:25.016918+0000","last_clean":"2023-11-27T17:53:25.016918+0000","last_became_active":"2023-11-27T17:53:24.043760+0000","last_became_peered":"2023-11-27T17:53:24.043760+0000","last_unstale":"2023-11-27T17:53:25.016918+0000","last_undegraded":"2023-11-27T17:53:25.016918+0000","last_fullsized":"2023-11-27T17:53:25.016918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:25:13.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508706+0000","last_change":"2023-11-27T17:53:24.061714+0000","last_active":"2023-11-27T17:53:25.508706+0000","last_peered":"2023-11-27T17:53:25.508706+0000","last_clean":"2023-11-27T17:53:25.508706+0000","last_became_active":"2023-11-27T17:53:24.061290+0000","last_became_peered":"2023-11-27T17:53:24.061290+0000","last_unstale":"2023-11-27T17:53:25.508706+0000","last_undegraded":"2023-11-27T17:53:25.508706+0000","last_fullsized":"2023-11-27T17:53:25.508706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:17.690966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395682+0000","last_change":"2023-11-27T17:53:24.060361+0000","last_active":"2023-11-27T17:53:25.395682+0000","last_peered":"2023-11-27T17:53:25.395682+0000","last_clean":"2023-11-27T17:53:25.395682+0000","last_became_active":"2023-11-27T17:53:24.060020+0000","last_became_peered":"2023-11-27T17:53:24.060020+0000","last_unstale":"2023-11-27T17:53:25.395682+0000","last_undegraded":"2023-11-27T17:53:25.395682+0000","last_fullsized":"2023-11-27T17:53:25.395682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:29:14.184726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004387+0000","last_change":"2023-11-27T17:53:24.060993+0000","last_active":"2023-11-27T17:53:26.004387+0000","last_peered":"2023-11-27T17:53:26.004387+0000","last_clean":"2023-11-27T17:53:26.004387+0000","last_became_active":"2023-11-27T17:53:24.060615+0000","last_became_peered":"2023-11-27T17:53:24.060615+0000","last_unstale":"2023-11-27T17:53:26.004387+0000","last_undegraded":"2023-11-27T17:53:26.004387+0000","last_fullsized":"2023-11-27T17:53:26.004387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:12.057622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003656+0000","last_change":"2023-11-27T17:53:24.034287+0000","last_active":"2023-11-27T17:53:26.003656+0000","last_peered":"2023-11-27T17:53:26.003656+0000","last_clean":"2023-11-27T17:53:26.003656+0000","last_became_active":"2023-11-27T17:53:24.033459+0000","last_became_peered":"2023-11-27T17:53:24.033459+0000","last_unstale":"2023-11-27T17:53:26.003656+0000","last_undegraded":"2023-11-27T17:53:26.003656+0000","last_fullsized":"2023-11-27T17:53:26.003656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:09.583099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017119+0000","last_change":"2023-11-27T17:53:24.043218+0000","last_active":"2023-11-27T17:53:25.017119+0000","last_peered":"2023-11-27T17:53:25.017119+0000","last_clean":"2023-11-27T17:53:25.017119+0000","last_became_active":"2023-11-27T17:53:24.042477+0000","last_became_peered":"2023-11-27T17:53:24.042477+0000","last_unstale":"2023-11-27T17:53:25.017119+0000","last_undegraded":"2023-11-27T17:53:25.017119+0000","last_fullsized":"2023-11-27T17:53:25.017119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:45.619458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478541+0000","last_change":"2023-11-27T17:53:24.064722+0000","last_active":"2023-11-27T17:53:25.478541+0000","last_peered":"2023-11-27T17:53:25.478541+0000","last_clean":"2023-11-27T17:53:25.478541+0000","last_became_active":"2023-11-27T17:53:24.064493+0000","last_became_peered":"2023-11-27T17:53:24.064493+0000","last_unstale":"2023-11-27T17:53:25.478541+0000","last_undegraded":"2023-11-27T17:53:25.478541+0000","last_fullsized":"2023-11-27T17:53:25.478541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:08.111590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016133+0000","last_change":"2023-11-27T17:53:24.052119+0000","last_active":"2023-11-27T17:53:25.016133+0000","last_peered":"2023-11-27T17:53:25.016133+0000","last_clean":"2023-11-27T17:53:25.016133+0000","last_became_active":"2023-11-27T17:53:24.051624+0000","last_became_peered":"2023-11-27T17:53:24.051624+0000","last_unstale":"2023-11-27T17:53:25.016133+0000","last_undegraded":"2023-11-27T17:53:25.016133+0000","last_fullsized":"2023-11-27T17:53:25.016133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479148+0000","last_change":"2023-11-27T17:53:24.067043+0000","last_active":"2023-11-27T17:53:25.479148+0000","last_peered":"2023-11-27T17:53:25.479148+0000","last_clean":"2023-11-27T17:53:25.479148+0000","last_became_active":"2023-11-27T17:53:24.066729+0000","last_became_peered":"2023-11-27T17:53:24.066729+0000","last_unstale":"2023-11-27T17:53:25.479148+0000","last_undegraded":"2023-11-27T17:53:25.479148+0000","last_fullsized":"2023-11-27T17:53:25.479148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004884+0000","last_change":"2023-11-27T17:53:24.036465+0000","last_active":"2023-11-27T17:53:26.004884+0000","last_peered":"2023-11-27T17:53:26.004884+0000","last_clean":"2023-11-27T17:53:26.004884+0000","last_became_active":"2023-11-27T17:53:24.035465+0000","last_became_peered":"2023-11-27T17:53:24.035465+0000","last_unstale":"2023-11-27T17:53:26.004884+0000","last_undegraded":"2023-11-27T17:53:26.004884+0000","last_fullsized":"2023-11-27T17:53:26.004884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011960+0000","last_change":"2023-11-27T17:53:24.050153+0000","last_active":"2023-11-27T17:53:25.011960+0000","last_peered":"2023-11-27T17:53:25.011960+0000","last_clean":"2023-11-27T17:53:25.011960+0000","last_became_active":"2023-11-27T17:53:24.049753+0000","last_became_peered":"2023-11-27T17:53:24.049753+0000","last_unstale":"2023-11-27T17:53:25.011960+0000","last_undegraded":"2023-11-27T17:53:25.011960+0000","last_fullsized":"2023-11-27T17:53:25.011960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479449+0000","last_change":"2023-11-27T17:53:24.067038+0000","last_active":"2023-11-27T17:53:25.479449+0000","last_peered":"2023-11-27T17:53:25.479449+0000","last_clean":"2023-11-27T17:53:25.479449+0000","last_became_active":"2023-11-27T17:53:24.066602+0000","last_became_peered":"2023-11-27T17:53:24.066602+0000","last_unstale":"2023-11-27T17:53:25.479449+0000","last_undegraded":"2023-11-27T17:53:25.479449+0000","last_fullsized":"2023-11-27T17:53:25.479449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:00.496330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003728+0000","last_change":"2023-11-27T17:53:24.052124+0000","last_active":"2023-11-27T17:53:26.003728+0000","last_peered":"2023-11-27T17:53:26.003728+0000","last_clean":"2023-11-27T17:53:26.003728+0000","last_became_active":"2023-11-27T17:53:24.051722+0000","last_became_peered":"2023-11-27T17:53:24.051722+0000","last_unstale":"2023-11-27T17:53:26.003728+0000","last_undegraded":"2023-11-27T17:53:26.003728+0000","last_fullsized":"2023-11-27T17:53:26.003728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:08.111590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017236+0000","last_change":"2023-11-27T17:53:24.051693+0000","last_active":"2023-11-27T17:53:25.017236+0000","last_peered":"2023-11-27T17:53:25.017236+0000","last_clean":"2023-11-27T17:53:25.017236+0000","last_became_active":"2023-11-27T17:53:24.051275+0000","last_became_peered":"2023-11-27T17:53:24.051275+0000","last_unstale":"2023-11-27T17:53:25.017236+0000","last_undegraded":"2023-11-27T17:53:25.017236+0000","last_fullsized":"2023-11-27T17:53:25.017236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:42.148671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508418+0000","last_change":"2023-11-27T17:53:24.071800+0000","last_active":"2023-11-27T17:53:25.508418+0000","last_peered":"2023-11-27T17:53:25.508418+0000","last_clean":"2023-11-27T17:53:25.508418+0000","last_became_active":"2023-11-27T17:53:24.071429+0000","last_became_peered":"2023-11-27T17:53:24.071429+0000","last_unstale":"2023-11-27T17:53:25.508418+0000","last_undegraded":"2023-11-27T17:53:25.508418+0000","last_fullsized":"2023-11-27T17:53:25.508418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:55.367408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003995+0000","last_change":"2023-11-27T17:53:24.050375+0000","last_active":"2023-11-27T17:53:26.003995+0000","last_peered":"2023-11-27T17:53:26.003995+0000","last_clean":"2023-11-27T17:53:26.003995+0000","last_became_active":"2023-11-27T17:53:24.050027+0000","last_became_peered":"2023-11-27T17:53:24.050027+0000","last_unstale":"2023-11-27T17:53:26.003995+0000","last_undegraded":"2023-11-27T17:53:26.003995+0000","last_fullsized":"2023-11-27T17:53:26.003995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:02:45.456945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017504+0000","last_change":"2023-11-27T17:53:24.053416+0000","last_active":"2023-11-27T17:53:25.017504+0000","last_peered":"2023-11-27T17:53:25.017504+0000","last_clean":"2023-11-27T17:53:25.017504+0000","last_became_active":"2023-11-27T17:53:24.053023+0000","last_became_peered":"2023-11-27T17:53:24.053023+0000","last_unstale":"2023-11-27T17:53:25.017504+0000","last_undegraded":"2023-11-27T17:53:25.017504+0000","last_fullsized":"2023-11-27T17:53:25.017504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:42.233281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479422+0000","last_change":"2023-11-27T17:53:23.058792+0000","last_active":"2023-11-27T17:53:25.479422+0000","last_peered":"2023-11-27T17:53:25.479422+0000","last_clean":"2023-11-27T17:53:25.479422+0000","last_became_active":"2023-11-27T17:53:23.058366+0000","last_became_peered":"2023-11-27T17:53:23.058366+0000","last_unstale":"2023-11-27T17:53:25.479422+0000","last_undegraded":"2023-11-27T17:53:25.479422+0000","last_fullsized":"2023-11-27T17:53:25.479422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:54.418108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004049+0000","last_change":"2023-11-27T17:53:24.038901+0000","last_active":"2023-11-27T17:53:26.004049+0000","last_peered":"2023-11-27T17:53:26.004049+0000","last_clean":"2023-11-27T17:53:26.004049+0000","last_became_active":"2023-11-27T17:53:24.038167+0000","last_became_peered":"2023-11-27T17:53:24.038167+0000","last_unstale":"2023-11-27T17:53:26.004049+0000","last_undegraded":"2023-11-27T17:53:26.004049+0000","last_fullsized":"2023-11-27T17:53:26.004049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004374+0000","last_change":"2023-11-27T17:53:23.043861+0000","last_active":"2023-11-27T17:53:26.004374+0000","last_peered":"2023-11-27T17:53:26.004374+0000","last_clean":"2023-11-27T17:53:26.004374+0000","last_became_active":"2023-11-27T17:53:23.043043+0000","last_became_peered":"2023-11-27T17:53:23.043043+0000","last_unstale":"2023-11-27T17:53:26.004374+0000","last_undegraded":"2023-11-27T17:53:26.004374+0000","last_fullsized":"2023-11-27T17:53:26.004374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:05:18.882272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478806+0000","last_change":"2023-11-27T17:53:23.041971+0000","last_active":"2023-11-27T17:53:25.478806+0000","last_peered":"2023-11-27T17:53:25.478806+0000","last_clean":"2023-11-27T17:53:25.478806+0000","last_became_active":"2023-11-27T17:53:23.041559+0000","last_became_peered":"2023-11-27T17:53:23.041559+0000","last_unstale":"2023-11-27T17:53:25.478806+0000","last_undegraded":"2023-11-27T17:53:25.478806+0000","last_fullsized":"2023-11-27T17:53:25.478806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:00:57.689429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478592+0000","last_change":"2023-11-27T17:53:24.050436+0000","last_active":"2023-11-27T17:53:25.478592+0000","last_peered":"2023-11-27T17:53:25.478592+0000","last_clean":"2023-11-27T17:53:25.478592+0000","last_became_active":"2023-11-27T17:53:24.050061+0000","last_became_peered":"2023-11-27T17:53:24.050061+0000","last_unstale":"2023-11-27T17:53:25.478592+0000","last_undegraded":"2023-11-27T17:53:25.478592+0000","last_fullsized":"2023-11-27T17:53:25.478592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:12.057622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016172+0000","last_change":"2023-11-27T17:53:23.053689+0000","last_active":"2023-11-27T17:53:25.016172+0000","last_peered":"2023-11-27T17:53:25.016172+0000","last_clean":"2023-11-27T17:53:25.016172+0000","last_became_active":"2023-11-27T17:53:23.053057+0000","last_became_peered":"2023-11-27T17:53:23.053057+0000","last_unstale":"2023-11-27T17:53:25.016172+0000","last_undegraded":"2023-11-27T17:53:25.016172+0000","last_fullsized":"2023-11-27T17:53:25.016172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:05:18.882272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011415+0000","last_change":"2023-11-27T17:53:24.054176+0000","last_active":"2023-11-27T17:53:25.011415+0000","last_peered":"2023-11-27T17:53:25.011415+0000","last_clean":"2023-11-27T17:53:25.011415+0000","last_became_active":"2023-11-27T17:53:24.053857+0000","last_became_peered":"2023-11-27T17:53:24.053857+0000","last_unstale":"2023-11-27T17:53:25.011415+0000","last_undegraded":"2023-11-27T17:53:25.011415+0000","last_fullsized":"2023-11-27T17:53:25.011415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:09.583099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004857+0000","last_change":"2023-11-27T17:53:23.056432+0000","last_active":"2023-11-27T17:53:26.004857+0000","last_peered":"2023-11-27T17:53:26.004857+0000","last_clean":"2023-11-27T17:53:26.004857+0000","last_became_active":"2023-11-27T17:53:23.055625+0000","last_became_peered":"2023-11-27T17:53:23.055625+0000","last_unstale":"2023-11-27T17:53:26.004857+0000","last_undegraded":"2023-11-27T17:53:26.004857+0000","last_fullsized":"2023-11-27T17:53:26.004857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:41.221801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016671+0000","last_change":"2023-11-27T17:53:24.043160+0000","last_active":"2023-11-27T17:53:25.016671+0000","last_peered":"2023-11-27T17:53:25.016671+0000","last_clean":"2023-11-27T17:53:25.016671+0000","last_became_active":"2023-11-27T17:53:24.042227+0000","last_became_peered":"2023-11-27T17:53:24.042227+0000","last_unstale":"2023-11-27T17:53:25.016671+0000","last_undegraded":"2023-11-27T17:53:25.016671+0000","last_fullsized":"2023-11-27T17:53:25.016671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:43:50.934311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016683+0000","last_change":"2023-11-27T17:53:23.055506+0000","last_active":"2023-11-27T17:53:25.016683+0000","last_peered":"2023-11-27T17:53:25.016683+0000","last_clean":"2023-11-27T17:53:25.016683+0000","last_became_active":"2023-11-27T17:53:23.054754+0000","last_became_peered":"2023-11-27T17:53:23.054754+0000","last_unstale":"2023-11-27T17:53:25.016683+0000","last_undegraded":"2023-11-27T17:53:25.016683+0000","last_fullsized":"2023-11-27T17:53:25.016683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:07.100110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003813+0000","last_change":"2023-11-27T17:53:24.053672+0000","last_active":"2023-11-27T17:53:26.003813+0000","last_peered":"2023-11-27T17:53:26.003813+0000","last_clean":"2023-11-27T17:53:26.003813+0000","last_became_active":"2023-11-27T17:53:24.053313+0000","last_became_peered":"2023-11-27T17:53:24.053313+0000","last_unstale":"2023-11-27T17:53:26.003813+0000","last_undegraded":"2023-11-27T17:53:26.003813+0000","last_fullsized":"2023-11-27T17:53:26.003813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:05.212482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.012084+0000","last_change":"2023-11-27T17:53:23.054682+0000","last_active":"2023-11-27T17:53:25.012084+0000","last_peered":"2023-11-27T17:53:25.012084+0000","last_clean":"2023-11-27T17:53:25.012084+0000","last_became_active":"2023-11-27T17:53:23.054371+0000","last_became_peered":"2023-11-27T17:53:23.054371+0000","last_unstale":"2023-11-27T17:53:25.012084+0000","last_undegraded":"2023-11-27T17:53:25.012084+0000","last_fullsized":"2023-11-27T17:53:25.012084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:05:18.882272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018654+0000","last_change":"2023-11-27T17:53:24.039799+0000","last_active":"2023-11-27T17:53:25.018654+0000","last_peered":"2023-11-27T17:53:25.018654+0000","last_clean":"2023-11-27T17:53:25.018654+0000","last_became_active":"2023-11-27T17:53:24.038490+0000","last_became_peered":"2023-11-27T17:53:24.038490+0000","last_unstale":"2023-11-27T17:53:25.018654+0000","last_undegraded":"2023-11-27T17:53:25.018654+0000","last_fullsized":"2023-11-27T17:53:25.018654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:17.690966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004368+0000","last_change":"2023-11-27T17:53:23.041778+0000","last_active":"2023-11-27T17:53:26.004368+0000","last_peered":"2023-11-27T17:53:26.004368+0000","last_clean":"2023-11-27T17:53:26.004368+0000","last_became_active":"2023-11-27T17:53:23.040987+0000","last_became_peered":"2023-11-27T17:53:23.040987+0000","last_unstale":"2023-11-27T17:53:26.004368+0000","last_undegraded":"2023-11-27T17:53:26.004368+0000","last_fullsized":"2023-11-27T17:53:26.004368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:54.418108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395177+0000","last_change":"2023-11-27T17:53:24.059693+0000","last_active":"2023-11-27T17:53:25.395177+0000","last_peered":"2023-11-27T17:53:25.395177+0000","last_clean":"2023-11-27T17:53:25.395177+0000","last_became_active":"2023-11-27T17:53:24.059382+0000","last_became_peered":"2023-11-27T17:53:24.059382+0000","last_unstale":"2023-11-27T17:53:25.395177+0000","last_undegraded":"2023-11-27T17:53:25.395177+0000","last_fullsized":"2023-11-27T17:53:25.395177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:25:13.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004024+0000","last_change":"2023-11-27T17:53:23.035915+0000","last_active":"2023-11-27T17:53:26.004024+0000","last_peered":"2023-11-27T17:53:26.004024+0000","last_clean":"2023-11-27T17:53:26.004024+0000","last_became_active":"2023-11-27T17:53:23.035185+0000","last_became_peered":"2023-11-27T17:53:23.035185+0000","last_unstale":"2023-11-27T17:53:26.004024+0000","last_undegraded":"2023-11-27T17:53:26.004024+0000","last_fullsized":"2023-11-27T17:53:26.004024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.633096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003295+0000","last_change":"2023-11-27T17:53:24.042633+0000","last_active":"2023-11-27T17:53:26.003295+0000","last_peered":"2023-11-27T17:53:26.003295+0000","last_clean":"2023-11-27T17:53:26.003295+0000","last_became_active":"2023-11-27T17:53:24.041865+0000","last_became_peered":"2023-11-27T17:53:24.041865+0000","last_unstale":"2023-11-27T17:53:26.003295+0000","last_undegraded":"2023-11-27T17:53:26.003295+0000","last_fullsized":"2023-11-27T17:53:26.003295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:55.429588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017332+0000","last_change":"2023-11-27T17:53:23.050229+0000","last_active":"2023-11-27T17:53:25.017332+0000","last_peered":"2023-11-27T17:53:25.017332+0000","last_clean":"2023-11-27T17:53:25.017332+0000","last_became_active":"2023-11-27T17:53:23.049600+0000","last_became_peered":"2023-11-27T17:53:23.049600+0000","last_unstale":"2023-11-27T17:53:25.017332+0000","last_undegraded":"2023-11-27T17:53:25.017332+0000","last_fullsized":"2023-11-27T17:53:25.017332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:54.355928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395687+0000","last_change":"2023-11-27T17:53:24.069376+0000","last_active":"2023-11-27T17:53:25.395687+0000","last_peered":"2023-11-27T17:53:25.395687+0000","last_clean":"2023-11-27T17:53:25.395687+0000","last_became_active":"2023-11-27T17:53:24.069060+0000","last_became_peered":"2023-11-27T17:53:24.069060+0000","last_unstale":"2023-11-27T17:53:25.395687+0000","last_undegraded":"2023-11-27T17:53:25.395687+0000","last_fullsized":"2023-11-27T17:53:25.395687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:35:18.811780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003937+0000","last_change":"2023-11-27T17:53:23.043670+0000","last_active":"2023-11-27T17:53:26.003937+0000","last_peered":"2023-11-27T17:53:26.003937+0000","last_clean":"2023-11-27T17:53:26.003937+0000","last_became_active":"2023-11-27T17:53:23.042834+0000","last_became_peered":"2023-11-27T17:53:23.042834+0000","last_unstale":"2023-11-27T17:53:26.003937+0000","last_undegraded":"2023-11-27T17:53:26.003937+0000","last_fullsized":"2023-11-27T17:53:26.003937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:00:57.689429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004035+0000","last_change":"2023-11-27T17:53:24.046699+0000","last_active":"2023-11-27T17:53:26.004035+0000","last_peered":"2023-11-27T17:53:26.004035+0000","last_clean":"2023-11-27T17:53:26.004035+0000","last_became_active":"2023-11-27T17:53:24.045787+0000","last_became_peered":"2023-11-27T17:53:24.045787+0000","last_unstale":"2023-11-27T17:53:26.004035+0000","last_undegraded":"2023-11-27T17:53:26.004035+0000","last_fullsized":"2023-11-27T17:53:26.004035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:09.583099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508349+0000","last_change":"2023-11-27T17:53:23.026816+0000","last_active":"2023-11-27T17:53:25.508349+0000","last_peered":"2023-11-27T17:53:25.508349+0000","last_clean":"2023-11-27T17:53:25.508349+0000","last_became_active":"2023-11-27T17:53:23.026389+0000","last_became_peered":"2023-11-27T17:53:23.026389+0000","last_unstale":"2023-11-27T17:53:25.508349+0000","last_undegraded":"2023-11-27T17:53:25.508349+0000","last_fullsized":"2023-11-27T17:53:25.508349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:51:12.666393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395043+0000","last_change":"2023-11-27T17:53:24.069115+0000","last_active":"2023-11-27T17:53:25.395043+0000","last_peered":"2023-11-27T17:53:25.395043+0000","last_clean":"2023-11-27T17:53:25.395043+0000","last_became_active":"2023-11-27T17:53:24.068805+0000","last_became_peered":"2023-11-27T17:53:24.068805+0000","last_unstale":"2023-11-27T17:53:25.395043+0000","last_undegraded":"2023-11-27T17:53:25.395043+0000","last_fullsized":"2023-11-27T17:53:25.395043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:18.581213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.019567+0000","last_change":"2023-11-27T17:53:23.038303+0000","last_active":"2023-11-27T17:53:25.019567+0000","last_peered":"2023-11-27T17:53:25.019567+0000","last_clean":"2023-11-27T17:53:25.019567+0000","last_became_active":"2023-11-27T17:53:23.037075+0000","last_became_peered":"2023-11-27T17:53:23.037075+0000","last_unstale":"2023-11-27T17:53:25.019567+0000","last_undegraded":"2023-11-27T17:53:25.019567+0000","last_fullsized":"2023-11-27T17:53:25.019567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:50.048292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395581+0000","last_change":"2023-11-27T17:53:24.069732+0000","last_active":"2023-11-27T17:53:25.395581+0000","last_peered":"2023-11-27T17:53:25.395581+0000","last_clean":"2023-11-27T17:53:25.395581+0000","last_became_active":"2023-11-27T17:53:24.069433+0000","last_became_peered":"2023-11-27T17:53:24.069433+0000","last_unstale":"2023-11-27T17:53:25.395581+0000","last_undegraded":"2023-11-27T17:53:25.395581+0000","last_fullsized":"2023-11-27T17:53:25.395581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:23.694932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508637+0000","last_change":"2023-11-27T17:53:23.046224+0000","last_active":"2023-11-27T17:53:25.508637+0000","last_peered":"2023-11-27T17:53:25.508637+0000","last_clean":"2023-11-27T17:53:25.508637+0000","last_became_active":"2023-11-27T17:53:23.045684+0000","last_became_peered":"2023-11-27T17:53:23.045684+0000","last_unstale":"2023-11-27T17:53:25.508637+0000","last_undegraded":"2023-11-27T17:53:25.508637+0000","last_fullsized":"2023-11-27T17:53:25.508637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.633096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.396046+0000","last_change":"2023-11-27T17:53:24.069521+0000","last_active":"2023-11-27T17:53:25.396046+0000","last_peered":"2023-11-27T17:53:25.396046+0000","last_clean":"2023-11-27T17:53:25.396046+0000","last_became_active":"2023-11-27T17:53:24.069223+0000","last_became_peered":"2023-11-27T17:53:24.069223+0000","last_unstale":"2023-11-27T17:53:25.396046+0000","last_undegraded":"2023-11-27T17:53:25.396046+0000","last_fullsized":"2023-11-27T17:53:25.396046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:52:03.352536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.012199+0000","last_change":"2023-11-27T17:53:23.032781+0000","last_active":"2023-11-27T17:53:25.012199+0000","last_peered":"2023-11-27T17:53:25.012199+0000","last_clean":"2023-11-27T17:53:25.012199+0000","last_became_active":"2023-11-27T17:53:23.032049+0000","last_became_peered":"2023-11-27T17:53:23.032049+0000","last_unstale":"2023-11-27T17:53:25.012199+0000","last_undegraded":"2023-11-27T17:53:25.012199+0000","last_fullsized":"2023-11-27T17:53:25.012199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:00:57.689429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016753+0000","last_change":"2023-11-27T17:53:24.050873+0000","last_active":"2023-11-27T17:53:25.016753+0000","last_peered":"2023-11-27T17:53:25.016753+0000","last_clean":"2023-11-27T17:53:25.016753+0000","last_became_active":"2023-11-27T17:53:24.050472+0000","last_became_peered":"2023-11-27T17:53:24.050472+0000","last_unstale":"2023-11-27T17:53:25.016753+0000","last_undegraded":"2023-11-27T17:53:25.016753+0000","last_fullsized":"2023-11-27T17:53:25.016753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:00.496330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508440+0000","last_change":"2023-11-27T17:53:23.052857+0000","last_active":"2023-11-27T17:53:25.508440+0000","last_peered":"2023-11-27T17:53:25.508440+0000","last_clean":"2023-11-27T17:53:25.508440+0000","last_became_active":"2023-11-27T17:53:23.052447+0000","last_became_peered":"2023-11-27T17:53:23.052447+0000","last_unstale":"2023-11-27T17:53:25.508440+0000","last_undegraded":"2023-11-27T17:53:25.508440+0000","last_fullsized":"2023-11-27T17:53:25.508440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:47.750203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395283+0000","last_change":"2023-11-27T17:53:24.073138+0000","last_active":"2023-11-27T17:53:25.395283+0000","last_peered":"2023-11-27T17:53:25.395283+0000","last_clean":"2023-11-27T17:53:25.395283+0000","last_became_active":"2023-11-27T17:53:24.072819+0000","last_became_peered":"2023-11-27T17:53:24.072819+0000","last_unstale":"2023-11-27T17:53:25.395283+0000","last_undegraded":"2023-11-27T17:53:25.395283+0000","last_fullsized":"2023-11-27T17:53:25.395283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:45.619458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T17:53:24.032108+0000","last_change":"2023-11-27T17:53:12.619175+0000","last_active":"2023-11-27T17:53:24.032108+0000","last_peered":"2023-11-27T17:53:24.032108+0000","last_clean":"2023-11-27T17:53:24.032108+0000","last_became_active":"2023-11-27T17:53:12.617047+0000","last_became_peered":"2023-11-27T17:53:12.617047+0000","last_unstale":"2023-11-27T17:53:24.032108+0000","last_undegraded":"2023-11-27T17:53:24.032108+0000","last_fullsized":"2023-11-27T17:53:24.032108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_clean_scrub_stamp":"2023-11-27T17:53:11.496632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:23:56.619761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016035+0000","last_change":"2023-11-27T17:53:23.049153+0000","last_active":"2023-11-27T17:53:25.016035+0000","last_peered":"2023-11-27T17:53:25.016035+0000","last_clean":"2023-11-27T17:53:25.016035+0000","last_became_active":"2023-11-27T17:53:23.044808+0000","last_became_peered":"2023-11-27T17:53:23.044808+0000","last_unstale":"2023-11-27T17:53:25.016035+0000","last_undegraded":"2023-11-27T17:53:25.016035+0000","last_fullsized":"2023-11-27T17:53:25.016035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:08.571619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478682+0000","last_change":"2023-11-27T17:53:24.071981+0000","last_active":"2023-11-27T17:53:25.478682+0000","last_peered":"2023-11-27T17:53:25.478682+0000","last_clean":"2023-11-27T17:53:25.478682+0000","last_became_active":"2023-11-27T17:53:24.071602+0000","last_became_peered":"2023-11-27T17:53:24.071602+0000","last_unstale":"2023-11-27T17:53:25.478682+0000","last_undegraded":"2023-11-27T17:53:25.478682+0000","last_fullsized":"2023-11-27T17:53:25.478682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:05.212482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.394663+0000","last_change":"2023-11-27T17:53:23.056689+0000","last_active":"2023-11-27T17:53:25.394663+0000","last_peered":"2023-11-27T17:53:25.394663+0000","last_clean":"2023-11-27T17:53:25.394663+0000","last_became_active":"2023-11-27T17:53:23.053330+0000","last_became_peered":"2023-11-27T17:53:23.053330+0000","last_unstale":"2023-11-27T17:53:25.394663+0000","last_undegraded":"2023-11-27T17:53:25.394663+0000","last_fullsized":"2023-11-27T17:53:25.394663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.633096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.002921+0000","last_change":"2023-11-27T17:53:24.055376+0000","last_active":"2023-11-27T17:53:26.002921+0000","last_peered":"2023-11-27T17:53:26.002921+0000","last_clean":"2023-11-27T17:53:26.002921+0000","last_became_active":"2023-11-27T17:53:24.054564+0000","last_became_peered":"2023-11-27T17:53:24.054564+0000","last_unstale":"2023-11-27T17:53:26.002921+0000","last_undegraded":"2023-11-27T17:53:26.002921+0000","last_fullsized":"2023-11-27T17:53:26.002921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:00:58.700909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508559+0000","last_change":"2023-11-27T17:53:23.039358+0000","last_active":"2023-11-27T17:53:25.508559+0000","last_peered":"2023-11-27T17:53:25.508559+0000","last_clean":"2023-11-27T17:53:25.508559+0000","last_became_active":"2023-11-27T17:53:23.038886+0000","last_became_peered":"2023-11-27T17:53:23.038886+0000","last_unstale":"2023-11-27T17:53:25.508559+0000","last_undegraded":"2023-11-27T17:53:25.508559+0000","last_fullsized":"2023-11-27T17:53:25.508559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:41.221801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011710+0000","last_change":"2023-11-27T17:53:24.040703+0000","last_active":"2023-11-27T17:53:25.011710+0000","last_peered":"2023-11-27T17:53:25.011710+0000","last_clean":"2023-11-27T17:53:25.011710+0000","last_became_active":"2023-11-27T17:53:24.039927+0000","last_became_peered":"2023-11-27T17:53:24.039927+0000","last_unstale":"2023-11-27T17:53:25.011710+0000","last_undegraded":"2023-11-27T17:53:25.011710+0000","last_fullsized":"2023-11-27T17:53:25.011710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:12.057622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017442+0000","last_change":"2023-11-27T17:53:23.053942+0000","last_active":"2023-11-27T17:53:25.017442+0000","last_peered":"2023-11-27T17:53:25.017442+0000","last_clean":"2023-11-27T17:53:25.017442+0000","last_became_active":"2023-11-27T17:53:23.053210+0000","last_became_peered":"2023-11-27T17:53:23.053210+0000","last_unstale":"2023-11-27T17:53:25.017442+0000","last_undegraded":"2023-11-27T17:53:25.017442+0000","last_fullsized":"2023-11-27T17:53:25.017442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:16.679486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018127+0000","last_change":"2023-11-27T17:53:24.037341+0000","last_active":"2023-11-27T17:53:25.018127+0000","last_peered":"2023-11-27T17:53:25.018127+0000","last_clean":"2023-11-27T17:53:25.018127+0000","last_became_active":"2023-11-27T17:53:24.036405+0000","last_became_peered":"2023-11-27T17:53:24.036405+0000","last_unstale":"2023-11-27T17:53:25.018127+0000","last_undegraded":"2023-11-27T17:53:25.018127+0000","last_fullsized":"2023-11-27T17:53:25.018127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:02:36.909088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.012159+0000","last_change":"2023-11-27T17:53:23.026507+0000","last_active":"2023-11-27T17:53:25.012159+0000","last_peered":"2023-11-27T17:53:25.012159+0000","last_clean":"2023-11-27T17:53:25.012159+0000","last_became_active":"2023-11-27T17:53:23.025698+0000","last_became_peered":"2023-11-27T17:53:23.025698+0000","last_unstale":"2023-11-27T17:53:25.012159+0000","last_undegraded":"2023-11-27T17:53:25.012159+0000","last_fullsized":"2023-11-27T17:53:25.012159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:54.355928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018672+0000","last_change":"2023-11-27T17:53:24.051723+0000","last_active":"2023-11-27T17:53:25.018672+0000","last_peered":"2023-11-27T17:53:25.018672+0000","last_clean":"2023-11-27T17:53:25.018672+0000","last_became_active":"2023-11-27T17:53:24.050835+0000","last_became_peered":"2023-11-27T17:53:24.050835+0000","last_unstale":"2023-11-27T17:53:25.018672+0000","last_undegraded":"2023-11-27T17:53:25.018672+0000","last_fullsized":"2023-11-27T17:53:25.018672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:35:18.811780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395790+0000","last_change":"2023-11-27T17:53:23.058458+0000","last_active":"2023-11-27T17:53:25.395790+0000","last_peered":"2023-11-27T17:53:25.395790+0000","last_clean":"2023-11-27T17:53:25.395790+0000","last_became_active":"2023-11-27T17:53:23.057577+0000","last_became_peered":"2023-11-27T17:53:23.057577+0000","last_unstale":"2023-11-27T17:53:25.395790+0000","last_undegraded":"2023-11-27T17:53:25.395790+0000","last_fullsized":"2023-11-27T17:53:25.395790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:07.100110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011937+0000","last_change":"2023-11-27T17:53:24.040681+0000","last_active":"2023-11-27T17:53:25.011937+0000","last_peered":"2023-11-27T17:53:25.011937+0000","last_clean":"2023-11-27T17:53:25.011937+0000","last_became_active":"2023-11-27T17:53:24.039794+0000","last_became_peered":"2023-11-27T17:53:24.039794+0000","last_unstale":"2023-11-27T17:53:25.011937+0000","last_undegraded":"2023-11-27T17:53:25.011937+0000","last_fullsized":"2023-11-27T17:53:25.011937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011935+0000","last_change":"2023-11-27T17:53:23.033025+0000","last_active":"2023-11-27T17:53:25.011935+0000","last_peered":"2023-11-27T17:53:25.011935+0000","last_clean":"2023-11-27T17:53:25.011935+0000","last_became_active":"2023-11-27T17:53:23.031928+0000","last_became_peered":"2023-11-27T17:53:23.031928+0000","last_unstale":"2023-11-27T17:53:25.011935+0000","last_undegraded":"2023-11-27T17:53:25.011935+0000","last_fullsized":"2023-11-27T17:53:25.011935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:41.221801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479483+0000","last_change":"2023-11-27T17:53:24.045894+0000","last_active":"2023-11-27T17:53:25.479483+0000","last_peered":"2023-11-27T17:53:25.479483+0000","last_clean":"2023-11-27T17:53:25.479483+0000","last_became_active":"2023-11-27T17:53:24.045667+0000","last_became_peered":"2023-11-27T17:53:24.045667+0000","last_unstale":"2023-11-27T17:53:25.479483+0000","last_undegraded":"2023-11-27T17:53:25.479483+0000","last_fullsized":"2023-11-27T17:53:25.479483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:18.581213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004831+0000","last_change":"2023-11-27T17:53:23.058762+0000","last_active":"2023-11-27T17:53:26.004831+0000","last_peered":"2023-11-27T17:53:26.004831+0000","last_clean":"2023-11-27T17:53:26.004831+0000","last_became_active":"2023-11-27T17:53:23.058049+0000","last_became_peered":"2023-11-27T17:53:23.058049+0000","last_unstale":"2023-11-27T17:53:26.004831+0000","last_undegraded":"2023-11-27T17:53:26.004831+0000","last_fullsized":"2023-11-27T17:53:26.004831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:54.355928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003837+0000","last_change":"2023-11-27T17:53:24.036018+0000","last_active":"2023-11-27T17:53:26.003837+0000","last_peered":"2023-11-27T17:53:26.003837+0000","last_clean":"2023-11-27T17:53:26.003837+0000","last_became_active":"2023-11-27T17:53:24.035256+0000","last_became_peered":"2023-11-27T17:53:24.035256+0000","last_unstale":"2023-11-27T17:53:26.003837+0000","last_undegraded":"2023-11-27T17:53:26.003837+0000","last_fullsized":"2023-11-27T17:53:26.003837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.394659+0000","last_change":"2023-11-27T17:53:23.052731+0000","last_active":"2023-11-27T17:53:25.394659+0000","last_peered":"2023-11-27T17:53:25.394659+0000","last_clean":"2023-11-27T17:53:25.394659+0000","last_became_active":"2023-11-27T17:53:23.051967+0000","last_became_peered":"2023-11-27T17:53:23.051967+0000","last_unstale":"2023-11-27T17:53:25.394659+0000","last_undegraded":"2023-11-27T17:53:25.394659+0000","last_fullsized":"2023-11-27T17:53:25.394659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:41.221801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017633+0000","last_change":"2023-11-27T17:53:24.052937+0000","last_active":"2023-11-27T17:53:25.017633+0000","last_peered":"2023-11-27T17:53:25.017633+0000","last_clean":"2023-11-27T17:53:25.017633+0000","last_became_active":"2023-11-27T17:53:24.038020+0000","last_became_peered":"2023-11-27T17:53:24.038020+0000","last_unstale":"2023-11-27T17:53:25.017633+0000","last_undegraded":"2023-11-27T17:53:25.017633+0000","last_fullsized":"2023-11-27T17:53:25.017633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:41.644575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011631+0000","last_change":"2023-11-27T17:53:23.057464+0000","last_active":"2023-11-27T17:53:25.011631+0000","last_peered":"2023-11-27T17:53:25.011631+0000","last_clean":"2023-11-27T17:53:25.011631+0000","last_became_active":"2023-11-27T17:53:23.057190+0000","last_became_peered":"2023-11-27T17:53:23.057190+0000","last_unstale":"2023-11-27T17:53:25.011631+0000","last_undegraded":"2023-11-27T17:53:25.011631+0000","last_fullsized":"2023-11-27T17:53:25.011631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:54.418108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478786+0000","last_change":"2023-11-27T17:53:24.037009+0000","last_active":"2023-11-27T17:53:25.478786+0000","last_peered":"2023-11-27T17:53:25.478786+0000","last_clean":"2023-11-27T17:53:25.478786+0000","last_became_active":"2023-11-27T17:53:24.036291+0000","last_became_peered":"2023-11-27T17:53:24.036291+0000","last_unstale":"2023-11-27T17:53:25.478786+0000","last_undegraded":"2023-11-27T17:53:25.478786+0000","last_fullsized":"2023-11-27T17:53:25.478786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011932+0000","last_change":"2023-11-27T17:53:23.041287+0000","last_active":"2023-11-27T17:53:25.011932+0000","last_peered":"2023-11-27T17:53:25.011932+0000","last_clean":"2023-11-27T17:53:25.011932+0000","last_became_active":"2023-11-27T17:53:23.040654+0000","last_became_peered":"2023-11-27T17:53:23.040654+0000","last_unstale":"2023-11-27T17:53:25.011932+0000","last_undegraded":"2023-11-27T17:53:25.011932+0000","last_fullsized":"2023-11-27T17:53:25.011932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:02:44.445465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479554+0000","last_change":"2023-11-27T17:53:24.049816+0000","last_active":"2023-11-27T17:53:25.479554+0000","last_peered":"2023-11-27T17:53:25.479554+0000","last_clean":"2023-11-27T17:53:25.479554+0000","last_became_active":"2023-11-27T17:53:24.049411+0000","last_became_peered":"2023-11-27T17:53:24.049411+0000","last_unstale":"2023-11-27T17:53:25.479554+0000","last_undegraded":"2023-11-27T17:53:25.479554+0000","last_fullsized":"2023-11-27T17:53:25.479554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:25:13.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395686+0000","last_change":"2023-11-27T17:53:23.052664+0000","last_active":"2023-11-27T17:53:25.395686+0000","last_peered":"2023-11-27T17:53:25.395686+0000","last_clean":"2023-11-27T17:53:25.395686+0000","last_became_active":"2023-11-27T17:53:23.052116+0000","last_became_peered":"2023-11-27T17:53:23.052116+0000","last_unstale":"2023-11-27T17:53:25.395686+0000","last_undegraded":"2023-11-27T17:53:25.395686+0000","last_fullsized":"2023-11-27T17:53:25.395686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:11.046142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004154+0000","last_change":"2023-11-27T17:53:24.065880+0000","last_active":"2023-11-27T17:53:26.004154+0000","last_peered":"2023-11-27T17:53:26.004154+0000","last_clean":"2023-11-27T17:53:26.004154+0000","last_became_active":"2023-11-27T17:53:24.065598+0000","last_became_peered":"2023-11-27T17:53:24.065598+0000","last_unstale":"2023-11-27T17:53:26.004154+0000","last_undegraded":"2023-11-27T17:53:26.004154+0000","last_fullsized":"2023-11-27T17:53:26.004154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:08.111590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018350+0000","last_change":"2023-11-27T17:53:24.058438+0000","last_active":"2023-11-27T17:53:25.018350+0000","last_peered":"2023-11-27T17:53:25.018350+0000","last_clean":"2023-11-27T17:53:25.018350+0000","last_became_active":"2023-11-27T17:53:24.058100+0000","last_became_peered":"2023-11-27T17:53:24.058100+0000","last_unstale":"2023-11-27T17:53:25.018350+0000","last_undegraded":"2023-11-27T17:53:25.018350+0000","last_fullsized":"2023-11-27T17:53:25.018350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:23.694932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395155+0000","last_change":"2023-11-27T17:53:23.057372+0000","last_active":"2023-11-27T17:53:25.395155+0000","last_peered":"2023-11-27T17:53:25.395155+0000","last_clean":"2023-11-27T17:53:25.395155+0000","last_became_active":"2023-11-27T17:53:23.056729+0000","last_became_peered":"2023-11-27T17:53:23.056729+0000","last_unstale":"2023-11-27T17:53:25.395155+0000","last_undegraded":"2023-11-27T17:53:25.395155+0000","last_fullsized":"2023-11-27T17:53:25.395155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:54.355928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018999+0000","last_change":"2023-11-27T17:53:24.042985+0000","last_active":"2023-11-27T17:53:25.018999+0000","last_peered":"2023-11-27T17:53:25.018999+0000","last_clean":"2023-11-27T17:53:25.018999+0000","last_became_active":"2023-11-27T17:53:24.042169+0000","last_became_peered":"2023-11-27T17:53:24.042169+0000","last_unstale":"2023-11-27T17:53:25.018999+0000","last_undegraded":"2023-11-27T17:53:25.018999+0000","last_fullsized":"2023-11-27T17:53:25.018999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:29:14.184726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395483+0000","last_change":"2023-11-27T17:53:23.060149+0000","last_active":"2023-11-27T17:53:25.395483+0000","last_peered":"2023-11-27T17:53:25.395483+0000","last_clean":"2023-11-27T17:53:25.395483+0000","last_became_active":"2023-11-27T17:53:23.059061+0000","last_became_peered":"2023-11-27T17:53:23.059061+0000","last_unstale":"2023-11-27T17:53:25.395483+0000","last_undegraded":"2023-11-27T17:53:25.395483+0000","last_fullsized":"2023-11-27T17:53:25.395483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:02:44.445465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003787+0000","last_change":"2023-11-27T17:53:24.072023+0000","last_active":"2023-11-27T17:53:26.003787+0000","last_peered":"2023-11-27T17:53:26.003787+0000","last_clean":"2023-11-27T17:53:26.003787+0000","last_became_active":"2023-11-27T17:53:24.071654+0000","last_became_peered":"2023-11-27T17:53:24.071654+0000","last_unstale":"2023-11-27T17:53:26.003787+0000","last_undegraded":"2023-11-27T17:53:26.003787+0000","last_fullsized":"2023-11-27T17:53:26.003787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:12.057622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479498+0000","last_change":"2023-11-27T17:53:23.041663+0000","last_active":"2023-11-27T17:53:25.479498+0000","last_peered":"2023-11-27T17:53:25.479498+0000","last_clean":"2023-11-27T17:53:25.479498+0000","last_became_active":"2023-11-27T17:53:23.039923+0000","last_became_peered":"2023-11-27T17:53:23.039923+0000","last_unstale":"2023-11-27T17:53:25.479498+0000","last_undegraded":"2023-11-27T17:53:25.479498+0000","last_fullsized":"2023-11-27T17:53:25.479498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:58:39.365122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479266+0000","last_change":"2023-11-27T17:53:24.051978+0000","last_active":"2023-11-27T17:53:25.479266+0000","last_peered":"2023-11-27T17:53:25.479266+0000","last_clean":"2023-11-27T17:53:25.479266+0000","last_became_active":"2023-11-27T17:53:24.051656+0000","last_became_peered":"2023-11-27T17:53:24.051656+0000","last_unstale":"2023-11-27T17:53:25.479266+0000","last_undegraded":"2023-11-27T17:53:25.479266+0000","last_fullsized":"2023-11-27T17:53:25.479266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:43:50.934311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004097+0000","last_change":"2023-11-27T17:53:23.057889+0000","last_active":"2023-11-27T17:53:26.004097+0000","last_peered":"2023-11-27T17:53:26.004097+0000","last_clean":"2023-11-27T17:53:26.004097+0000","last_became_active":"2023-11-27T17:53:23.057602+0000","last_became_peered":"2023-11-27T17:53:23.057602+0000","last_unstale":"2023-11-27T17:53:26.004097+0000","last_undegraded":"2023-11-27T17:53:26.004097+0000","last_fullsized":"2023-11-27T17:53:26.004097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:05:18.882272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":200704,"data_stored":65203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.331}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4370000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":794624,"data_stored":654597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:53:27.417 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T17:53:27.418 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-27T17:53:27.418 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-27T17:53:27.418 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-27T17:53:27.418 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-27T17:53:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f105c4640 1 Processor -- start 2023-11-27T17:53:27.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f105c4640 1 -- start start 2023-11-27T17:53:27.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f105c4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6f081418e0 0x7f6f080b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f105c4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6f08141cc0 0x7f6f080b6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f105c4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f080b5880 con 0x7f6f08072510 2023-11-27T17:53:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f105c4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f080b6100 con 0x7f6f08141cc0 2023-11-27T17:53:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f105c4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080b6d80 con 0x7f6f081418e0 2023-11-27T17:53:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f0db5f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6f08141cc0 0x7f6f080b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f0db5f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6f08141cc0 0x7f6f080b6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50904/0 (socket says 172.21.15.31:50904) 2023-11-27T17:53:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f0db5f640 1 -- 172.21.15.31:0/2443898315 learned_addr learned my addr 172.21.15.31:0/2443898315 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f0e360640 1 --2- 172.21.15.31:0/2443898315 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6f081418e0 0x7f6f080b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f0db5f640 1 -- 172.21.15.31:0/2443898315 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6f081418e0 msgr2=0x7f6f080b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f0db5f640 1 --2- 172.21.15.31:0/2443898315 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6f081418e0 0x7f6f080b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f0db5f640 1 -- 172.21.15.31:0/2443898315 >> v1:172.21.15.81:6789/0 conn(0x7f6f08072510 legacy=0x7f6f0814ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:27.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f0db5f640 1 -- 172.21.15.31:0/2443898315 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f080b6ff0 con 0x7f6f08141cc0 2023-11-27T17:53:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f0db5f640 1 --2- 172.21.15.31:0/2443898315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f08141cc0 0x7f6f080b6840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009e50 tx=0x7f6ef801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5faef1062de96820 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.577+0000 7f6f0d35e640 1 -- 172.21.15.31:0/2443898315 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80af400 con 0x7f6f08141cc0 2023-11-27T17:53:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0d35e640 1 -- 172.21.15.31:0/2443898315 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef80ab050 con 0x7f6f08141cc0 2023-11-27T17:53:27.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0d35e640 1 -- 172.21.15.31:0/2443898315 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80af780 con 0x7f6f08141cc0 2023-11-27T17:53:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 -- 172.21.15.31:0/2443898315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f08141cc0 msgr2=0x7f6f080b6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 --2- 172.21.15.31:0/2443898315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f08141cc0 0x7f6f080b6840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8009e50 tx=0x7f6ef801f1c0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 -- 172.21.15.31:0/2443898315 shutdown_connections 2023-11-27T17:53:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 --2- 172.21.15.31:0/2443898315 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f08141cc0 0x7f6f080b6840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 --2- 172.21.15.31:0/2443898315 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6f081418e0 0x7f6f080b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 -- 172.21.15.31:0/2443898315 >> 172.21.15.31:0/2443898315 conn(0x7f6f0806ab60 msgr2=0x7f6f080bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 -- 172.21.15.31:0/2443898315 shutdown_connections 2023-11-27T17:53:27.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 -- 172.21.15.31:0/2443898315 wait complete. 2023-11-27T17:53:27.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 Processor -- start 2023-11-27T17:53:27.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 -- start start 2023-11-27T17:53:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6f08072510 0x7f6f08140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f081418e0 0x7f6f08148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f08141cc0 0x7f6f08071920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08147e00 con 0x7f6f081418e0 2023-11-27T17:53:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08140a60 con 0x7f6f08141cc0 2023-11-27T17:53:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f105c4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08149270 con 0x7f6f08072510 2023-11-27T17:53:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0db5f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f081418e0 0x7f6f08148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0db5f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f081418e0 0x7f6f08148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50908/0 (socket says 172.21.15.31:50908) 2023-11-27T17:53:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0db5f640 1 -- 172.21.15.31:0/3115263994 learned_addr learned my addr 172.21.15.31:0/3115263994 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0e360640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6f08072510 0x7f6f08140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0eb61640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f08141cc0 0x7f6f08071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0db5f640 1 -- 172.21.15.31:0/3115263994 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6f08072510 msgr2=0x7f6f08140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0db5f640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6f08072510 0x7f6f08140520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0db5f640 1 -- 172.21.15.31:0/3115263994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f08141cc0 msgr2=0x7f6f08071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0db5f640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f08141cc0 0x7f6f08071920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0db5f640 1 -- 172.21.15.31:0/3115263994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef8009b30 con 0x7f6f081418e0 2023-11-27T17:53:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0eb61640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f08141cc0 0x7f6f08071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f0db5f640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f081418e0 0x7f6f08148d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80b2040 tx=0x7f6ef801bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.581+0000 7f6f06ffd640 1 -- 172.21.15.31:0/3115263994 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80c0070 con 0x7f6f081418e0 2023-11-27T17:53:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.585+0000 7f6f06ffd640 1 -- 172.21.15.31:0/3115263994 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8009510 con 0x7f6f081418e0 2023-11-27T17:53:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.585+0000 7f6f105c4640 1 -- 172.21.15.31:0/3115263994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0813c4b0 con 0x7f6f081418e0 2023-11-27T17:53:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.585+0000 7f6f06ffd640 1 -- 172.21.15.31:0/3115263994 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80ba420 con 0x7f6f081418e0 2023-11-27T17:53:27.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.585+0000 7f6f105c4640 1 -- 172.21.15.31:0/3115263994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f08149510 con 0x7f6f081418e0 2023-11-27T17:53:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.585+0000 7f6f105c4640 1 -- 172.21.15.31:0/3115263994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0804e850 con 0x7f6f081418e0 2023-11-27T17:53:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.585+0000 7f6f06ffd640 1 -- 172.21.15.31:0/3115263994 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f6ef80b6040 con 0x7f6f081418e0 2023-11-27T17:53:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.585+0000 7f6f06ffd640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6ee80667f0 0x7f6ee8068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.585+0000 7f6f06ffd640 1 -- 172.21.15.31:0/3115263994 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ef8121be0 con 0x7f6f081418e0 2023-11-27T17:53:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.585+0000 7f6f0e360640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6ee80667f0 0x7f6ee8068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.585+0000 7f6f0e360640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6ee80667f0 0x7f6ee8068cb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000b9d0 tx=0x7f6f00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:27.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.589+0000 7f6f06ffd640 1 -- 172.21.15.31:0/3115263994 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f6ef80eee30 con 0x7f6f081418e0 2023-11-27T17:53:27.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.777+0000 7f6f105c4640 1 -- 172.21.15.31:0/3115263994 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6f080a2d90 con 0x7f6f081418e0 2023-11-27T17:53:27.783 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.777+0000 7f6f06ffd640 1 -- 172.21.15.31:0/3115263994 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164563 (secure 0 0 0) 0x7f6ef80f2450 con 0x7f6f081418e0 2023-11-27T17:53:27.785 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:27.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.781+0000 7f6f105c4640 1 -- 172.21.15.31:0/3115263994 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6ee80667f0 msgr2=0x7f6ee8068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.781+0000 7f6f105c4640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6ee80667f0 0x7f6ee8068cb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000b9d0 tx=0x7f6f00008040 comp rx=0 tx=0).stop 2023-11-27T17:53:27.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.781+0000 7f6f105c4640 1 -- 172.21.15.31:0/3115263994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f081418e0 msgr2=0x7f6f08148d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.781+0000 7f6f105c4640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f081418e0 0x7f6f08148d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80b2040 tx=0x7f6ef801bf60 comp rx=0 tx=0).stop 2023-11-27T17:53:27.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.781+0000 7f6f105c4640 1 -- 172.21.15.31:0/3115263994 shutdown_connections 2023-11-27T17:53:27.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.781+0000 7f6f105c4640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6ee80667f0 0x7f6ee8068cb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.781+0000 7f6f105c4640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f08141cc0 0x7f6f08071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.781+0000 7f6f105c4640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f081418e0 0x7f6f08148d30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.781+0000 7f6f105c4640 1 --2- 172.21.15.31:0/3115263994 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6f08072510 0x7f6f08140520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.781+0000 7f6f105c4640 1 -- 172.21.15.31:0/3115263994 >> 172.21.15.31:0/3115263994 conn(0x7f6f0806ab60 msgr2=0x7f6f080bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:27.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.781+0000 7f6f105c4640 1 -- 172.21.15.31:0/3115263994 shutdown_connections 2023-11-27T17:53:27.787 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.781+0000 7f6f105c4640 1 -- 172.21.15.31:0/3115263994 wait complete. 2023-11-27T17:53:27.801 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1886714170},{"type":"v1","addr":"172.21.15.31:6833","nonce":1886714170}]},"active_addr":"172.21.15.31:6833/1886714170","active_change":"2023-11-27T17:53:03.084499+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":1552586651}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":3848078622}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":3683474245}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.31:0","nonce":1974748398}]}]} 2023-11-27T17:53:27.804 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-27T17:53:27.805 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-27T17:53:27.805 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.909+0000 7fa96f1b6640 1 Processor -- start 2023-11-27T17:53:27.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.909+0000 7fa96f1b6640 1 -- start start 2023-11-27T17:53:27.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa96f1b6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa96806cd00 0x7fa968071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa96f1b6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa96814b700 0x7fa9681420b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa96f1b6640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96806d5f0 con 0x7fa9680b9a30 2023-11-27T17:53:27.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa96f1b6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96806e760 con 0x7fa96806cd00 2023-11-27T17:53:27.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa96f1b6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa968072040 con 0x7fa96814b700 2023-11-27T17:53:27.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa96cf52640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa9680b9a30 0x7fa96806ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46052/0 (socket says 172.21.15.31:46052) 2023-11-27T17:53:27.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa96cf52640 1 -- 172.21.15.31:0/1521752358 learned_addr learned my addr 172.21.15.31:0/1521752358 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:27.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa96d753640 1 --2- 172.21.15.31:0/1521752358 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa96814b700 0x7fa9681420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa967fff640 1 --2- 172.21.15.31:0/1521752358 >> v2:172.21.15.81:3300/0 conn(0x7fa96806cd00 0x7fa968071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171626018 0 0) 0x7fa96806d5f0 con 0x7fa9680b9a30 2023-11-27T17:53:27.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa954003530 con 0x7fa9680b9a30 2023-11-27T17:53:27.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3122737491 0 0) 0x7fa954003530 con 0x7fa9680b9a30 2023-11-27T17:53:27.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa96814b700 msgr2=0x7fa9681420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:27.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 --2- 172.21.15.31:0/1521752358 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa96814b700 0x7fa9681420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 >> v2:172.21.15.81:3300/0 conn(0x7fa96806cd00 msgr2=0x7fa968071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:27.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 --2- 172.21.15.31:0/1521752358 >> v2:172.21.15.81:3300/0 conn(0x7fa96806cd00 0x7fa968071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968072320 con 0x7fa9680b9a30 2023-11-27T17:53:27.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7fa960001a00 con 0x7fa9680b9a30 2023-11-27T17:53:27.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 >> v1:172.21.15.31:6789/0 conn(0x7fa9680b9a30 legacy=0x7fa96806ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 --2- 172.21.15.31:0/1521752358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9540039f0 0x7fa954003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 --2- 172.21.15.31:0/1521752358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9540047d0 0x7fa954004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 --2- 172.21.15.31:0/1521752358 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa96814b700 0x7fa954005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96806e760 con 0x7fa9540047d0 2023-11-27T17:53:27.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968072040 con 0x7fa9540039f0 2023-11-27T17:53:27.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95400b9e0 con 0x7fa96814b700 2023-11-27T17:53:27.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa967fff640 1 --2- 172.21.15.31:0/1521752358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9540047d0 0x7fa954004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa96cf52640 1 --2- 172.21.15.31:0/1521752358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9540039f0 0x7fa954003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa96d753640 1 --2- 172.21.15.31:0/1521752358 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa96814b700 0x7fa954005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa967fff640 1 -- 172.21.15.31:0/1521752358 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa96814b700 msgr2=0x7fa954005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:27.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa967fff640 1 --2- 172.21.15.31:0/1521752358 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa96814b700 0x7fa954005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa967fff640 1 -- 172.21.15.31:0/1521752358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9540039f0 msgr2=0x7fa954003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:27.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa967fff640 1 --2- 172.21.15.31:0/1521752358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9540039f0 0x7fa954003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.913+0000 7fa967fff640 1 -- 172.21.15.31:0/1521752358 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa954003530 con 0x7fa9540047d0 2023-11-27T17:53:27.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa967fff640 1 --2- 172.21.15.31:0/1521752358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9540047d0 0x7fa954004c50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa950009ae0 tx=0x7fa95001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236bbfd2604e9055 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:27.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500a55a0 con 0x7fa9540047d0 2023-11-27T17:53:27.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9500a5700 con 0x7fa9540047d0 2023-11-27T17:53:27.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa9677fe640 1 -- 172.21.15.31:0/1521752358 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500a5ab0 con 0x7fa9540047d0 2023-11-27T17:53:27.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 -- 172.21.15.31:0/1521752358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9540047d0 msgr2=0x7fa954004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 --2- 172.21.15.31:0/1521752358 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9540047d0 0x7fa954004c50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa950009ae0 tx=0x7fa95001ca90 comp rx=0 tx=0).stop 2023-11-27T17:53:27.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96d753640 1 -- 172.21.15.31:0/1521752358 reap_dead start 2023-11-27T17:53:27.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 -- 172.21.15.31:0/1521752358 shutdown_connections 2023-11-27T17:53:27.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 -- 172.21.15.31:0/1521752358 >> 172.21.15.31:0/1521752358 conn(0x7fa9680ba8c0 msgr2=0x7fa9680bacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:27.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 -- 172.21.15.31:0/1521752358 shutdown_connections 2023-11-27T17:53:27.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 -- 172.21.15.31:0/1521752358 wait complete. 2023-11-27T17:53:27.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 Processor -- start 2023-11-27T17:53:27.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 -- start start 2023-11-27T17:53:27.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9540047d0 0x7fa9680b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa9680b7a90 0x7fa9681e10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9681e15e0 0x7fa968132630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9681e1a90 con 0x7fa9540047d0 2023-11-27T17:53:27.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9681e4880 con 0x7fa9681e15e0 2023-11-27T17:53:27.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9681e4b60 con 0x7fa9680b7a90 2023-11-27T17:53:27.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96cf52640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9540047d0 0x7fa9680b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96cf52640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9540047d0 0x7fa9680b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50926/0 (socket says 172.21.15.31:50926) 2023-11-27T17:53:27.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96cf52640 1 -- 172.21.15.31:0/2650015482 learned_addr learned my addr 172.21.15.31:0/2650015482 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:27.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa967fff640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa9680b7a90 0x7fa9681e10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96d753640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9681e15e0 0x7fa968132630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96cf52640 1 -- 172.21.15.31:0/2650015482 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa9680b7a90 msgr2=0x7fa9681e10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96cf52640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa9680b7a90 0x7fa9681e10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96cf52640 1 -- 172.21.15.31:0/2650015482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9681e15e0 msgr2=0x7fa968132630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:27.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96cf52640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9681e15e0 0x7fa968132630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:27.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96cf52640 1 -- 172.21.15.31:0/2650015482 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680a3fd0 con 0x7fa9540047d0 2023-11-27T17:53:27.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa967fff640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa9680b7a90 0x7fa9681e10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:27.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96cf52640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9540047d0 0x7fa9680b6b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa960007a60 tx=0x7fa96000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:27.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa9657fa640 1 -- 172.21.15.31:0/2650015482 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000ee50 con 0x7fa9540047d0 2023-11-27T17:53:27.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa9657fa640 1 -- 172.21.15.31:0/2650015482 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa960013420 con 0x7fa9540047d0 2023-11-27T17:53:27.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 -- 172.21.15.31:0/2650015482 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9681e4e40 con 0x7fa9540047d0 2023-11-27T17:53:27.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa9657fa640 1 -- 172.21.15.31:0/2650015482 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600137d0 con 0x7fa9540047d0 2023-11-27T17:53:27.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.917+0000 7fa96f1b6640 1 -- 172.21.15.31:0/2650015482 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9680b41d0 con 0x7fa9540047d0 2023-11-27T17:53:27.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.921+0000 7fa96f1b6640 1 -- 172.21.15.31:0/2650015482 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96804e850 con 0x7fa9540047d0 2023-11-27T17:53:27.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.921+0000 7fa9657fa640 1 -- 172.21.15.31:0/2650015482 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa960013930 con 0x7fa9540047d0 2023-11-27T17:53:27.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.921+0000 7fa9657fa640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa9480667f0 0x7fa948068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:27.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.921+0000 7fa9657fa640 1 -- 172.21.15.31:0/2650015482 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa960085470 con 0x7fa9540047d0 2023-11-27T17:53:27.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.921+0000 7fa967fff640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa9480667f0 0x7fa948068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:27.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.921+0000 7fa967fff640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa9480667f0 0x7fa948068cb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa9500af000 tx=0x7fa9500046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:27.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:27.925+0000 7fa9657fa640 1 -- 172.21.15.31:0/2650015482 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa960052660 con 0x7fa9540047d0 2023-11-27T17:53:27.977 INFO:tasks.ceph.mds.b.smithi081.stderr:2023-11-27T17:53:27.970+0000 7fe24ed9d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T17:53:28.078 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.073+0000 7fa96f1b6640 1 -- 172.21.15.31:0/2650015482 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa96814c5d0 con 0x7fa9540047d0 2023-11-27T17:53:28.081 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.077+0000 7fa9657fa640 1 -- 172.21.15.31:0/2650015482 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7fa960055c80 con 0x7fa9540047d0 2023-11-27T17:53:28.081 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:28.081 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:28.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.081+0000 7fa96f1b6640 1 -- 172.21.15.31:0/2650015482 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa9480667f0 msgr2=0x7fa948068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.083 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.081+0000 7fa96f1b6640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa9480667f0 0x7fa948068cb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa9500af000 tx=0x7fa9500046d0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.081+0000 7fa96f1b6640 1 -- 172.21.15.31:0/2650015482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9540047d0 msgr2=0x7fa9680b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.081+0000 7fa96f1b6640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9540047d0 0x7fa9680b6b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa960007a60 tx=0x7fa96000e530 comp rx=0 tx=0).stop 2023-11-27T17:53:28.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.081+0000 7fa96f1b6640 1 -- 172.21.15.31:0/2650015482 shutdown_connections 2023-11-27T17:53:28.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.081+0000 7fa96f1b6640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa9480667f0 0x7fa948068cb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.081+0000 7fa96f1b6640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9681e15e0 0x7fa968132630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.081+0000 7fa96f1b6640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa9680b7a90 0x7fa9681e10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.081+0000 7fa96f1b6640 1 --2- 172.21.15.31:0/2650015482 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa9540047d0 0x7fa9680b6b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.081+0000 7fa96f1b6640 1 -- 172.21.15.31:0/2650015482 >> 172.21.15.31:0/2650015482 conn(0x7fa9680ba8c0 msgr2=0x7fa968070c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.081+0000 7fa96f1b6640 1 -- 172.21.15.31:0/2650015482 shutdown_connections 2023-11-27T17:53:28.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.081+0000 7fa96f1b6640 1 -- 172.21.15.31:0/2650015482 wait complete. 2023-11-27T17:53:28.099 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-27T17:53:28.099 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:28.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f791d8fc640 1 Processor -- start 2023-11-27T17:53:28.211 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f791d8fc640 1 -- start start 2023-11-27T17:53:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f791d8fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79180b30b0 0x7f79180b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f791d8fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f79180b3a60 0x7f791814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f791d8fc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f79180bd240 0x7f79180b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f791d8fc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79180b52c0 con 0x7f79180b3a60 2023-11-27T17:53:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f791d8fc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7918148930 con 0x7f79180b30b0 2023-11-27T17:53:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f791d8fc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79180b3490 con 0x7f79180bd240 2023-11-27T17:53:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f79167fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f79180b3a60 0x7f791814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f79167fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f79180b3a60 0x7f791814b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50942/0 (socket says 172.21.15.31:50942) 2023-11-27T17:53:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f79167fc640 1 -- 172.21.15.31:0/2563948515 learned_addr learned my addr 172.21.15.31:0/2563948515 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.213 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f79177fe640 1 --2- 172.21.15.31:0/2563948515 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f79180bd240 0x7f79180b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f7916ffd640 1 --2- 172.21.15.31:0/2563948515 >> v2:172.21.15.81:3300/0 conn(0x7f79180b30b0 0x7f79180b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f79167fc640 1 -- 172.21.15.31:0/2563948515 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f79180bd240 msgr2=0x7f79180b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f79167fc640 1 --2- 172.21.15.31:0/2563948515 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f79180bd240 0x7f79180b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f79167fc640 1 -- 172.21.15.31:0/2563948515 >> v2:172.21.15.81:3300/0 conn(0x7f79180b30b0 msgr2=0x7f79180b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f79167fc640 1 --2- 172.21.15.31:0/2563948515 >> v2:172.21.15.81:3300/0 conn(0x7f79180b30b0 0x7f79180b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f79167fc640 1 -- 172.21.15.31:0/2563948515 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918148040 con 0x7f79180b3a60 2023-11-27T17:53:28.214 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.209+0000 7f7916ffd640 1 --2- 172.21.15.31:0/2563948515 >> v2:172.21.15.81:3300/0 conn(0x7f79180b30b0 0x7f79180b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:28.215 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f79167fc640 1 --2- 172.21.15.31:0/2563948515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79180b3a60 0x7f791814b5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f79180b89d0 tx=0x7f790c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eea0d9a349e5f86 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f7915ffb640 1 -- 172.21.15.31:0/2563948515 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c0aa5f0 con 0x7f79180b3a60 2023-11-27T17:53:28.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f7915ffb640 1 -- 172.21.15.31:0/2563948515 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790c0aa750 con 0x7f79180b3a60 2023-11-27T17:53:28.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f7915ffb640 1 -- 172.21.15.31:0/2563948515 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790c0aaae0 con 0x7f79180b3a60 2023-11-27T17:53:28.216 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 -- 172.21.15.31:0/2563948515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79180b3a60 msgr2=0x7f791814b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 --2- 172.21.15.31:0/2563948515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79180b3a60 0x7f791814b5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f79180b89d0 tx=0x7f790c01c4d0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 -- 172.21.15.31:0/2563948515 shutdown_connections 2023-11-27T17:53:28.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 --2- 172.21.15.31:0/2563948515 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f79180bd240 0x7f79180b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 --2- 172.21.15.31:0/2563948515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79180b3a60 0x7f791814b5a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 --2- 172.21.15.31:0/2563948515 >> v2:172.21.15.81:3300/0 conn(0x7f79180b30b0 0x7f79180b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 -- 172.21.15.31:0/2563948515 >> 172.21.15.31:0/2563948515 conn(0x7f791806ab60 msgr2=0x7f79180bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 -- 172.21.15.31:0/2563948515 shutdown_connections 2023-11-27T17:53:28.217 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 -- 172.21.15.31:0/2563948515 wait complete. 2023-11-27T17:53:28.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 Processor -- start 2023-11-27T17:53:28.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 -- start start 2023-11-27T17:53:28.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79180b30b0 0x7f79180bbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f79180b3a60 0x7f7918149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79180bd240 0x7f7918149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180bc200 con 0x7f79180b30b0 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79181419f0 con 0x7f79180bd240 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f791d8fc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791814a7e0 con 0x7f79180b3a60 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f7916ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79180b30b0 0x7f79180bbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f7916ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79180b30b0 0x7f79180bbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50958/0 (socket says 172.21.15.31:50958) 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f7916ffd640 1 -- 172.21.15.31:0/1018364793 learned_addr learned my addr 172.21.15.31:0/1018364793 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f79167fc640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f79180b3a60 0x7f7918149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f79177fe640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79180bd240 0x7f7918149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f7916ffd640 1 -- 172.21.15.31:0/1018364793 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f79180b3a60 msgr2=0x7f7918149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f7916ffd640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f79180b3a60 0x7f7918149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f7916ffd640 1 -- 172.21.15.31:0/1018364793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79180bd240 msgr2=0x7f7918149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f7916ffd640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79180bd240 0x7f7918149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f7916ffd640 1 -- 172.21.15.31:0/1018364793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790c0094d0 con 0x7f79180b30b0 2023-11-27T17:53:28.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f79167fc640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f79180b3a60 0x7f7918149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:28.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f7916ffd640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79180b30b0 0x7f79180bbcc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f790800c7f0 tx=0x7f790800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.213+0000 7f78fffff640 1 -- 172.21.15.31:0/1018364793 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908007820 con 0x7f79180b30b0 2023-11-27T17:53:28.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.217+0000 7f78fffff640 1 -- 172.21.15.31:0/1018364793 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908007980 con 0x7f79180b30b0 2023-11-27T17:53:28.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.217+0000 7f791d8fc640 1 -- 172.21.15.31:0/1018364793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79180b94a0 con 0x7f79180b30b0 2023-11-27T17:53:28.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.217+0000 7f78fffff640 1 -- 172.21.15.31:0/1018364793 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908007d30 con 0x7f79180b30b0 2023-11-27T17:53:28.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.217+0000 7f791d8fc640 1 -- 172.21.15.31:0/1018364793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791814aa80 con 0x7f79180b30b0 2023-11-27T17:53:28.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.217+0000 7f791d8fc640 1 -- 172.21.15.31:0/1018364793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791804e850 con 0x7f79180b30b0 2023-11-27T17:53:28.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.217+0000 7f78fffff640 1 -- 172.21.15.31:0/1018364793 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f79080113f0 con 0x7f79180b30b0 2023-11-27T17:53:28.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.217+0000 7f78fffff640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f79040667f0 0x7f7904068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.217+0000 7f79167fc640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f79040667f0 0x7f7904068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.217+0000 7f78fffff640 1 -- 172.21.15.31:0/1018364793 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7908084670 con 0x7f79180b30b0 2023-11-27T17:53:28.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.217+0000 7f79167fc640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f79040667f0 0x7f7904068cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f790c0ae000 tx=0x7f790c0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.221+0000 7f78fffff640 1 -- 172.21.15.31:0/1018364793 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f7908051640 con 0x7f79180b30b0 2023-11-27T17:53:28.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 -- 172.21.15.31:0/1018364793 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79180a2d90 con 0x7f79180b30b0 2023-11-27T17:53:28.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f78fffff640 1 -- 172.21.15.31:0/1018364793 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7f7908054c60 con 0x7f79180b30b0 2023-11-27T17:53:28.381 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:28.381 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:28.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 -- 172.21.15.31:0/1018364793 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f79040667f0 msgr2=0x7f7904068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f79040667f0 0x7f7904068cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f790c0ae000 tx=0x7f790c0a7000 comp rx=0 tx=0).stop 2023-11-27T17:53:28.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 -- 172.21.15.31:0/1018364793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79180b30b0 msgr2=0x7f79180bbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79180b30b0 0x7f79180bbcc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f790800c7f0 tx=0x7f790800ccb0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 -- 172.21.15.31:0/1018364793 shutdown_connections 2023-11-27T17:53:28.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f79040667f0 0x7f7904068cb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79180bd240 0x7f7918149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f79180b3a60 0x7f7918149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 --2- 172.21.15.31:0/1018364793 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79180b30b0 0x7f79180bbcc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 -- 172.21.15.31:0/1018364793 >> 172.21.15.31:0/1018364793 conn(0x7f791806ab60 msgr2=0x7f79180b7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 -- 172.21.15.31:0/1018364793 shutdown_connections 2023-11-27T17:53:28.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.377+0000 7f791d8fc640 1 -- 172.21.15.31:0/1018364793 wait complete. 2023-11-27T17:53:28.400 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-27T17:53:28.400 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-27T17:53:28.401 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-27T17:53:28.401 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-27T17:53:28.401 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-27T17:53:28.402 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-27T17:53:28.402 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-27T17:53:28.402 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-27T17:53:28.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.573+0000 7fb4192dc640 1 Processor -- start 2023-11-27T17:53:28.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.573+0000 7fb4192dc640 1 -- start start 2023-11-27T17:53:28.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.573+0000 7fb4192dc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb4140b7bb0 0x7fb4140b6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7fb4192dc640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4140b9060 con 0x7fb4140729c0 2023-11-27T17:53:28.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7fb4192dc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4140b9300 con 0x7fb4140b2bc0 2023-11-27T17:53:28.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7fb4192dc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4140b1e80 con 0x7fb4140b7bb0 2023-11-27T17:53:28.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7fb4127fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb4140729c0 0x7fb4140b61f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46054/0 (socket says 172.21.15.31:46054) 2023-11-27T17:53:28.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7fb4127fc640 1 -- 172.21.15.31:0/2582426864 learned_addr learned my addr 172.21.15.31:0/2582426864 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:28.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7fb4137fe640 1 --2- 172.21.15.31:0/2582426864 >> v2:172.21.15.81:3300/0 conn(0x7fb4140b7bb0 0x7fb4140b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7fb411ffb640 1 -- 172.21.15.31:0/2582426864 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271224078 0 0) 0x7fb4140b9060 con 0x7fb4140729c0 2023-11-27T17:53:28.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7fb411ffb640 1 -- 172.21.15.31:0/2582426864 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3fc003530 con 0x7fb4140729c0 2023-11-27T17:53:28.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7fb4137fe640 1 -- 172.21.15.31:0/2582426864 >> v1:172.21.15.81:6789/0 conn(0x7fb4140b2bc0 legacy=0x7fb4140b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7fb4137fe640 1 -- 172.21.15.31:0/2582426864 >> v1:172.21.15.31:6789/0 conn(0x7fb4140729c0 legacy=0x7fb4140b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7fb4137fe640 1 -- 172.21.15.31:0/2582426864 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4140b1aa0 con 0x7fb4140b7bb0 2023-11-27T17:53:28.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7f35a8f61640 1 Processor -- start 2023-11-27T17:53:28.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7f35a8f61640 1 -- start start 2023-11-27T17:53:28.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7f35a8f61640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b2bc0 0x7f35a40b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7f35a8f61640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f35a40729c0 0x7f35a40b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7f35a8f61640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a40b9060 con 0x7f35a40b61f0 2023-11-27T17:53:28.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7f35a8f61640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a40b1e80 con 0x7f35a40729c0 2023-11-27T17:53:28.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7f35a8f61640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a40b4950 con 0x7f35a40b2bc0 2023-11-27T17:53:28.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7f35a259c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b2bc0 0x7f35a40b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7f35a2d9d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f35a40b61f0 0x7f35a40b6640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46058/0 (socket says 172.21.15.31:46058) 2023-11-27T17:53:28.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7f35a259c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b2bc0 0x7f35a40b74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:38510/0 (socket says 172.21.15.31:38510) 2023-11-27T17:53:28.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7f35a259c640 1 -- 172.21.15.31:0/3123543931 learned_addr learned my addr 172.21.15.31:0/3123543931 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.577+0000 7f35a1d9b640 1 --2- 172.21.15.31:0/3123543931 >> v2:172.21.15.81:3300/0 conn(0x7f35a40729c0 0x7f35a40b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f35a259c640 1 -- 172.21.15.31:0/3123543931 >> v2:172.21.15.81:3300/0 conn(0x7f35a40729c0 msgr2=0x7f35a40b79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f35a259c640 1 --2- 172.21.15.31:0/3123543931 >> v2:172.21.15.81:3300/0 conn(0x7f35a40729c0 0x7f35a40b79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f35a259c640 1 -- 172.21.15.31:0/3123543931 >> v1:172.21.15.31:6789/0 conn(0x7f35a40b61f0 legacy=0x7f35a40b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f35a159a640 1 -- 172.21.15.31:0/3123543931 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734925744 0 0) 0x7f35a40b9060 con 0x7f35a40b61f0 2023-11-27T17:53:28.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f35a259c640 1 -- 172.21.15.31:0/3123543931 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40b9300 con 0x7f35a40b2bc0 2023-11-27T17:53:28.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf20084640 1 Processor -- start 2023-11-27T17:53:28.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf20084640 1 -- start start 2023-11-27T17:53:28.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fb4137fe640 1 --2- 172.21.15.31:0/2582426864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4140b7bb0 0x7fb4140b6900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb4040097f0 tx=0x7fb40401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=123707676cb26ed server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fb411ffb640 1 -- 172.21.15.31:0/2582426864 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4040ab600 con 0x7fb4140b7bb0 2023-11-27T17:53:28.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e42a07640 1 Processor -- start 2023-11-27T17:53:28.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fb411ffb640 1 -- 172.21.15.31:0/2582426864 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4040a7050 con 0x7fb4140b7bb0 2023-11-27T17:53:28.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fb411ffb640 1 -- 172.21.15.31:0/2582426864 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4040ab960 con 0x7fb4140b7bb0 2023-11-27T17:53:28.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e42a07640 1 -- start start 2023-11-27T17:53:28.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4f2365640 1 Processor -- start 2023-11-27T17:53:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4f2365640 1 -- start start 2023-11-27T17:53:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf20084640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf1003acd0 0x7fbf10038da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf20084640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbf1003b0b0 0x7fbf100ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf20084640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf10007440 con 0x7fbf100ce740 2023-11-27T17:53:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf20084640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf10035c90 con 0x7fbf1003b0b0 2023-11-27T17:53:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf20084640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10006b10 con 0x7fbf1003acd0 2023-11-27T17:53:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf1e621640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbf100ce740 0x7fbf100d4680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.31:48058/0 (socket says 172.21.15.31:48058) 2023-11-27T17:53:28.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf1e621640 1 -- 172.21.15.31:0/3909132910 learned_addr learned my addr 172.21.15.31:0/3909132910 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:28.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4f2365640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4ec0b2bc0 0x7fa4ec0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4f2365640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa4ec0b8260 0x7fa4ec0b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4f2365640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ec0b7dd0 con 0x7fa4ec0b2320 2023-11-27T17:53:28.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4f2365640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec0b8c30 con 0x7fa4ec0b2bc0 2023-11-27T17:53:28.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4f2365640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec0b74a0 con 0x7fa4ec0b8260 2023-11-27T17:53:28.588 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fb4192dc640 1 -- 172.21.15.31:0/2582426864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4140b7bb0 msgr2=0x7fb4140b6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fb4192dc640 1 --2- 172.21.15.31:0/2582426864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4140b7bb0 0x7fb4140b6900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb4040097f0 tx=0x7fb40401c3f0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fb4192dc640 1 -- 172.21.15.31:0/2582426864 shutdown_connections 2023-11-27T17:53:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fb4192dc640 1 --2- 172.21.15.31:0/2582426864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4140b7bb0 0x7fb4140b6900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fb4192dc640 1 -- 172.21.15.31:0/2582426864 >> 172.21.15.31:0/2582426864 conn(0x7fb4140b95a0 msgr2=0x7fb4140b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fb4192dc640 1 -- 172.21.15.31:0/2582426864 shutdown_connections 2023-11-27T17:53:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fb4192dc640 1 -- 172.21.15.31:0/2582426864 wait complete. 2023-11-27T17:53:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf1de20640 1 --2- 172.21.15.31:0/3909132910 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf1003acd0 0x7fbf10038da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf1d61f640 1 --2- 172.21.15.31:0/3909132910 >> v2:172.21.15.81:3300/0 conn(0x7fbf1003b0b0 0x7fbf100ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e42a07640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e3c0b28b0 0x7f9e3c0b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e42a07640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c0b1dd0 con 0x7f9e3c14ede0 2023-11-27T17:53:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e42a07640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c0b1b30 con 0x7f9e3c0b9710 2023-11-27T17:53:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e42a07640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0b33a0 con 0x7f9e3c0b28b0 2023-11-27T17:53:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0fec5c640 1 Processor -- start 2023-11-27T17:53:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0fec5c640 1 -- start start 2023-11-27T17:53:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9e3c0b9710 0x7f9e3c0b2c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.31:48060/0 (socket says 172.21.15.31:48060) 2023-11-27T17:53:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3b7fe640 1 -- 172.21.15.31:0/2652366104 learned_addr learned my addr 172.21.15.31:0/2652366104 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0fec5c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc0f80a1ec0 0x7fc0f80a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0fec5c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0f80b8790 0x7fc0f80b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.591 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4eb7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa4ec0b2320 0x7fa4ec14e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46064/0 (socket says 172.21.15.31:46064) 2023-11-27T17:53:28.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4eb7fe640 1 -- 172.21.15.31:0/4166526194 learned_addr learned my addr 172.21.15.31:0/4166526194 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:28.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf1d61f640 1 -- 172.21.15.31:0/3909132910 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf1003acd0 msgr2=0x7fbf10038da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf1d61f640 1 --2- 172.21.15.31:0/3909132910 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf1003acd0 0x7fbf10038da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf1d61f640 1 -- 172.21.15.31:0/3909132910 >> v1:172.21.15.81:6789/0 conn(0x7fbf100ce740 legacy=0x7fbf100d4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fbf1d61f640 1 -- 172.21.15.31:0/3909132910 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf10006df0 con 0x7fbf1003b0b0 2023-11-27T17:53:28.592 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4ebfff640 1 --2- 172.21.15.31:0/4166526194 >> v2:172.21.15.31:3300/0 conn(0x7fa4ec0b2bc0 0x7fa4ec0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0fec5c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f80b32c0 con 0x7fc0f80b8be0 2023-11-27T17:53:28.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4f0902640 1 --2- 172.21.15.31:0/4166526194 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa4ec0b8260 0x7fa4ec0b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f1b8b160640 1 Processor -- start 2023-11-27T17:53:28.593 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0f7fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0f80b8790 0x7fc0f80b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0f7fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc0f80b8790 0x7fc0f80b74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50968/0 (socket says 172.21.15.31:50968) 2023-11-27T17:53:28.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0f7fff640 1 -- 172.21.15.31:0/2177358294 learned_addr learned my addr 172.21.15.31:0/2177358294 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4eaffd640 1 -- 172.21.15.31:0/4166526194 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702686395 0 0) 0x7fa4ec0b7dd0 con 0x7fa4ec0b2320 2023-11-27T17:53:28.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4eaffd640 1 -- 172.21.15.31:0/4166526194 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4d4003530 con 0x7fa4ec0b2320 2023-11-27T17:53:28.594 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0fec5c640 1 -- 172.21.15.31:0/2177358294 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f80b27a0 con 0x7fc0f80b8790 2023-11-27T17:53:28.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079854347 0 0) 0x7f9e3c0b1b30 con 0x7f9e3c0b9710 2023-11-27T17:53:28.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e24003530 con 0x7f9e3c0b9710 2023-11-27T17:53:28.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0fec5c640 1 -- 172.21.15.31:0/2177358294 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f80b4260 con 0x7fc0f80a1ec0 2023-11-27T17:53:28.595 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f1b8b160640 1 -- start start 2023-11-27T17:53:28.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3bfff640 1 --2- 172.21.15.31:0/2652366104 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e3c0b28b0 0x7f9e3c0b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246277067 0 0) 0x7f9e340014a0 con 0x7f9e3c14ede0 2023-11-27T17:53:28.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4f0902640 1 -- 172.21.15.31:0/4166526194 >> v2:172.21.15.31:3300/0 conn(0x7fa4ec0b2bc0 msgr2=0x7fa4ec0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.596 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4eaffd640 1 -- 172.21.15.31:0/4166526194 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2109788060 0 0) 0x7fa4d4003530 con 0x7fa4ec0b2320 2023-11-27T17:53:28.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e3c0b1b30 con 0x7f9e3c14ede0 2023-11-27T17:53:28.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f57532db640 1 Processor -- start 2023-11-27T17:53:28.597 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fb4192dc640 1 Processor -- start 2023-11-27T17:53:28.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 <== mon.1 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3065349884 0 0) 0x7f9e24003530 con 0x7f9e3c0b9710 2023-11-27T17:53:28.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e3c0b28b0 msgr2=0x7f9e3c0b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3affd640 1 --2- 172.21.15.31:0/2652366104 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e3c0b28b0 0x7f9e3c0b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 >> v1:172.21.15.31:6789/0 conn(0x7f9e3c14ede0 legacy=0x7f9e3c155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c0ba430 con 0x7f9e3c0b9710 2023-11-27T17:53:28.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 <== mon.1 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f9e30001680 con 0x7f9e3c0b9710 2023-11-27T17:53:28.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 >> v1:172.21.15.81:6789/0 conn(0x7f9e3c0b9710 legacy=0x7f9e3c0b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3affd640 1 --2- 172.21.15.31:0/2652366104 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e24003b80 0x7f9e24003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.599 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3affd640 1 --2- 172.21.15.31:0/2652366104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e240047d0 0x7f9e24004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3affd640 1 --2- 172.21.15.31:0/2652366104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e240052b0 0x7f9e2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0b33a0 con 0x7f9e240047d0 2023-11-27T17:53:28.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2400c160 con 0x7f9e240052b0 2023-11-27T17:53:28.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2400c320 con 0x7f9e24003b80 2023-11-27T17:53:28.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3b7fe640 1 --2- 172.21.15.31:0/2652366104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e240047d0 0x7f9e24004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3bfff640 1 --2- 172.21.15.31:0/2652366104 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e24003b80 0x7f9e24003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e40fa4640 1 --2- 172.21.15.31:0/2652366104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e240052b0 0x7f9e2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4f0902640 1 --2- 172.21.15.31:0/4166526194 >> v2:172.21.15.31:3300/0 conn(0x7fa4ec0b2bc0 0x7fa4ec0b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4f0902640 1 -- 172.21.15.31:0/4166526194 >> v1:172.21.15.31:6789/0 conn(0x7fa4ec0b2320 legacy=0x7fa4ec14e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.600 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fa4f0902640 1 -- 172.21.15.31:0/4166526194 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec0b7780 con 0x7fa4ec0b8260 2023-11-27T17:53:28.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fa4ebfff640 1 --2- 172.21.15.31:0/4166526194 >> v2:172.21.15.31:3300/0 conn(0x7fa4ec0b2bc0 0x7fa4ec0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:28.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fa4f0902640 1 --2- 172.21.15.31:0/4166526194 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa4ec0b8260 0x7fa4ec0b86f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00097c0 tx=0x7fa4e001cd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5e4dd39b1606f21 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.601 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fa4eaffd640 1 -- 172.21.15.31:0/4166526194 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc001680 con 0x7fa4ec0b8260 2023-11-27T17:53:28.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb4192dc640 1 -- start start 2023-11-27T17:53:28.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb4192dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4140729c0 0x7fb414071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb4192dc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb4140b2bc0 0x7fb41413bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb4192dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4140b7bb0 0x7fb414141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb4192dc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41413c4b0 con 0x7fb4140729c0 2023-11-27T17:53:28.602 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb4192dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb414141dc0 con 0x7fb4140b7bb0 2023-11-27T17:53:28.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb4192dc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb414140e40 con 0x7fb4140b2bc0 2023-11-27T17:53:28.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb412ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4140729c0 0x7fb414071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb412ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4140729c0 0x7fb414071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50990/0 (socket says 172.21.15.31:50990) 2023-11-27T17:53:28.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb412ffd640 1 -- 172.21.15.31:0/345193125 learned_addr learned my addr 172.21.15.31:0/345193125 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb4127fc640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb4140b2bc0 0x7fb41413bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb4137fe640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4140b7bb0 0x7fb414141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb412ffd640 1 -- 172.21.15.31:0/345193125 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb4140b2bc0 msgr2=0x7fb41413bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb412ffd640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb4140b2bc0 0x7fb41413bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb412ffd640 1 -- 172.21.15.31:0/345193125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4140b7bb0 msgr2=0x7fb414141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb412ffd640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4140b7bb0 0x7fb414141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.603 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb412ffd640 1 -- 172.21.15.31:0/345193125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404009420 con 0x7fb4140729c0 2023-11-27T17:53:28.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb412ffd640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4140729c0 0x7fb414071b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c790 tx=0x7fb40c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb3fb7fe640 1 -- 172.21.15.31:0/345193125 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c00cea0 con 0x7fb4140729c0 2023-11-27T17:53:28.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb3fb7fe640 1 -- 172.21.15.31:0/345193125 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c003ba0 con 0x7fb4140729c0 2023-11-27T17:53:28.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb3fb7fe640 1 -- 172.21.15.31:0/345193125 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c00a7f0 con 0x7fb4140729c0 2023-11-27T17:53:28.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb4192dc640 1 -- 172.21.15.31:0/345193125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb414070840 con 0x7fb4140729c0 2023-11-27T17:53:28.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fb4192dc640 1 -- 172.21.15.31:0/345193125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41406f580 con 0x7fb4140729c0 2023-11-27T17:53:28.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fbf1d61f640 1 --2- 172.21.15.31:0/3909132910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf1003b0b0 0x7fbf100ce200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf080097c0 tx=0x7fbf0801cd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d77ee52139f1cdb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fbf1ce1e640 1 -- 172.21.15.31:0/3909132910 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf080ab600 con 0x7fbf1003b0b0 2023-11-27T17:53:28.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fbf1ce1e640 1 -- 172.21.15.31:0/3909132910 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf080a7050 con 0x7fbf1003b0b0 2023-11-27T17:53:28.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fbf1ce1e640 1 -- 172.21.15.31:0/3909132910 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf080ab980 con 0x7fbf1003b0b0 2023-11-27T17:53:28.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7f57532db640 1 -- start start 2023-11-27T17:53:28.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f57532db640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f574c0b2c90 0x7f574c1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f57532db640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f574c153630 0x7f574c153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f57532db640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574c0b8fe0 con 0x7f574c0b28b0 2023-11-27T17:53:28.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f57532db640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574c0b8d70 con 0x7f574c0b2c90 2023-11-27T17:53:28.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f57532db640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c0b4420 con 0x7f574c153630 2023-11-27T17:53:28.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f5751878640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f574c153630 0x7f574c153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f5751878640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f574c153630 0x7f574c153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:38570/0 (socket says 172.21.15.31:38570) 2023-11-27T17:53:28.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f5751878640 1 -- 172.21.15.31:0/2509716443 learned_addr learned my addr 172.21.15.31:0/2509716443 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f5750876640 1 --2- 172.21.15.31:0/2509716443 >> v2:172.21.15.31:3300/0 conn(0x7f574c0b2c90 0x7f574c1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f5751878640 1 -- 172.21.15.31:0/2509716443 >> v2:172.21.15.31:3300/0 conn(0x7f574c0b2c90 msgr2=0x7f574c1530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f5751878640 1 --2- 172.21.15.31:0/2509716443 >> v2:172.21.15.31:3300/0 conn(0x7f574c0b2c90 0x7f574c1530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f5751878640 1 -- 172.21.15.31:0/2509716443 >> v1:172.21.15.81:6789/0 conn(0x7f574c0b28b0 legacy=0x7f574c0b9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.606 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f5751878640 1 -- 172.21.15.31:0/2509716443 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c0b1ba0 con 0x7f574c153630 2023-11-27T17:53:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3b7fe640 1 -- 172.21.15.31:0/2652366104 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e24003b80 msgr2=0x7f9e24003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3b7fe640 1 --2- 172.21.15.31:0/2652366104 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e24003b80 0x7f9e24003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3b7fe640 1 -- 172.21.15.31:0/2652366104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e240052b0 msgr2=0x7f9e2400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3b7fe640 1 --2- 172.21.15.31:0/2652366104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e240052b0 0x7f9e2400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f9e3b7fe640 1 -- 172.21.15.31:0/2652366104 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24003530 con 0x7f9e240047d0 2023-11-27T17:53:28.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f35a259c640 1 --2- 172.21.15.31:0/3123543931 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b2bc0 0x7f35a40b74a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3594009870 tx=0x7f359401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fb79c3d0007b900 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f35a159a640 1 -- 172.21.15.31:0/3123543931 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35940ac630 con 0x7f35a40b2bc0 2023-11-27T17:53:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f35a159a640 1 -- 172.21.15.31:0/3123543931 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35940ac790 con 0x7f35a40b2bc0 2023-11-27T17:53:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f35a159a640 1 -- 172.21.15.31:0/3123543931 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35940acb20 con 0x7f35a40b2bc0 2023-11-27T17:53:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f35a8f61640 1 -- 172.21.15.31:0/3123543931 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b2bc0 msgr2=0x7f35a40b74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7f35a8f61640 1 --2- 172.21.15.31:0/3123543931 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b2bc0 0x7f35a40b74a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3594009870 tx=0x7f359401c560 comp rx=0 tx=0).stop 2023-11-27T17:53:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0f7fff640 1 -- 172.21.15.31:0/2177358294 >> v2:172.21.15.81:3300/0 conn(0x7fc0f80a1ec0 msgr2=0x7fc0f80a22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0f7fff640 1 --2- 172.21.15.31:0/2177358294 >> v2:172.21.15.81:3300/0 conn(0x7fc0f80a1ec0 0x7fc0f80a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0f7fff640 1 -- 172.21.15.31:0/2177358294 >> v1:172.21.15.31:6789/0 conn(0x7fc0f80b8be0 legacy=0x7fc0f80b79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.581+0000 7fc0f7fff640 1 -- 172.21.15.31:0/2177358294 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f8067120 con 0x7fc0f80b8790 2023-11-27T17:53:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fc0f7fff640 1 --2- 172.21.15.31:0/2177358294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80b8790 0x7fc0f80b74a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8074010 tx=0x7fc0ec020de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3206efe102c230a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fc0f77fe640 1 -- 172.21.15.31:0/2177358294 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec008be0 con 0x7fc0f80b8790 2023-11-27T17:53:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fc0f77fe640 1 -- 172.21.15.31:0/2177358294 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ec008d40 con 0x7fc0f80b8790 2023-11-27T17:53:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fc0f77fe640 1 -- 172.21.15.31:0/2177358294 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec0aabf0 con 0x7fc0f80b8790 2023-11-27T17:53:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 -- 172.21.15.31:0/3909132910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf1003b0b0 msgr2=0x7fbf100ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.609 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 --2- 172.21.15.31:0/3909132910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf1003b0b0 0x7fbf100ce200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbf080097c0 tx=0x7fbf0801cd90 comp rx=0 tx=0).stop 2023-11-27T17:53:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 -- 172.21.15.31:0/3909132910 shutdown_connections 2023-11-27T17:53:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 --2- 172.21.15.31:0/3909132910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf1003b0b0 0x7fbf100ce200 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 --2- 172.21.15.31:0/3909132910 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf1003acd0 0x7fbf10038da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 -- 172.21.15.31:0/3909132910 >> 172.21.15.31:0/3909132910 conn(0x7fbf10005ec0 msgr2=0x7fbf100062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fa4eaffd640 1 -- 172.21.15.31:0/4166526194 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e00a7050 con 0x7fa4ec0b8260 2023-11-27T17:53:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.585+0000 7fa4eaffd640 1 -- 172.21.15.31:0/4166526194 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00ab600 con 0x7fa4ec0b8260 2023-11-27T17:53:28.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 -- 172.21.15.31:0/4166526194 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa4ec0b8260 msgr2=0x7fa4ec0b86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 --2- 172.21.15.31:0/4166526194 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa4ec0b8260 0x7fa4ec0b86f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00097c0 tx=0x7fa4e001cd60 comp rx=0 tx=0).stop 2023-11-27T17:53:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f9e3b7fe640 1 --2- 172.21.15.31:0/2652366104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e240047d0 0x7f9e24004c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9e30007f80 tx=0x7f9e3001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f75383873a98887 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 -- 172.21.15.31:0/3123543931 shutdown_connections 2023-11-27T17:53:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 --2- 172.21.15.31:0/3123543931 >> v2:172.21.15.81:3300/0 conn(0x7f35a40729c0 0x7f35a40b79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 --2- 172.21.15.31:0/3123543931 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b2bc0 0x7f35a40b74a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 -- 172.21.15.31:0/3123543931 >> 172.21.15.31:0/3123543931 conn(0x7f35a40b95a0 msgr2=0x7f35a40b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fc0fec5c640 1 -- 172.21.15.31:0/2177358294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80b8790 msgr2=0x7fc0f80b74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fc0fec5c640 1 --2- 172.21.15.31:0/2177358294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80b8790 0x7fc0f80b74a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8074010 tx=0x7fc0ec020de0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 -- 172.21.15.31:0/4166526194 shutdown_connections 2023-11-27T17:53:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 --2- 172.21.15.31:0/4166526194 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa4ec0b8260 0x7fa4ec0b86f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 --2- 172.21.15.31:0/4166526194 >> v2:172.21.15.31:3300/0 conn(0x7fa4ec0b2bc0 0x7fa4ec0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 -- 172.21.15.31:0/4166526194 >> 172.21.15.31:0/4166526194 conn(0x7fa4ec0b95a0 msgr2=0x7fa4ec0b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.613 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 -- 172.21.15.31:0/3909132910 shutdown_connections 2023-11-27T17:53:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fc0fec5c640 1 -- 172.21.15.31:0/2177358294 shutdown_connections 2023-11-27T17:53:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30005ae0 con 0x7f9e240047d0 2023-11-27T17:53:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e30005c60 con 0x7f9e240047d0 2023-11-27T17:53:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f9e3affd640 1 -- 172.21.15.31:0/2652366104 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e300072b0 con 0x7f9e240047d0 2023-11-27T17:53:28.614 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 -- 172.21.15.31:0/3123543931 shutdown_connections 2023-11-27T17:53:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f5751878640 1 --2- 172.21.15.31:0/2509716443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f574c153630 0x7f574c153aa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5744009e50 tx=0x7f574401f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=553afe0153098ef5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 -- 172.21.15.31:0/4166526194 shutdown_connections 2023-11-27T17:53:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fc0fec5c640 1 --2- 172.21.15.31:0/2177358294 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80b8790 0x7fc0f80b74a0 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8074010 tx=0x7fc0ec020de0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fc0fec5c640 1 --2- 172.21.15.31:0/2177358294 >> v2:172.21.15.81:3300/0 conn(0x7fc0f80a1ec0 0x7fc0f80a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fc0fec5c640 1 -- 172.21.15.31:0/2177358294 >> 172.21.15.31:0/2177358294 conn(0x7fc0f80b95a0 msgr2=0x7fc0f80b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fc0fec5c640 1 -- 172.21.15.31:0/2177358294 shutdown_connections 2023-11-27T17:53:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fc0fec5c640 1 -- 172.21.15.31:0/2177358294 wait complete. 2023-11-27T17:53:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fb3fb7fe640 1 -- 172.21.15.31:0/345193125 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb40c00a950 con 0x7fb4140729c0 2023-11-27T17:53:28.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fb4192dc640 1 -- 172.21.15.31:0/345193125 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3f4000fd0 con 0x7fb4140729c0 2023-11-27T17:53:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f9e42a07640 1 -- 172.21.15.31:0/2652366104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e240047d0 msgr2=0x7f9e24004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f9e42a07640 1 --2- 172.21.15.31:0/2652366104 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e240047d0 0x7f9e24004c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9e30007f80 tx=0x7f9e3001ca90 comp rx=0 tx=0).stop 2023-11-27T17:53:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f9e40fa4640 1 -- 172.21.15.31:0/2652366104 reap_dead start 2023-11-27T17:53:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 -- 172.21.15.31:0/4166526194 wait complete. 2023-11-27T17:53:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 Processor -- start 2023-11-27T17:53:28.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 -- start start 2023-11-27T17:53:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 -- 172.21.15.31:0/3909132910 wait complete. 2023-11-27T17:53:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 Processor -- start 2023-11-27T17:53:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f5743fff640 1 -- 172.21.15.31:0/2509716443 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57440af400 con 0x7f574c153630 2023-11-27T17:53:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f5743fff640 1 -- 172.21.15.31:0/2509716443 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57440ab050 con 0x7f574c153630 2023-11-27T17:53:28.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f5743fff640 1 -- 172.21.15.31:0/2509716443 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57440af780 con 0x7f574c153630 2023-11-27T17:53:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f57532db640 1 -- 172.21.15.31:0/2509716443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f574c153630 msgr2=0x7f574c153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f57532db640 1 --2- 172.21.15.31:0/2509716443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f574c153630 0x7f574c153aa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5744009e50 tx=0x7f574401f1f0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f57532db640 1 -- 172.21.15.31:0/2509716443 shutdown_connections 2023-11-27T17:53:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f57532db640 1 --2- 172.21.15.31:0/2509716443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f574c153630 0x7f574c153aa0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f57532db640 1 --2- 172.21.15.31:0/2509716443 >> v2:172.21.15.31:3300/0 conn(0x7f574c0b2c90 0x7f574c1530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f57532db640 1 -- 172.21.15.31:0/2509716443 >> 172.21.15.31:0/2509716443 conn(0x7f574c06a560 msgr2=0x7f574c06a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f9e42a07640 1 -- 172.21.15.31:0/2652366104 shutdown_connections 2023-11-27T17:53:28.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f9e42a07640 1 -- 172.21.15.31:0/2652366104 >> 172.21.15.31:0/2652366104 conn(0x7f9e3c06a560 msgr2=0x7f9e3c06a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 -- 172.21.15.31:0/3123543931 wait complete. 2023-11-27T17:53:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 Processor -- start 2023-11-27T17:53:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f9e42a07640 1 -- 172.21.15.31:0/2652366104 shutdown_connections 2023-11-27T17:53:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4ec0b2320 0x7fa4ec0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2bc0 0x7fa4ec148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa4ec0b8260 0x7fa4ec1e7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec0b6960 con 0x7fa4ec0b2bc0 2023-11-27T17:53:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec1eb5d0 con 0x7fa4ec0b2320 2023-11-27T17:53:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4f2365640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec1eba60 con 0x7fa4ec0b8260 2023-11-27T17:53:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fa4eb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2bc0 0x7fa4ec148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4eb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2bc0 0x7fa4ec148710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51010/0 (socket says 172.21.15.31:51010) 2023-11-27T17:53:28.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4eb7fe640 1 -- 172.21.15.31:0/2639245019 learned_addr learned my addr 172.21.15.31:0/2639245019 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fb3fb7fe640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb400066870 0x7fb400068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fb3fb7fe640 1 -- 172.21.15.31:0/345193125 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb40c083e80 con 0x7fb4140729c0 2023-11-27T17:53:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fb3fb7fe640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:6816/2443446215,v1:172.21.15.31:6817/2443446215] conn(0x7fb40006ea90 0x7fb400070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fb3fb7fe640 1 -- 172.21.15.31:0/345193125 --> [v2:172.21.15.31:6816/2443446215,v1:172.21.15.31:6817/2443446215] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb400071560 con 0x7fb40006ea90 2023-11-27T17:53:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fb3fb7fe640 1 -- 172.21.15.31:0/345193125 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb40c086590 con 0x7fb4140729c0 2023-11-27T17:53:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fb4137fe640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:6816/2443446215,v1:172.21.15.31:6817/2443446215] conn(0x7fb40006ea90 0x7fb400070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fb4127fc640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb400066870 0x7fb400068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fb4137fe640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:6816/2443446215,v1:172.21.15.31:6817/2443446215] conn(0x7fb40006ea90 0x7fb400070eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fb4127fc640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb400066870 0x7fb400068d30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4141420c0 tx=0x7fb408007d40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f1b8b160640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b840b2ce0 0x7f1b840b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f1b8b160640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b840b2220 0x7f1b840b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f1b88efc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b840b2ce0 0x7f1b840b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f1b88efc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b840b2ce0 0x7f1b840b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:38582/0 (socket says 172.21.15.31:38582) 2023-11-27T17:53:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b83fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b840b2220 0x7f1b840b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b83fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1b840b2220 0x7f1b840b74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:51636/0 (socket says 172.21.15.31:51636) 2023-11-27T17:53:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b88efc640 1 -- 172.21.15.31:0/125153868 learned_addr learned my addr 172.21.15.31:0/125153868 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b8b160640 1 --2- 172.21.15.31:0/125153868 >> v2:172.21.15.31:3300/0 conn(0x7f1b840b30c0 0x7f1b8414aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b8b160640 1 -- 172.21.15.31:0/125153868 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b840b4640 con 0x7f1b840b30c0 2023-11-27T17:53:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b8b160640 1 -- 172.21.15.31:0/125153868 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b840b6ef0 con 0x7f1b840b2220 2023-11-27T17:53:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b8b160640 1 -- 172.21.15.31:0/125153868 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b840b79e0 con 0x7f1b840b2ce0 2023-11-27T17:53:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 -- start start 2023-11-27T17:53:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf1003acd0 0x7fbf100d0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1003b0b0 0x7fbf100cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf100ce740 0x7fbf100d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf100d06a0 con 0x7fbf1003b0b0 2023-11-27T17:53:28.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf100cf240 con 0x7fbf1003acd0 2023-11-27T17:53:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf20084640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf100ceef0 con 0x7fbf100ce740 2023-11-27T17:53:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf1d61f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1003b0b0 0x7fbf100cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf1d61f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1003b0b0 0x7fbf100cf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50996/0 (socket says 172.21.15.31:50996) 2023-11-27T17:53:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf1d61f640 1 -- 172.21.15.31:0/1448521908 learned_addr learned my addr 172.21.15.31:0/1448521908 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf1e621640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf100ce740 0x7fbf100d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fbf1de20640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf1003acd0 0x7fbf100d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fbf1d61f640 1 -- 172.21.15.31:0/1448521908 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf100ce740 msgr2=0x7fbf100d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fbf1d61f640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbf100ce740 0x7fbf100d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fbf1d61f640 1 -- 172.21.15.31:0/1448521908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf1003acd0 msgr2=0x7fbf100d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fbf1d61f640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf1003acd0 0x7fbf100d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fbf1d61f640 1 -- 172.21.15.31:0/1448521908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf08009420 con 0x7fbf1003b0b0 2023-11-27T17:53:28.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fbf1de20640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf1003acd0 0x7fbf100d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:28.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fbf1d61f640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1003b0b0 0x7fbf100cf6d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbf08018f60 tx=0x7fbf080190f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f9e42a07640 1 -- 172.21.15.31:0/2652366104 wait complete. 2023-11-27T17:53:28.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e42a07640 1 Processor -- start 2023-11-27T17:53:28.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 -- start start 2023-11-27T17:53:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a40729c0 0x7f35a41ebea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a40b2bc0 0x7f35a4145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b61f0 0x7f35a4157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4159480 con 0x7f35a40729c0 2023-11-27T17:53:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4156b10 con 0x7f35a40b2bc0 2023-11-27T17:53:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a8f61640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4156d60 con 0x7f35a40b61f0 2023-11-27T17:53:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a2d9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b61f0 0x7f35a4157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a2d9d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b61f0 0x7f35a4157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:38600/0 (socket says 172.21.15.31:38600) 2023-11-27T17:53:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a2d9d640 1 -- 172.21.15.31:0/1707509623 learned_addr learned my addr 172.21.15.31:0/1707509623 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7f35a1d9b640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a40b2bc0 0x7f35a4145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f35a259c640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a40729c0 0x7f35a41ebea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fc0fec5c640 1 Processor -- start 2023-11-27T17:53:28.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.589+0000 7fc0fec5c640 1 -- start start 2023-11-27T17:53:28.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b896fd640 1 --2- 172.21.15.31:0/125153868 >> v2:172.21.15.31:3300/0 conn(0x7f1b840b30c0 0x7f1b8414aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fec5c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80a1ec0 0x7fc0f80b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4f0902640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa4ec0b8260 0x7fa4ec1e7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4ebfff640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4ec0b2320 0x7fa4ec0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fbf0e7fc640 1 -- 172.21.15.31:0/1448521908 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf080b48d0 con 0x7fbf1003b0b0 2023-11-27T17:53:28.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fbf0e7fc640 1 -- 172.21.15.31:0/1448521908 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf080b4a30 con 0x7fbf1003b0b0 2023-11-27T17:53:28.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fbf0e7fc640 1 -- 172.21.15.31:0/1448521908 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf080b4de0 con 0x7fbf1003b0b0 2023-11-27T17:53:28.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f57532db640 1 -- 172.21.15.31:0/2509716443 shutdown_connections 2023-11-27T17:53:28.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f35a2d9d640 1 -- 172.21.15.31:0/1707509623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a40b2bc0 msgr2=0x7f35a4145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f35a2d9d640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35a40b2bc0 0x7f35a4145eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f35a2d9d640 1 -- 172.21.15.31:0/1707509623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a40729c0 msgr2=0x7f35a41ebea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f35a2d9d640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a40729c0 0x7f35a41ebea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f35a2d9d640 1 -- 172.21.15.31:0/1707509623 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35940094d0 con 0x7f35a40b61f0 2023-11-27T17:53:28.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f35a259c640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35a40729c0 0x7f35a41ebea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:28.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fec5c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0f80b8be0 0x7fc0f8071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fec5c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0f8072350 0x7fc0f8071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fec5c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f8070220 con 0x7fc0f80a1ec0 2023-11-27T17:53:28.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fec5c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f80b61c0 con 0x7fc0f8072350 2023-11-27T17:53:28.631 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fec5c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f81e3580 con 0x7fc0f80b8be0 2023-11-27T17:53:28.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fb3fb7fe640 1 -- 172.21.15.31:0/345193125 <== osd.1 v2:172.21.15.31:6816/2443446215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb400071560 con 0x7fb40006ea90 2023-11-27T17:53:28.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4eb7fe640 1 -- 172.21.15.31:0/2639245019 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa4ec0b8260 msgr2=0x7fa4ec1e7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4eb7fe640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa4ec0b8260 0x7fa4ec1e7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4eb7fe640 1 -- 172.21.15.31:0/2639245019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4ec0b2320 msgr2=0x7fa4ec0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4eb7fe640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa4ec0b2320 0x7fa4ec0b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4eb7fe640 1 -- 172.21.15.31:0/2639245019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e4009a70 con 0x7fa4ec0b2bc0 2023-11-27T17:53:28.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f35a2d9d640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b61f0 0x7f35a4157120 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f359800c3c0 tx=0x7f359800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e42a07640 1 -- start start 2023-11-27T17:53:28.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e42a07640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e3c154ae0 0x7f9e3c155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e42a07640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e3c1e8880 0x7f9e3c1e8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e42a07640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e3c148c80 0x7f9e3c1490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e42a07640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0712f0 con 0x7f9e3c154ae0 2023-11-27T17:53:28.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e42a07640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c1e83f0 con 0x7f9e3c148c80 2023-11-27T17:53:28.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e42a07640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c155f40 con 0x7f9e3c1e8880 2023-11-27T17:53:28.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4eb7fe640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2bc0 0x7fa4ec148710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00c780 tx=0x7fa4dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f3592ffd640 1 -- 172.21.15.31:0/1707509623 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980074e0 con 0x7f35a40b61f0 2023-11-27T17:53:28.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fbf20084640 1 -- 172.21.15.31:0/1448521908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf10027860 con 0x7fbf1003b0b0 2023-11-27T17:53:28.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fbf20084640 1 -- 172.21.15.31:0/1448521908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf100cfc10 con 0x7fbf1003b0b0 2023-11-27T17:53:28.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f3592ffd640 1 -- 172.21.15.31:0/1707509623 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598007640 con 0x7f35a40b61f0 2023-11-27T17:53:28.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f3592ffd640 1 -- 172.21.15.31:0/1707509623 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598004a30 con 0x7f35a40b61f0 2023-11-27T17:53:28.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4e8ff9640 1 -- 172.21.15.31:0/2639245019 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc005ae0 con 0x7fa4ec0b2bc0 2023-11-27T17:53:28.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f35a8f61640 1 -- 172.21.15.31:0/1707509623 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a4159d00 con 0x7f35a40b61f0 2023-11-27T17:53:28.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4e8ff9640 1 -- 172.21.15.31:0/2639245019 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc005c60 con 0x7fa4ec0b2bc0 2023-11-27T17:53:28.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4e8ff9640 1 -- 172.21.15.31:0/2639245019 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc007070 con 0x7fa4ec0b2bc0 2023-11-27T17:53:28.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4f2365640 1 -- 172.21.15.31:0/2639245019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e0009420 con 0x7fa4ec0b2bc0 2023-11-27T17:53:28.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4f2365640 1 -- 172.21.15.31:0/2639245019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec1eaf80 con 0x7fa4ec0b2bc0 2023-11-27T17:53:28.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f35a8f61640 1 -- 172.21.15.31:0/1707509623 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a4159990 con 0x7f35a40b61f0 2023-11-27T17:53:28.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f35a8f61640 1 -- 172.21.15.31:0/1707509623 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3588000fd0 con 0x7f35a40b61f0 2023-11-27T17:53:28.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f57532db640 1 -- 172.21.15.31:0/2509716443 wait complete. 2023-11-27T17:53:28.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f57532db640 1 Processor -- start 2023-11-27T17:53:28.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e3b7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e3c1e8880 0x7f9e3c1e8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e3b7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e3c1e8880 0x7f9e3c1e8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:38626/0 (socket says 172.21.15.31:38626) 2023-11-27T17:53:28.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e3b7fe640 1 -- 172.21.15.31:0/2176754930 learned_addr learned my addr 172.21.15.31:0/2176754930 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e40fa4640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e3c148c80 0x7f9e3c1490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fa4f2365640 1 -- 172.21.15.31:0/2639245019 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa4ec0b9270 con 0x7fa4ec0b2bc0 2023-11-27T17:53:28.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e3b7fe640 1 -- 172.21.15.31:0/2176754930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e3c148c80 msgr2=0x7f9e3c1490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e3b7fe640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e3c148c80 0x7f9e3c1490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e3b7fe640 1 -- 172.21.15.31:0/2176754930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e3c154ae0 msgr2=0x7f9e3c155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e3b7fe640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e3c154ae0 0x7f9e3c155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e3b7fe640 1 -- 172.21.15.31:0/2176754930 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c1e9220 con 0x7f9e3c1e8880 2023-11-27T17:53:28.640 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e40fa4640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e3c148c80 0x7f9e3c1490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:28.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fc9f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80a1ec0 0x7fc0f80b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fc9f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80a1ec0 0x7fc0f80b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51040/0 (socket says 172.21.15.31:51040) 2023-11-27T17:53:28.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fc9f8640 1 -- 172.21.15.31:0/905128050 learned_addr learned my addr 172.21.15.31:0/905128050 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fc9f8640 1 -- 172.21.15.31:0/905128050 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0f80b8be0 msgr2=0x7fc0f8071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fc9f8640 1 --2- 172.21.15.31:0/905128050 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc0f80b8be0 0x7fc0f8071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fc9f8640 1 -- 172.21.15.31:0/905128050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0f8072350 msgr2=0x7fc0f8071690 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:53:28.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fc9f8640 1 --2- 172.21.15.31:0/905128050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0f8072350 0x7fc0f8071690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fc9f8640 1 -- 172.21.15.31:0/905128050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec007040 con 0x7fc0f80a1ec0 2023-11-27T17:53:28.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f9e3b7fe640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e3c1e8880 0x7f9e3c1e8ce0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9e3001d330 tx=0x7f9e24005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7fc0fc9f8640 1 --2- 172.21.15.31:0/905128050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80a1ec0 0x7fc0f80b5c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800b550 tx=0x7fc0e800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fbf20084640 1 -- 172.21.15.31:0/1448521908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf100052a0 con 0x7fbf1003b0b0 2023-11-27T17:53:28.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fbf0e7fc640 1 -- 172.21.15.31:0/1448521908 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fbf080b2040 con 0x7fbf1003b0b0 2023-11-27T17:53:28.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fa4e8ff9640 1 -- 172.21.15.31:0/2639245019 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa4dc0071d0 con 0x7fa4ec0b2bc0 2023-11-27T17:53:28.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b896fd640 1 -- 172.21.15.31:0/125153868 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b840b2ce0 msgr2=0x7f1b840b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b896fd640 1 --2- 172.21.15.31:0/125153868 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b840b2ce0 0x7f1b840b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b896fd640 1 -- 172.21.15.31:0/125153868 >> v2:172.21.15.81:3300/0 conn(0x7f1b840b2220 msgr2=0x7f1b840b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b896fd640 1 --2- 172.21.15.31:0/125153868 >> v2:172.21.15.81:3300/0 conn(0x7f1b840b2220 0x7f1b840b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.593+0000 7f1b896fd640 1 -- 172.21.15.31:0/125153868 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b840b6bc0 con 0x7f1b840b30c0 2023-11-27T17:53:28.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f1b896fd640 1 --2- 172.21.15.31:0/125153868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b840b30c0 0x7f1b8414aca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1b840b9f10 tx=0x7f1b78023060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d40a2a1c81c780 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f9e38ff9640 1 -- 172.21.15.31:0/2176754930 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e300b4070 con 0x7f9e3c1e8880 2023-11-27T17:53:28.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fa4e8ff9640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa4d8066840 0x7fa4d8068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fa4e8ff9640 1 -- 172.21.15.31:0/2639245019 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4dc083e80 con 0x7fa4ec0b2bc0 2023-11-27T17:53:28.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fa4e8ff9640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:6800/87696833,v1:172.21.15.31:6801/87696833] conn(0x7fa4d806e9e0 0x7fa4d8070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fa4e8ff9640 1 -- 172.21.15.31:0/2639245019 --> [v2:172.21.15.31:6800/87696833,v1:172.21.15.31:6801/87696833] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4d80714b0 con 0x7fa4d806e9e0 2023-11-27T17:53:28.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fa4e8ff9640 1 -- 172.21.15.31:0/2639245019 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4dc0511b0 con 0x7fa4ec0b2bc0 2023-11-27T17:53:28.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fa4ebfff640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa4d8066840 0x7fa4d8068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fbf0e7fc640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbefc0667f0 0x7fbefc068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fbf0e7fc640 1 -- 172.21.15.31:0/1448521908 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf0811e890 con 0x7fbf1003b0b0 2023-11-27T17:53:28.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fbf0e7fc640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:6824/1572841372,v1:172.21.15.31:6825/1572841372] conn(0x7fbefc06e990 0x7fbefc070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fbf0e7fc640 1 -- 172.21.15.31:0/1448521908 --> [v2:172.21.15.31:6824/1572841372,v1:172.21.15.31:6825/1572841372] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbefc071460 con 0x7fbefc06e990 2023-11-27T17:53:28.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fbf1de20640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbefc0667f0 0x7fbefc068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fbf1e621640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:6824/1572841372,v1:172.21.15.31:6825/1572841372] conn(0x7fbefc06e990 0x7fbefc070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f57532db640 1 -- start start 2023-11-27T17:53:28.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f57532db640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f574c0b28b0 0x7f574c1328d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f57532db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0b2c90 0x7f574c1f1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f57532db640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574c153630 0x7f574c1f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f57532db640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c12fa90 con 0x7f574c153630 2023-11-27T17:53:28.646 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f57532db640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c12f480 con 0x7f574c0b2c90 2023-11-27T17:53:28.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f57532db640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c12f720 con 0x7f574c0b28b0 2023-11-27T17:53:28.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f5750876640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0b2c90 0x7f574c1f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f5750876640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0b2c90 0x7f574c1f1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:51692/0 (socket says 172.21.15.31:51692) 2023-11-27T17:53:28.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f5750876640 1 -- 172.21.15.31:0/3926464340 learned_addr learned my addr 172.21.15.31:0/3926464340 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f5751077640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f574c0b28b0 0x7f574c1328d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f9e38ff9640 1 -- 172.21.15.31:0/2176754930 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e30001480 con 0x7f9e3c1e8880 2023-11-27T17:53:28.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f9e38ff9640 1 -- 172.21.15.31:0/2176754930 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e300a5e50 con 0x7f9e3c1e8880 2023-11-27T17:53:28.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f9e42a07640 1 -- 172.21.15.31:0/2176754930 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c071540 con 0x7f9e3c1e8880 2023-11-27T17:53:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f9e42a07640 1 -- 172.21.15.31:0/2176754930 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c071b00 con 0x7f9e3c1e8880 2023-11-27T17:53:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f3592ffd640 1 -- 172.21.15.31:0/1707509623 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3598004b90 con 0x7f35a40b61f0 2023-11-27T17:53:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f3592ffd640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f35840667f0 0x7f3584068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f3592ffd640 1 -- 172.21.15.31:0/1707509623 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3598084780 con 0x7f35a40b61f0 2023-11-27T17:53:28.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f35a259c640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f35840667f0 0x7f3584068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f3592ffd640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.81:6824/1518266559,v1:172.21.15.81:6825/1518266559] conn(0x7f358406e990 0x7f3584070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f3592ffd640 1 -- 172.21.15.31:0/1707509623 --> [v2:172.21.15.81:6824/1518266559,v1:172.21.15.81:6825/1518266559] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3584071460 con 0x7f358406e990 2023-11-27T17:53:28.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f3592ffd640 1 -- 172.21.15.31:0/1707509623 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3598084bd0 con 0x7f35a40b61f0 2023-11-27T17:53:28.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f35a1d9b640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.81:6824/1518266559,v1:172.21.15.81:6825/1518266559] conn(0x7f358406e990 0x7f3584070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f5750876640 1 -- 172.21.15.31:0/3926464340 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f574c0b28b0 msgr2=0x7f574c1328d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f5750876640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f574c0b28b0 0x7f574c1328d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f5750876640 1 -- 172.21.15.31:0/3926464340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574c153630 msgr2=0x7f574c1f15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fc0f57fa640 1 -- 172.21.15.31:0/905128050 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8010610 con 0x7fc0f80a1ec0 2023-11-27T17:53:28.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fc0f57fa640 1 -- 172.21.15.31:0/905128050 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e8010770 con 0x7fc0f80a1ec0 2023-11-27T17:53:28.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fbf1e621640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:6824/1572841372,v1:172.21.15.31:6825/1572841372] conn(0x7fbefc06e990 0x7fbefc070db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f5750876640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f574c153630 0x7f574c1f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f5750876640 1 -- 172.21.15.31:0/3926464340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5744009b30 con 0x7f574c0b2c90 2023-11-27T17:53:28.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f35a259c640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f35840667f0 0x7f3584068cb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35940ae000 tx=0x7f3594008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.651 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fbf1de20640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbefc0667f0 0x7fbefc068cb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbf18072ee0 tx=0x7fbf18069a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f1b837fe640 1 -- 172.21.15.31:0/125153868 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b780acd20 con 0x7f1b840b30c0 2023-11-27T17:53:28.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f1b837fe640 1 -- 172.21.15.31:0/125153868 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b780ace80 con 0x7f1b840b30c0 2023-11-27T17:53:28.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f1b837fe640 1 -- 172.21.15.31:0/125153868 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b780b4660 con 0x7f1b840b30c0 2023-11-27T17:53:28.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fa4f0902640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:6800/87696833,v1:172.21.15.31:6801/87696833] conn(0x7fa4d806e9e0 0x7fa4d8070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.652 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fa4ebfff640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa4d8066840 0x7fa4d8068d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4007600 tx=0x7fa4e400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fbf0e7fc640 1 -- 172.21.15.31:0/1448521908 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf080eb980 con 0x7fbf1003b0b0 2023-11-27T17:53:28.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f5750876640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0b2c90 0x7f574c1f1070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f574800e9b0 tx=0x7f574800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f9e42a07640 1 -- 172.21.15.31:0/2176754930 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e1c000fd0 con 0x7f9e3c1e8880 2023-11-27T17:53:28.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f35a1d9b640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.81:6824/1518266559,v1:172.21.15.81:6825/1518266559] conn(0x7f358406e990 0x7f3584070db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fc0f57fa640 1 -- 172.21.15.31:0/905128050 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8010b00 con 0x7fc0f80a1ec0 2023-11-27T17:53:28.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fc0fec5c640 1 -- 172.21.15.31:0/905128050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f81e32a0 con 0x7fc0f80a1ec0 2023-11-27T17:53:28.654 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fc0fec5c640 1 -- 172.21.15.31:0/905128050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f806f530 con 0x7fc0f80a1ec0 2023-11-27T17:53:28.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7fa4f0902640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:6800/87696833,v1:172.21.15.31:6801/87696833] conn(0x7fa4d806e9e0 0x7fa4d8070e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f1b8b160640 1 -- 172.21.15.31:0/125153868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b840b30c0 msgr2=0x7f1b8414aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f1b8b160640 1 --2- 172.21.15.31:0/125153868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b840b30c0 0x7f1b8414aca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1b840b9f10 tx=0x7f1b78023060 comp rx=0 tx=0).stop 2023-11-27T17:53:28.655 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.597+0000 7f5741ffb640 1 -- 172.21.15.31:0/3926464340 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57480096b0 con 0x7f574c0b2c90 2023-11-27T17:53:28.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f9e38ff9640 1 -- 172.21.15.31:0/2176754930 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9e300b7070 con 0x7f9e3c1e8880 2023-11-27T17:53:28.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7fc0fec5c640 1 -- 172.21.15.31:0/905128050 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc0f80a27e0 con 0x7fc0f80a1ec0 2023-11-27T17:53:28.656 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f5741ffb640 1 -- 172.21.15.31:0/3926464340 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574800c9a0 con 0x7f574c0b2c90 2023-11-27T17:53:28.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f5741ffb640 1 -- 172.21.15.31:0/3926464340 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574800cd30 con 0x7f574c0b2c90 2023-11-27T17:53:28.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7fbf0e7fc640 1 -- 172.21.15.31:0/1448521908 <== osd.3 v2:172.21.15.31:6824/1572841372 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbefc071460 con 0x7fbefc06e990 2023-11-27T17:53:28.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7fa4e8ff9640 1 -- 172.21.15.31:0/2639245019 <== osd.0 v2:172.21.15.31:6800/87696833 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa4d80714b0 con 0x7fa4d806e9e0 2023-11-27T17:53:28.657 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f9e38ff9640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9e28066840 0x7f9e28068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f9e38ff9640 1 -- 172.21.15.31:0/2176754930 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e3011d710 con 0x7f9e3c1e8880 2023-11-27T17:53:28.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f3592ffd640 1 -- 172.21.15.31:0/1707509623 <== osd.6 v2:172.21.15.81:6824/1518266559 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3584071460 con 0x7f358406e990 2023-11-27T17:53:28.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f57532db640 1 -- 172.21.15.31:0/3926464340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574c133510 con 0x7f574c0b2c90 2023-11-27T17:53:28.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f57532db640 1 -- 172.21.15.31:0/3926464340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574c12b4a0 con 0x7f574c0b2c90 2023-11-27T17:53:28.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f57532db640 1 -- 172.21.15.31:0/3926464340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f574c0ba3e0 con 0x7f574c0b2c90 2023-11-27T17:53:28.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f9e38ff9640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.81:6808/691520267,v1:172.21.15.81:6809/691520267] conn(0x7f9e2806ea60 0x7f9e28070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f9e38ff9640 1 -- 172.21.15.31:0/2176754930 --> [v2:172.21.15.81:6808/691520267,v1:172.21.15.81:6809/691520267] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e28071530 con 0x7f9e2806ea60 2023-11-27T17:53:28.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f9e38ff9640 1 -- 172.21.15.31:0/2176754930 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e3011da80 con 0x7f9e3c1e8880 2023-11-27T17:53:28.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f9e3bfff640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9e28066840 0x7f9e28068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.659 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f9e40fa4640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.81:6808/691520267,v1:172.21.15.81:6809/691520267] conn(0x7f9e2806ea60 0x7f9e28070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f1b8b160640 1 -- 172.21.15.31:0/125153868 shutdown_connections 2023-11-27T17:53:28.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f1b8b160640 1 --2- 172.21.15.31:0/125153868 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b840b30c0 0x7f1b8414aca0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f1b8b160640 1 --2- 172.21.15.31:0/125153868 >> v2:172.21.15.81:3300/0 conn(0x7f1b840b2220 0x7f1b840b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f1b8b160640 1 --2- 172.21.15.31:0/125153868 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b840b2ce0 0x7f1b840b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f1b8b160640 1 -- 172.21.15.31:0/125153868 >> 172.21.15.31:0/125153868 conn(0x7f1b8406a560 msgr2=0x7f1b8406a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7fc0f57fa640 1 -- 172.21.15.31:0/905128050 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fc0e8010c60 con 0x7fc0f80a1ec0 2023-11-27T17:53:28.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7fc0f57fa640 1 --2- 172.21.15.31:0/905128050 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fc0e40668c0 0x7fc0e4068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7fc0f57fa640 1 -- 172.21.15.31:0/905128050 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0e8083e60 con 0x7fc0f80a1ec0 2023-11-27T17:53:28.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7fc0f57fa640 1 --2- 172.21.15.31:0/905128050 >> [v2:172.21.15.81:6800/1833955858,v1:172.21.15.81:6801/1833955858] conn(0x7fc0e406e970 0x7fc0e4070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7fc0f57fa640 1 -- 172.21.15.31:0/905128050 --> [v2:172.21.15.81:6800/1833955858,v1:172.21.15.81:6801/1833955858] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0e4071440 con 0x7fc0e406e970 2023-11-27T17:53:28.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7fc0f57fa640 1 -- 172.21.15.31:0/905128050 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0e8086480 con 0x7fc0f80a1ec0 2023-11-27T17:53:28.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f9e3bfff640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9e28066840 0x7f9e28068d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c006aa0 tx=0x7f9e2c006a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f1b8b160640 1 -- 172.21.15.31:0/125153868 shutdown_connections 2023-11-27T17:53:28.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7f1b8b160640 1 -- 172.21.15.31:0/125153868 wait complete. 2023-11-27T17:53:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.601+0000 7fc0fd1f9640 1 --2- 172.21.15.31:0/905128050 >> [v2:172.21.15.81:6800/1833955858,v1:172.21.15.81:6801/1833955858] conn(0x7fc0e406e970 0x7fc0e4070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7fc0f7fff640 1 --2- 172.21.15.31:0/905128050 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fc0e40668c0 0x7fc0e4068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7fc0fd1f9640 1 --2- 172.21.15.31:0/905128050 >> [v2:172.21.15.81:6800/1833955858,v1:172.21.15.81:6801/1833955858] conn(0x7fc0e406e970 0x7fc0e4070d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7fc0f7fff640 1 --2- 172.21.15.31:0/905128050 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fc0e40668c0 0x7fc0e4068d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0b3000 tx=0x7fc0ec004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b8b160640 1 Processor -- start 2023-11-27T17:53:28.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b8b160640 1 -- start start 2023-11-27T17:53:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f5741ffb640 1 -- 172.21.15.31:0/3926464340 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5748013470 con 0x7f574c0b2c90 2023-11-27T17:53:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f5741ffb640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57300667f0 0x7f5730068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f5741ffb640 1 -- 172.21.15.31:0/3926464340 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5748084830 con 0x7f574c0b2c90 2023-11-27T17:53:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f5741ffb640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.81:6816/4034202684,v1:172.21.15.81:6817/4034202684] conn(0x7f573006ea10 0x7f5730070e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f5741ffb640 1 -- 172.21.15.31:0/3926464340 --> [v2:172.21.15.81:6816/4034202684,v1:172.21.15.81:6817/4034202684] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57300714e0 con 0x7f573006ea10 2023-11-27T17:53:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f5741ffb640 1 -- 172.21.15.31:0/3926464340 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5748084be0 con 0x7f574c0b2c90 2023-11-27T17:53:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f5751077640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57300667f0 0x7f5730068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f5751878640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.81:6816/4034202684,v1:172.21.15.81:6817/4034202684] conn(0x7f573006ea10 0x7f5730070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7fc0f57fa640 1 -- 172.21.15.31:0/905128050 <== osd.7 v2:172.21.15.81:6800/1833955858 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc0e4071440 con 0x7fc0e406e970 2023-11-27T17:53:28.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b8b160640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b840b2220 0x7f1b84071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b8b160640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b840b2ce0 0x7f1b841d2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b8b160640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b840b30c0 0x7f1b841e4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b8b160640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b84071fa0 con 0x7f1b840b2220 2023-11-27T17:53:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b8b160640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b841d0770 con 0x7f1b840b30c0 2023-11-27T17:53:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b8b160640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b841cfba0 con 0x7f1b840b2ce0 2023-11-27T17:53:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b88efc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b840b2220 0x7f1b84071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b88efc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b840b2220 0x7f1b84071a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51058/0 (socket says 172.21.15.31:51058) 2023-11-27T17:53:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b88efc640 1 -- 172.21.15.31:0/2096090181 learned_addr learned my addr 172.21.15.31:0/2096090181 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b896fd640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b840b30c0 0x7f1b841e4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b83fff640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b840b2ce0 0x7f1b841d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b88efc640 1 -- 172.21.15.31:0/2096090181 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b840b2ce0 msgr2=0x7f1b841d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b88efc640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b840b2ce0 0x7f1b841d2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b88efc640 1 -- 172.21.15.31:0/2096090181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b840b30c0 msgr2=0x7f1b841e4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b88efc640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b840b30c0 0x7f1b841e4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b88efc640 1 -- 172.21.15.31:0/2096090181 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b78009420 con 0x7f1b840b2220 2023-11-27T17:53:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b896fd640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b840b30c0 0x7f1b841e4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f1b88efc640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b840b2220 0x7f1b84071a60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400f930 tx=0x7f1b7400fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f5751878640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.81:6816/4034202684,v1:172.21.15.81:6817/4034202684] conn(0x7f573006ea10 0x7f5730070e30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.605+0000 7f5751077640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57300667f0 0x7f5730068cb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f574c0b5f40 tx=0x7f573c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.609+0000 7f9e40fa4640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.81:6808/691520267,v1:172.21.15.81:6809/691520267] conn(0x7f9e2806ea60 0x7f9e28070e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.609+0000 7f9e38ff9640 1 -- 172.21.15.31:0/2176754930 <== osd.5 v2:172.21.15.81:6808/691520267 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9e28071530 con 0x7f9e2806ea60 2023-11-27T17:53:28.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.613+0000 7f1b817fa640 1 -- 172.21.15.31:0/2096090181 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7400c070 con 0x7f1b840b2220 2023-11-27T17:53:28.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.613+0000 7f1b817fa640 1 -- 172.21.15.31:0/2096090181 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7400dd10 con 0x7f1b840b2220 2023-11-27T17:53:28.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.613+0000 7f1b817fa640 1 -- 172.21.15.31:0/2096090181 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74009620 con 0x7f1b840b2220 2023-11-27T17:53:28.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.613+0000 7f1b8b160640 1 -- 172.21.15.31:0/2096090181 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b841cfe40 con 0x7f1b840b2220 2023-11-27T17:53:28.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.613+0000 7f1b8b160640 1 -- 172.21.15.31:0/2096090181 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b841d0400 con 0x7f1b840b2220 2023-11-27T17:53:28.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.613+0000 7f5741ffb640 1 -- 172.21.15.31:0/3926464340 <== osd.4 v2:172.21.15.81:6816/4034202684 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f57300714e0 con 0x7f573006ea10 2023-11-27T17:53:28.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.613+0000 7f1b8b160640 1 -- 172.21.15.31:0/2096090181 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b64000fd0 con 0x7f1b840b2220 2023-11-27T17:53:28.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7f1b817fa640 1 -- 172.21.15.31:0/2096090181 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1b74012680 con 0x7f1b840b2220 2023-11-27T17:53:28.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7f1b817fa640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1b700668f0 0x7f1b70068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7f1b817fa640 1 -- 172.21.15.31:0/2096090181 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b74084620 con 0x7f1b840b2220 2023-11-27T17:53:28.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7f1b817fa640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:6802/2804285075,v1:172.21.15.31:6804/2804285075] conn(0x7f1b7006eb10 0x7f1b70070f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7f1b817fa640 1 -- 172.21.15.31:0/2096090181 --> [v2:172.21.15.31:6802/2804285075,v1:172.21.15.31:6804/2804285075] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b700715e0 con 0x7f1b7006eb10 2023-11-27T17:53:28.670 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7f1b817fa640 1 -- 172.21.15.31:0/2096090181 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b740849d0 con 0x7f1b840b2220 2023-11-27T17:53:28.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7f1b896fd640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:6802/2804285075,v1:172.21.15.31:6804/2804285075] conn(0x7f1b7006eb10 0x7f1b70070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7f1b83fff640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1b700668f0 0x7f1b70068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7f1b896fd640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:6802/2804285075,v1:172.21.15.31:6804/2804285075] conn(0x7f1b7006eb10 0x7f1b70070f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7fb4192dc640 1 -- 172.21.15.31:0/345193125 --> [v2:172.21.15.31:6816/2443446215,v1:172.21.15.31:6817/2443446215] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb3f4002cc0 con 0x7fb40006ea90 2023-11-27T17:53:28.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7f1b83fff640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1b700668f0 0x7f1b70068db0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1b840bda60 tx=0x7f1b7c009750 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7fb3fb7fe640 1 -- 172.21.15.31:0/345193125 <== osd.1 v2:172.21.15.31:6816/2443446215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb3f4002cc0 con 0x7fb40006ea90 2023-11-27T17:53:28.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7f1b817fa640 1 -- 172.21.15.31:0/2096090181 <== osd.2 v2:172.21.15.31:6802/2804285075 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1b700715e0 con 0x7f1b7006eb10 2023-11-27T17:53:28.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.617+0000 7fb3f97fa640 1 -- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:6816/2443446215,v1:172.21.15.31:6817/2443446215] conn(0x7fb40006ea90 msgr2=0x7fb400070eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fb3f97fa640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:6816/2443446215,v1:172.21.15.31:6817/2443446215] conn(0x7fb40006ea90 0x7fb400070eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fb3f97fa640 1 -- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb400066870 msgr2=0x7fb400068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fb3f97fa640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb400066870 0x7fb400068d30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4141420c0 tx=0x7fb408007d40 comp rx=0 tx=0).stop 2023-11-27T17:53:28.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fb3f97fa640 1 -- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4140729c0 msgr2=0x7fb414071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fb3f97fa640 1 --2- 172.21.15.31:0/345193125 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb4140729c0 0x7fb414071b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c790 tx=0x7fb40c00cc50 comp rx=0 tx=0).stop 2023-11-27T17:53:28.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fb4137fe640 1 -- 172.21.15.31:0/345193125 reap_dead start 2023-11-27T17:53:28.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fb3f97fa640 1 -- 172.21.15.31:0/345193125 shutdown_connections 2023-11-27T17:53:28.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fbf20084640 1 -- 172.21.15.31:0/1448521908 --> [v2:172.21.15.31:6824/1572841372,v1:172.21.15.31:6825/1572841372] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbf100cf3b0 con 0x7fbefc06e990 2023-11-27T17:53:28.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fb3f97fa640 1 -- 172.21.15.31:0/345193125 >> 172.21.15.31:0/345193125 conn(0x7fb4140b95a0 msgr2=0x7fb4140b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fb3f97fa640 1 -- 172.21.15.31:0/345193125 shutdown_connections 2023-11-27T17:53:28.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fb3f97fa640 1 -- 172.21.15.31:0/345193125 wait complete. 2023-11-27T17:53:28.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fbf0e7fc640 1 -- 172.21.15.31:0/1448521908 <== osd.3 v2:172.21.15.31:6824/1572841372 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbf100cf3b0 con 0x7fbefc06e990 2023-11-27T17:53:28.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fbf20084640 1 -- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:6824/1572841372,v1:172.21.15.31:6825/1572841372] conn(0x7fbefc06e990 msgr2=0x7fbefc070db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fbf20084640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:6824/1572841372,v1:172.21.15.31:6825/1572841372] conn(0x7fbefc06e990 0x7fbefc070db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fbf20084640 1 -- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbefc0667f0 msgr2=0x7fbefc068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fbf20084640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbefc0667f0 0x7fbefc068cb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbf18072ee0 tx=0x7fbf18069a00 comp rx=0 tx=0).stop 2023-11-27T17:53:28.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fbf20084640 1 -- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1003b0b0 msgr2=0x7fbf100cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fbf20084640 1 --2- 172.21.15.31:0/1448521908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbf1003b0b0 0x7fbf100cf6d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbf08018f60 tx=0x7fbf080190f0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fbf1e621640 1 -- 172.21.15.31:0/1448521908 reap_dead start 2023-11-27T17:53:28.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fbf20084640 1 -- 172.21.15.31:0/1448521908 shutdown_connections 2023-11-27T17:53:28.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7fbf20084640 1 -- 172.21.15.31:0/1448521908 >> 172.21.15.31:0/1448521908 conn(0x7fbf10005ec0 msgr2=0x7fbf1003e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.621+0000 7f35a8f61640 1 -- 172.21.15.31:0/1707509623 --> [v2:172.21.15.81:6824/1518266559,v1:172.21.15.81:6825/1518266559] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3588002cc0 con 0x7f358406e990 2023-11-27T17:53:28.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.625+0000 7f3592ffd640 1 -- 172.21.15.31:0/1707509623 <== osd.6 v2:172.21.15.81:6824/1518266559 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3588002cc0 con 0x7f358406e990 2023-11-27T17:53:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.625+0000 7f35a8f61640 1 -- 172.21.15.31:0/1707509623 >> [v2:172.21.15.81:6824/1518266559,v1:172.21.15.81:6825/1518266559] conn(0x7f358406e990 msgr2=0x7f3584070db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.625+0000 7f35a8f61640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.81:6824/1518266559,v1:172.21.15.81:6825/1518266559] conn(0x7f358406e990 0x7f3584070db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.625+0000 7f35a8f61640 1 -- 172.21.15.31:0/1707509623 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f35840667f0 msgr2=0x7f3584068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.625+0000 7f35a8f61640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f35840667f0 0x7f3584068cb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f35940ae000 tx=0x7f3594008040 comp rx=0 tx=0).stop 2023-11-27T17:53:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.625+0000 7f35a8f61640 1 -- 172.21.15.31:0/1707509623 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b61f0 msgr2=0x7f35a4157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.625+0000 7f35a8f61640 1 --2- 172.21.15.31:0/1707509623 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f35a40b61f0 0x7f35a4157120 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f359800c3c0 tx=0x7f359800c880 comp rx=0 tx=0).stop 2023-11-27T17:53:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.625+0000 7f35a2d9d640 1 -- 172.21.15.31:0/1707509623 reap_dead start 2023-11-27T17:53:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.625+0000 7f35a8f61640 1 -- 172.21.15.31:0/1707509623 shutdown_connections 2023-11-27T17:53:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.625+0000 7f35a8f61640 1 -- 172.21.15.31:0/1707509623 >> 172.21.15.31:0/1707509623 conn(0x7f35a40b95a0 msgr2=0x7f35a40bb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.625+0000 7f35a8f61640 1 -- 172.21.15.31:0/1707509623 shutdown_connections 2023-11-27T17:53:28.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.625+0000 7f35a8f61640 1 -- 172.21.15.31:0/1707509623 wait complete. 2023-11-27T17:53:28.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.633+0000 7fbf20084640 1 -- 172.21.15.31:0/1448521908 shutdown_connections 2023-11-27T17:53:28.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.633+0000 7fbf20084640 1 -- 172.21.15.31:0/1448521908 wait complete. 2023-11-27T17:53:28.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.633+0000 7fa4f2365640 1 -- 172.21.15.31:0/2639245019 --> [v2:172.21.15.31:6800/87696833,v1:172.21.15.31:6801/87696833] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa4ec074960 con 0x7fa4d806e9e0 2023-11-27T17:53:28.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.633+0000 7fa4e8ff9640 1 -- 172.21.15.31:0/2639245019 <== osd.0 v2:172.21.15.31:6800/87696833 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa4ec074960 con 0x7fa4d806e9e0 2023-11-27T17:53:28.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7f9e42a07640 1 -- 172.21.15.31:0/2176754930 --> [v2:172.21.15.81:6808/691520267,v1:172.21.15.81:6809/691520267] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9e1c002cf0 con 0x7f9e2806ea60 2023-11-27T17:53:28.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7f9e38ff9640 1 -- 172.21.15.31:0/2176754930 <== osd.5 v2:172.21.15.81:6808/691520267 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9e1c002cf0 con 0x7f9e2806ea60 2023-11-27T17:53:28.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7fa4f2365640 1 -- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:6800/87696833,v1:172.21.15.31:6801/87696833] conn(0x7fa4d806e9e0 msgr2=0x7fa4d8070e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7fa4f2365640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:6800/87696833,v1:172.21.15.31:6801/87696833] conn(0x7fa4d806e9e0 0x7fa4d8070e00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7fa4f2365640 1 -- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa4d8066840 msgr2=0x7fa4d8068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7fa4f2365640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa4d8066840 0x7fa4d8068d00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4007600 tx=0x7fa4e400b040 comp rx=0 tx=0).stop 2023-11-27T17:53:28.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7fa4f2365640 1 -- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2bc0 msgr2=0x7fa4ec148710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7f1b8b160640 1 -- 172.21.15.31:0/2096090181 --> [v2:172.21.15.31:6802/2804285075,v1:172.21.15.31:6804/2804285075] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b64002cf0 con 0x7f1b7006eb10 2023-11-27T17:53:28.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7fa4f2365640 1 --2- 172.21.15.31:0/2639245019 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4ec0b2bc0 0x7fa4ec148710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00c780 tx=0x7fa4dc00cc40 comp rx=0 tx=0).stop 2023-11-27T17:53:28.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7fa4f0902640 1 -- 172.21.15.31:0/2639245019 reap_dead start 2023-11-27T17:53:28.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7fa4f2365640 1 -- 172.21.15.31:0/2639245019 shutdown_connections 2023-11-27T17:53:28.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7fa4f2365640 1 -- 172.21.15.31:0/2639245019 >> 172.21.15.31:0/2639245019 conn(0x7fa4ec0b95a0 msgr2=0x7fa4ec14d110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7fa4f2365640 1 -- 172.21.15.31:0/2639245019 shutdown_connections 2023-11-27T17:53:28.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7fa4f2365640 1 -- 172.21.15.31:0/2639245019 wait complete. 2023-11-27T17:53:28.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7fc0fec5c640 1 -- 172.21.15.31:0/905128050 --> [v2:172.21.15.81:6800/1833955858,v1:172.21.15.81:6801/1833955858] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc0f80b2f50 con 0x7fc0e406e970 2023-11-27T17:53:28.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.637+0000 7f1b817fa640 1 -- 172.21.15.31:0/2096090181 <== osd.2 v2:172.21.15.31:6802/2804285075 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1b64002cf0 con 0x7f1b7006eb10 2023-11-27T17:53:28.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f1b6affd640 1 -- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:6802/2804285075,v1:172.21.15.31:6804/2804285075] conn(0x7f1b7006eb10 msgr2=0x7f1b70070f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f1b6affd640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:6802/2804285075,v1:172.21.15.31:6804/2804285075] conn(0x7f1b7006eb10 0x7f1b70070f30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f1b6affd640 1 -- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1b700668f0 msgr2=0x7f1b70068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f1b6affd640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1b700668f0 0x7f1b70068db0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1b840bda60 tx=0x7f1b7c009750 comp rx=0 tx=0).stop 2023-11-27T17:53:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7fc0f57fa640 1 -- 172.21.15.31:0/905128050 <== osd.7 v2:172.21.15.81:6800/1833955858 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc0f000a720 con 0x7fc0e406e970 2023-11-27T17:53:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f1b6affd640 1 -- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b840b2220 msgr2=0x7f1b84071a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f1b6affd640 1 --2- 172.21.15.31:0/2096090181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b840b2220 0x7f1b84071a60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400f930 tx=0x7f1b7400fdf0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f1b896fd640 1 -- 172.21.15.31:0/2096090181 reap_dead start 2023-11-27T17:53:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f1b6affd640 1 -- 172.21.15.31:0/2096090181 shutdown_connections 2023-11-27T17:53:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f1b6affd640 1 -- 172.21.15.31:0/2096090181 >> 172.21.15.31:0/2096090181 conn(0x7f1b8406a560 msgr2=0x7f1b840bd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f1b6affd640 1 -- 172.21.15.31:0/2096090181 shutdown_connections 2023-11-27T17:53:28.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f1b6affd640 1 -- 172.21.15.31:0/2096090181 wait complete. 2023-11-27T17:53:28.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f57532db640 1 -- 172.21.15.31:0/3926464340 --> [v2:172.21.15.81:6816/4034202684,v1:172.21.15.81:6817/4034202684] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f574c0b1ff0 con 0x7f573006ea10 2023-11-27T17:53:28.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f9e42a07640 1 -- 172.21.15.31:0/2176754930 >> [v2:172.21.15.81:6808/691520267,v1:172.21.15.81:6809/691520267] conn(0x7f9e2806ea60 msgr2=0x7f9e28070e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f9e42a07640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.81:6808/691520267,v1:172.21.15.81:6809/691520267] conn(0x7f9e2806ea60 0x7f9e28070e80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f9e42a07640 1 -- 172.21.15.31:0/2176754930 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9e28066840 msgr2=0x7f9e28068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f9e42a07640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9e28066840 0x7f9e28068d00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c006aa0 tx=0x7f9e2c006a30 comp rx=0 tx=0).stop 2023-11-27T17:53:28.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f9e42a07640 1 -- 172.21.15.31:0/2176754930 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e3c1e8880 msgr2=0x7f9e3c1e8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f9e42a07640 1 --2- 172.21.15.31:0/2176754930 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9e3c1e8880 0x7f9e3c1e8ce0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9e3001d330 tx=0x7f9e24005800 comp rx=0 tx=0).stop 2023-11-27T17:53:28.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f9e40fa4640 1 -- 172.21.15.31:0/2176754930 reap_dead start 2023-11-27T17:53:28.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f9e42a07640 1 -- 172.21.15.31:0/2176754930 shutdown_connections 2023-11-27T17:53:28.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f9e42a07640 1 -- 172.21.15.31:0/2176754930 >> 172.21.15.31:0/2176754930 conn(0x7f9e3c06a560 msgr2=0x7f9e3c149960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f9e42a07640 1 -- 172.21.15.31:0/2176754930 shutdown_connections 2023-11-27T17:53:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.641+0000 7f9e42a07640 1 -- 172.21.15.31:0/2176754930 wait complete. 2023-11-27T17:53:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.645+0000 7f5741ffb640 1 -- 172.21.15.31:0/3926464340 <== osd.4 v2:172.21.15.81:6816/4034202684 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f57440091f0 con 0x7f573006ea10 2023-11-27T17:53:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.645+0000 7f572f7fe640 1 -- 172.21.15.31:0/3926464340 >> [v2:172.21.15.81:6816/4034202684,v1:172.21.15.81:6817/4034202684] conn(0x7f573006ea10 msgr2=0x7f5730070e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.645+0000 7f572f7fe640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.81:6816/4034202684,v1:172.21.15.81:6817/4034202684] conn(0x7f573006ea10 0x7f5730070e30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.645+0000 7f572f7fe640 1 -- 172.21.15.31:0/3926464340 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57300667f0 msgr2=0x7f5730068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.645+0000 7f572f7fe640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57300667f0 0x7f5730068cb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f574c0b5f40 tx=0x7f573c009040 comp rx=0 tx=0).stop 2023-11-27T17:53:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.645+0000 7f572f7fe640 1 -- 172.21.15.31:0/3926464340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0b2c90 msgr2=0x7f574c1f1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.645+0000 7f572f7fe640 1 --2- 172.21.15.31:0/3926464340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0b2c90 0x7f574c1f1070 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f574800e9b0 tx=0x7f574800ee70 comp rx=0 tx=0).stop 2023-11-27T17:53:28.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.645+0000 7f5751878640 1 -- 172.21.15.31:0/3926464340 reap_dead start 2023-11-27T17:53:28.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.645+0000 7f572f7fe640 1 -- 172.21.15.31:0/3926464340 shutdown_connections 2023-11-27T17:53:28.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.645+0000 7f572f7fe640 1 -- 172.21.15.31:0/3926464340 >> 172.21.15.31:0/3926464340 conn(0x7f574c06a560 msgr2=0x7f574c0b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.645+0000 7f572f7fe640 1 -- 172.21.15.31:0/3926464340 shutdown_connections 2023-11-27T17:53:28.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.645+0000 7f572f7fe640 1 -- 172.21.15.31:0/3926464340 wait complete. 2023-11-27T17:53:28.691 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2023-11-27T17:53:28.692 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T17:53:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.649+0000 7fc0deffd640 1 -- 172.21.15.31:0/905128050 >> [v2:172.21.15.81:6800/1833955858,v1:172.21.15.81:6801/1833955858] conn(0x7fc0e406e970 msgr2=0x7fc0e4070d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.649+0000 7fc0deffd640 1 --2- 172.21.15.31:0/905128050 >> [v2:172.21.15.81:6800/1833955858,v1:172.21.15.81:6801/1833955858] conn(0x7fc0e406e970 0x7fc0e4070d90 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.649+0000 7fc0deffd640 1 -- 172.21.15.31:0/905128050 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fc0e40668c0 msgr2=0x7fc0e4068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.649+0000 7fc0deffd640 1 --2- 172.21.15.31:0/905128050 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fc0e40668c0 0x7fc0e4068d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0b3000 tx=0x7fc0ec004740 comp rx=0 tx=0).stop 2023-11-27T17:53:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.649+0000 7fc0deffd640 1 -- 172.21.15.31:0/905128050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80a1ec0 msgr2=0x7fc0f80b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.649+0000 7fc0deffd640 1 --2- 172.21.15.31:0/905128050 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc0f80a1ec0 0x7fc0f80b5c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800b550 tx=0x7fc0e800ba10 comp rx=0 tx=0).stop 2023-11-27T17:53:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.649+0000 7fc0fd1f9640 1 -- 172.21.15.31:0/905128050 reap_dead start 2023-11-27T17:53:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.649+0000 7fc0deffd640 1 -- 172.21.15.31:0/905128050 shutdown_connections 2023-11-27T17:53:28.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.649+0000 7fc0deffd640 1 -- 172.21.15.31:0/905128050 >> 172.21.15.31:0/905128050 conn(0x7fc0f80b95a0 msgr2=0x7fc0f81591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.694 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2023-11-27T17:53:28.695 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T17:53:28.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.649+0000 7fc0deffd640 1 -- 172.21.15.31:0/905128050 shutdown_connections 2023-11-27T17:53:28.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.649+0000 7fc0deffd640 1 -- 172.21.15.31:0/905128050 wait complete. 2023-11-27T17:53:28.696 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-11-27T17:53:28.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T17:53:28.697 INFO:teuthology.orchestra.run.smithi031.stdout:55834574857 2023-11-27T17:53:28.697 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T17:53:28.698 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-11-27T17:53:28.698 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T17:53:28.699 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-11-27T17:53:28.699 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T17:53:28.700 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2023-11-27T17:53:28.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T17:53:28.701 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-11-27T17:53:28.701 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T17:53:28.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.901+0000 7f4c0196d640 1 Processor -- start 2023-11-27T17:53:28.905 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.901+0000 7f4c0196d640 1 -- start start 2023-11-27T17:53:28.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.901+0000 7f4c0196d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4bfc0a2160 0x7f4bfc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.901+0000 7f4c0196d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bfc0a2620 con 0x7f4bfc14c950 2023-11-27T17:53:28.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.901+0000 7f4c0196d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bfc0b42d0 con 0x7f4bfc0b4d10 2023-11-27T17:53:28.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.901+0000 7f4c0196d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bfc0b5df0 con 0x7f4bfc0a2160 2023-11-27T17:53:28.906 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.901+0000 7f4bfaffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4bfc14c950 0x7f4bfc0a1a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46092/0 (socket says 172.21.15.31:46092) 2023-11-27T17:53:28.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.901+0000 7f4bfaffd640 1 -- 172.21.15.31:0/2345723980 learned_addr learned my addr 172.21.15.31:0/2345723980 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:28.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.901+0000 7f4bfa7fc640 1 --2- 172.21.15.31:0/2345723980 >> v2:172.21.15.31:3300/0 conn(0x7f4bfc0a2160 0x7f4bfc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.905+0000 7f4bfa7fc640 1 -- 172.21.15.31:0/2345723980 >> v1:172.21.15.81:6789/0 conn(0x7f4bfc0b4d10 legacy=0x7f4bfc153a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:53:28.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.905+0000 7f4bfa7fc640 1 -- 172.21.15.31:0/2345723980 >> v1:172.21.15.31:6789/0 conn(0x7f4bfc14c950 legacy=0x7f4bfc0a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.905+0000 7f4bfa7fc640 1 -- 172.21.15.31:0/2345723980 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc0b6bc0 con 0x7f4bfc0a2160 2023-11-27T17:53:28.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.905+0000 7f4bfa7fc640 1 --2- 172.21.15.31:0/2345723980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bfc0a2160 0x7f4bfc0b47d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0097c0 tx=0x7f4bec01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a121626ca906ab55 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.905+0000 7f4bf9ffb640 1 -- 172.21.15.31:0/2345723980 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0ab600 con 0x7f4bfc0a2160 2023-11-27T17:53:28.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.905+0000 7f4bf9ffb640 1 -- 172.21.15.31:0/2345723980 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec0a7050 con 0x7f4bfc0a2160 2023-11-27T17:53:28.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f4c0196d640 1 -- 172.21.15.31:0/2345723980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bfc0a2160 msgr2=0x7f4bfc0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f4c0196d640 1 --2- 172.21.15.31:0/2345723980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bfc0a2160 0x7f4bfc0b47d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4bec0097c0 tx=0x7f4bec01c360 comp rx=0 tx=0).stop 2023-11-27T17:53:28.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f4c0196d640 1 -- 172.21.15.31:0/2345723980 shutdown_connections 2023-11-27T17:53:28.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f4c0196d640 1 --2- 172.21.15.31:0/2345723980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bfc0a2160 0x7f4bfc0b47d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.912 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f4c0196d640 1 -- 172.21.15.31:0/2345723980 >> 172.21.15.31:0/2345723980 conn(0x7f4bfc0b95a0 msgr2=0x7f4bfc0b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f4c0196d640 1 -- 172.21.15.31:0/2345723980 shutdown_connections 2023-11-27T17:53:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f4c0196d640 1 -- 172.21.15.31:0/2345723980 wait complete. 2023-11-27T17:53:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fdfaf59e640 1 Processor -- start 2023-11-27T17:53:28.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fdfaf59e640 1 -- start start 2023-11-27T17:53:28.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fd8add9f640 1 Processor -- start 2023-11-27T17:53:28.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f7193668640 1 Processor -- start 2023-11-27T17:53:28.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f7193668640 1 -- start start 2023-11-27T17:53:28.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fd8add9f640 1 -- start start 2023-11-27T17:53:28.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fdfaf59e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdfa8007130 0x7fdfa803a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f5cfdabb640 1 Processor -- start 2023-11-27T17:53:28.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fdfaf59e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdfa803e6b0 0x7fdfa803ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f4c0196d640 1 Processor -- start 2023-11-27T17:53:28.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f5cfdabb640 1 -- start start 2023-11-27T17:53:28.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fdfaf59e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa8039b90 con 0x7fdfa803b0b0 2023-11-27T17:53:28.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fd8add9f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8a8147890 0x7fd8a8071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fd8add9f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a80b4490 con 0x7fd8a80b9630 2023-11-27T17:53:28.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fd8add9f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a806f1d0 con 0x7fd8a80722f0 2023-11-27T17:53:28.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fd8add9f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a80b7010 con 0x7fd8a8147890 2023-11-27T17:53:28.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fdfae59c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdfa8007130 0x7fdfa803a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fdfae59c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdfa8007130 0x7fdfa803a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:38662/0 (socket says 172.21.15.31:38662) 2023-11-27T17:53:28.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fdfae59c640 1 -- 172.21.15.31:0/3704507479 learned_addr learned my addr 172.21.15.31:0/3704507479 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fdfadd9b640 1 --2- 172.21.15.31:0/3704507479 >> v2:172.21.15.81:3300/0 conn(0x7fdfa803e6b0 0x7fdfa803ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f7193668640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f718403bca0 0x7f718403cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fd8a7fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd8a80722f0 0x7fd8a80b4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.31:48078/0 (socket says 172.21.15.31:48078) 2023-11-27T17:53:28.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fd8a7fff640 1 -- 172.21.15.31:0/2025521852 learned_addr learned my addr 172.21.15.31:0/2025521852 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:28.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f4c0196d640 1 -- start start 2023-11-27T17:53:28.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fdfaf59e640 1 -- 172.21.15.31:0/3704507479 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa803b4f0 con 0x7fdfa803e6b0 2023-11-27T17:53:28.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f7193668640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f71840c8990 0x7f71840c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f33cd775640 1 Processor -- start 2023-11-27T17:53:28.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7fdfaf59e640 1 -- 172.21.15.31:0/3704507479 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa803eb40 con 0x7fdfa8007130 2023-11-27T17:53:28.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f33cd775640 1 -- start start 2023-11-27T17:53:28.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fdfad59a640 1 -- 172.21.15.31:0/3704507479 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020359817 0 0) 0x7fdfa8039b90 con 0x7fdfa803b0b0 2023-11-27T17:53:28.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fdfad59a640 1 -- 172.21.15.31:0/3704507479 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf98003530 con 0x7fdfa803b0b0 2023-11-27T17:53:28.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527393705 0 0) 0x7fd8a806f1d0 con 0x7fd8a80722f0 2023-11-27T17:53:28.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd890003530 con 0x7fd8a80722f0 2023-11-27T17:53:28.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a6ffd640 1 --2- 172.21.15.31:0/2025521852 >> v2:172.21.15.31:3300/0 conn(0x7fd8a8147890 0x7fd8a8071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 113300613 0 0) 0x7fd8a80b4490 con 0x7fd8a80b9630 2023-11-27T17:53:28.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a806f1d0 con 0x7fd8a80b9630 2023-11-27T17:53:28.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4c0196d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4bfc0a2160 0x7f4bfc1478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4c0196d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bfc0b4d10 0x7f4bfc145e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4c0196d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc14c950 0x7f4bfc146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4c0196d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1498c0 con 0x7f4bfc0b4d10 2023-11-27T17:53:28.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4c0196d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc147e20 con 0x7f4bfc14c950 2023-11-27T17:53:28.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4c0196d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1480f0 con 0x7f4bfc0a2160 2023-11-27T17:53:28.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bfaffd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4bfc0a2160 0x7f4bfc1478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bfaffd640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4bfc0a2160 0x7f4bfc1478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:38674/0 (socket says 172.21.15.31:38674) 2023-11-27T17:53:28.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bfaffd640 1 -- 172.21.15.31:0/2956778195 learned_addr learned my addr 172.21.15.31:0/2956778195 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.909+0000 7f5cfdabb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf80704b0 0x7f5cf80b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfdabb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5cf8142420 0x7f5cf814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfdabb640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf8071780 con 0x7f5cf80b49d0 2023-11-27T17:53:28.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfdabb640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf8070d40 con 0x7f5cf8142420 2023-11-27T17:53:28.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfdabb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80725b0 con 0x7f5cf80704b0 2023-11-27T17:53:28.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cf7fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5cf80b49d0 0x7f5cf8141d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46118/0 (socket says 172.21.15.31:46118) 2023-11-27T17:53:28.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfcab9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf80704b0 0x7f5cf80b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfcab9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf80704b0 0x7f5cf80b9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:38690/0 (socket says 172.21.15.31:38690) 2023-11-27T17:53:28.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfcab9640 1 -- 172.21.15.31:0/4001545058 learned_addr learned my addr 172.21.15.31:0/4001545058 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f7190c03640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f71840cece0 0x7f7184040870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.31:48096/0 (socket says 172.21.15.31:48096) 2023-11-27T17:53:28.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f7190c03640 1 -- 172.21.15.31:0/3592671359 learned_addr learned my addr 172.21.15.31:0/3592671359 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:28.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f7191404640 1 --2- 172.21.15.31:0/3592671359 >> v2:172.21.15.31:3300/0 conn(0x7f718403bca0 0x7f718403cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f7191c05640 1 --2- 172.21.15.31:0/3592671359 >> v2:172.21.15.81:3300/0 conn(0x7f71840c8990 0x7f71840c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f7193668640 1 -- 172.21.15.31:0/3592671359 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7184040140 con 0x7f71840cece0 2023-11-27T17:53:28.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f7193668640 1 -- 172.21.15.31:0/3592671359 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718403d720 con 0x7f718403bca0 2023-11-27T17:53:28.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f7193668640 1 -- 172.21.15.31:0/3592671359 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71840063a0 con 0x7f71840c8990 2023-11-27T17:53:28.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f9af8dac640 1 Processor -- start 2023-11-27T17:53:28.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f9af8dac640 1 -- start start 2023-11-27T17:53:28.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfd2ba640 1 --2- 172.21.15.31:0/4001545058 >> v2:172.21.15.31:3300/0 conn(0x7f5cf8142420 0x7f5cf814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fdfae59c640 1 -- 172.21.15.31:0/3704507479 >> v2:172.21.15.81:3300/0 conn(0x7fdfa803e6b0 msgr2=0x7fdfa803ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fdfae59c640 1 --2- 172.21.15.31:0/3704507479 >> v2:172.21.15.81:3300/0 conn(0x7fdfa803e6b0 0x7fdfa803ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fdfae59c640 1 -- 172.21.15.31:0/3704507479 >> v1:172.21.15.81:6789/0 conn(0x7fdfa803b0b0 legacy=0x7fdfa803cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fdfae59c640 1 -- 172.21.15.31:0/3704507479 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8039820 con 0x7fdfa8007130 2023-11-27T17:53:28.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 944727964 0 0) 0x7fd8a806f1d0 con 0x7fd8a80b9630 2023-11-27T17:53:28.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 >> v2:172.21.15.31:3300/0 conn(0x7fd8a8147890 msgr2=0x7fd8a8071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 --2- 172.21.15.31:0/2025521852 >> v2:172.21.15.31:3300/0 conn(0x7fd8a8147890 0x7fd8a8071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 >> v1:172.21.15.81:6789/0 conn(0x7fd8a80722f0 legacy=0x7fd8a80b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a81482f0 con 0x7fd8a80b9630 2023-11-27T17:53:28.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7fd89c001680 con 0x7fd8a80b9630 2023-11-27T17:53:28.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 >> v1:172.21.15.31:6789/0 conn(0x7fd8a80b9630 legacy=0x7fd8a80b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 --2- 172.21.15.31:0/2025521852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd890003bd0 0x7fd890003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 --2- 172.21.15.31:0/2025521852 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8900047d0 0x7fd890004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 --2- 172.21.15.31:0/2025521852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8900052b0 0x7fd89000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80b7010 con 0x7fd8900052b0 2023-11-27T17:53:28.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89000c0e0 con 0x7fd890003bd0 2023-11-27T17:53:28.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89000c2a0 con 0x7fd8900047d0 2023-11-27T17:53:28.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a6ffd640 1 --2- 172.21.15.31:0/2025521852 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8900047d0 0x7fd890004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a77fe640 1 --2- 172.21.15.31:0/2025521852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd890003bd0 0x7fd890003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bfa7fc640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bfc0b4d10 0x7f4bfc145e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bfaffd640 1 -- 172.21.15.31:0/2956778195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc14c950 msgr2=0x7f4bfc146380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-27T17:53:28.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bfaffd640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc14c950 0x7f4bfc146380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bfaffd640 1 -- 172.21.15.31:0/2956778195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bfc0b4d10 msgr2=0x7f4bfc145e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bfaffd640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bfc0b4d10 0x7f4bfc145e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bfaffd640 1 -- 172.21.15.31:0/2956778195 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec009420 con 0x7f4bfc0a2160 2023-11-27T17:53:28.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bfa7fc640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bfc0b4d10 0x7f4bfc145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:28.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f33cd775640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33c806db00 0x7f33c8147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f33cd775640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c80b25c0 con 0x7f33c81418c0 2023-11-27T17:53:28.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f33cd775640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c80b31d0 con 0x7f33c8072330 2023-11-27T17:53:28.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f33cd775640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c80b3790 con 0x7f33c806db00 2023-11-27T17:53:28.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f33c77fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f33c8072330 0x7f33c8151e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.31:48100/0 (socket says 172.21.15.31:48100) 2023-11-27T17:53:28.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f33c77fe640 1 -- 172.21.15.31:0/2419475137 learned_addr learned my addr 172.21.15.31:0/2419475137 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:28.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bfaffd640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4bfc0a2160 0x7f4bfc1478e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400e780 tx=0x7f4bf400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bebfff640 1 -- 172.21.15.31:0/2956778195 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf400f930 con 0x7f4bfc0a2160 2023-11-27T17:53:28.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f33c5ffb640 1 -- 172.21.15.31:0/2419475137 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670894809 0 0) 0x7f33c80b31d0 con 0x7f33c8072330 2023-11-27T17:53:28.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f33c5ffb640 1 -- 172.21.15.31:0/2419475137 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33b0003530 con 0x7f33c8072330 2023-11-27T17:53:28.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfcab9640 1 -- 172.21.15.31:0/4001545058 >> v2:172.21.15.31:3300/0 conn(0x7f5cf8142420 msgr2=0x7f5cf814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfcab9640 1 --2- 172.21.15.31:0/4001545058 >> v2:172.21.15.31:3300/0 conn(0x7f5cf8142420 0x7f5cf814b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfcab9640 1 -- 172.21.15.31:0/4001545058 >> v1:172.21.15.31:6789/0 conn(0x7f5cf80b49d0 legacy=0x7f5cf8141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfcab9640 1 -- 172.21.15.31:0/4001545058 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8071a60 con 0x7f5cf80704b0 2023-11-27T17:53:28.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f9af8dac640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9af40b7bb0 0x7f9af40b6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfae59c640 1 --2- 172.21.15.31:0/3704507479 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdfa8007130 0x7fdfa803a590 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009870 tx=0x7fdfa001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae3e0edd9f8e6472 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a77fe640 1 -- 172.21.15.31:0/2025521852 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8900047d0 msgr2=0x7fd890004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a77fe640 1 --2- 172.21.15.31:0/2025521852 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8900047d0 0x7fd890004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a77fe640 1 -- 172.21.15.31:0/2025521852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8900052b0 msgr2=0x7fd89000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a77fe640 1 --2- 172.21.15.31:0/2025521852 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8900052b0 0x7fd89000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7fd8a77fe640 1 -- 172.21.15.31:0/2025521852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a806f1d0 con 0x7fd890003bd0 2023-11-27T17:53:28.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fd8a7fff640 1 -- 172.21.15.31:0/2025521852 reap_dead start 2023-11-27T17:53:28.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4c0196d640 1 -- 172.21.15.31:0/2956778195 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bfc149ad0 con 0x7f4bfc0a2160 2023-11-27T17:53:28.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4c0196d640 1 -- 172.21.15.31:0/2956778195 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc1494a0 con 0x7f4bfc0a2160 2023-11-27T17:53:28.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bebfff640 1 -- 172.21.15.31:0/2956778195 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf400fa90 con 0x7f4bfc0a2160 2023-11-27T17:53:28.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f4bebfff640 1 -- 172.21.15.31:0/2956778195 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf400fe00 con 0x7f4bfc0a2160 2023-11-27T17:53:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f33c67fc640 1 --2- 172.21.15.31:0/2419475137 >> v2:172.21.15.31:3300/0 conn(0x7f33c806db00 0x7f33c8147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f33c67fc640 1 -- 172.21.15.31:0/2419475137 >> v1:172.21.15.81:6789/0 conn(0x7f33c8072330 legacy=0x7f33c8151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f33c67fc640 1 -- 172.21.15.31:0/2419475137 >> v1:172.21.15.31:6789/0 conn(0x7f33c81418c0 legacy=0x7f33c80b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f33c67fc640 1 -- 172.21.15.31:0/2419475137 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c80b34b0 con 0x7f33c806db00 2023-11-27T17:53:28.940 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f5cfcab9640 1 --2- 172.21.15.31:0/4001545058 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf80704b0 0x7f5cf80b9fb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009870 tx=0x7f5cec01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=217fb6a50961e05b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cf77fe640 1 -- 172.21.15.31:0/4001545058 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0a8a30 con 0x7f5cf80704b0 2023-11-27T17:53:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cf77fe640 1 -- 172.21.15.31:0/4001545058 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cec0a8b90 con 0x7f5cf80704b0 2023-11-27T17:53:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cf77fe640 1 -- 172.21.15.31:0/4001545058 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec0b0440 con 0x7f5cf80704b0 2023-11-27T17:53:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f7191404640 1 -- 172.21.15.31:0/3592671359 >> v2:172.21.15.81:3300/0 conn(0x7f71840c8990 msgr2=0x7f71840c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f7191404640 1 --2- 172.21.15.31:0/3592671359 >> v2:172.21.15.81:3300/0 conn(0x7f71840c8990 0x7f71840c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f7191404640 1 -- 172.21.15.31:0/3592671359 >> v1:172.21.15.81:6789/0 conn(0x7f71840cece0 legacy=0x7f7184040870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f7191404640 1 -- 172.21.15.31:0/3592671359 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71840cf120 con 0x7f718403bca0 2023-11-27T17:53:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f7191404640 1 --2- 172.21.15.31:0/3592671359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f718403bca0 0x7f718403cc20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f71840d3350 tx=0x7f718801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea162e67045fefb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f9af8dac640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af40b9060 con 0x7f9af40729c0 2023-11-27T17:53:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f9af8dac640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af40b9300 con 0x7f9af40b2bc0 2023-11-27T17:53:28.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f9af8dac640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af40b1e80 con 0x7f9af40b7bb0 2023-11-27T17:53:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f9af259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9af40b2bc0 0x7f9af40b74a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.31:48106/0 (socket says 172.21.15.31:48106) 2023-11-27T17:53:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f9af259c640 1 -- 172.21.15.31:0/1871655086 learned_addr learned my addr 172.21.15.31:0/1871655086 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:28.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.913+0000 7f9af2d9d640 1 --2- 172.21.15.31:0/1871655086 >> v2:172.21.15.81:3300/0 conn(0x7f9af40b7bb0 0x7f9af40b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f9af2d9d640 1 -- 172.21.15.31:0/1871655086 >> v1:172.21.15.81:6789/0 conn(0x7f9af40b2bc0 legacy=0x7f9af40b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f7183fff640 1 -- 172.21.15.31:0/3592671359 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880ab5f0 con 0x7f718403bca0 2023-11-27T17:53:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f7183fff640 1 -- 172.21.15.31:0/3592671359 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71880ab750 con 0x7f718403bca0 2023-11-27T17:53:28.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f7183fff640 1 -- 172.21.15.31:0/3592671359 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880abb20 con 0x7f718403bca0 2023-11-27T17:53:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cfdabb640 1 -- 172.21.15.31:0/4001545058 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf80704b0 msgr2=0x7f5cf80b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cfdabb640 1 --2- 172.21.15.31:0/4001545058 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf80704b0 0x7f5cf80b9fb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009870 tx=0x7f5cec01ed50 comp rx=0 tx=0).stop 2023-11-27T17:53:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfad59a640 1 -- 172.21.15.31:0/3704507479 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00a8a30 con 0x7fdfa8007130 2023-11-27T17:53:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfad59a640 1 -- 172.21.15.31:0/3704507479 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa00a8b90 con 0x7fdfa8007130 2023-11-27T17:53:28.946 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfad59a640 1 -- 172.21.15.31:0/3704507479 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00b0440 con 0x7fdfa8007130 2023-11-27T17:53:28.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cfdabb640 1 -- 172.21.15.31:0/4001545058 shutdown_connections 2023-11-27T17:53:28.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cfdabb640 1 --2- 172.21.15.31:0/4001545058 >> v2:172.21.15.31:3300/0 conn(0x7f5cf8142420 0x7f5cf814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cfdabb640 1 --2- 172.21.15.31:0/4001545058 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf80704b0 0x7f5cf80b9fb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cfdabb640 1 -- 172.21.15.31:0/4001545058 >> 172.21.15.31:0/4001545058 conn(0x7f5cf80bdab0 msgr2=0x7f5cf80bde90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cfdabb640 1 -- 172.21.15.31:0/4001545058 shutdown_connections 2023-11-27T17:53:28.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfaf59e640 1 -- 172.21.15.31:0/3704507479 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdfa8007130 msgr2=0x7fdfa803a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfaf59e640 1 --2- 172.21.15.31:0/3704507479 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdfa8007130 0x7fdfa803a590 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009870 tx=0x7fdfa001ed50 comp rx=0 tx=0).stop 2023-11-27T17:53:28.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfaf59e640 1 -- 172.21.15.31:0/3704507479 shutdown_connections 2023-11-27T17:53:28.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfaf59e640 1 --2- 172.21.15.31:0/3704507479 >> v2:172.21.15.81:3300/0 conn(0x7fdfa803e6b0 0x7fdfa803ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfaf59e640 1 --2- 172.21.15.31:0/3704507479 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdfa8007130 0x7fdfa803a590 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfaf59e640 1 -- 172.21.15.31:0/3704507479 >> 172.21.15.31:0/3704507479 conn(0x7fdfa803ee00 msgr2=0x7fdfa803f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfaf59e640 1 -- 172.21.15.31:0/3704507479 shutdown_connections 2023-11-27T17:53:28.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f4bebfff640 1 -- 172.21.15.31:0/2956778195 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f4bf4015070 con 0x7f4bfc0a2160 2023-11-27T17:53:28.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f4bebfff640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f4be00667f0 0x7f4be0068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f4bebfff640 1 -- 172.21.15.31:0/2956778195 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bf4086dd0 con 0x7f4bfc0a2160 2023-11-27T17:53:28.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f4bfa7fc640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f4be00667f0 0x7f4be0068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f4c0196d640 1 -- 172.21.15.31:0/2956778195 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd8005260 con 0x7f4bfc0a2160 2023-11-27T17:53:28.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f33c67fc640 1 --2- 172.21.15.31:0/2419475137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c806db00 0x7f33c8147cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009740 tx=0x7f33bc01c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46ffad755bd3d02 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cfdabb640 1 -- 172.21.15.31:0/4001545058 wait complete. 2023-11-27T17:53:28.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cfdabb640 1 Processor -- start 2023-11-27T17:53:28.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f7193668640 1 -- 172.21.15.31:0/3592671359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f718403bca0 msgr2=0x7f718403cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f7193668640 1 --2- 172.21.15.31:0/3592671359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f718403bca0 0x7f718403cc20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f71840d3350 tx=0x7f718801c410 comp rx=0 tx=0).stop 2023-11-27T17:53:28.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f9af2d9d640 1 -- 172.21.15.31:0/1871655086 >> v1:172.21.15.31:6789/0 conn(0x7f9af40729c0 legacy=0x7f9af40b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f9af2d9d640 1 -- 172.21.15.31:0/1871655086 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40b1aa0 con 0x7f9af40b7bb0 2023-11-27T17:53:28.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfaf59e640 1 -- 172.21.15.31:0/3704507479 wait complete. 2023-11-27T17:53:28.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfaf59e640 1 Processor -- start 2023-11-27T17:53:28.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f5cfdabb640 1 -- start start 2023-11-27T17:53:28.952 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f33c5ffb640 1 -- 172.21.15.31:0/2419475137 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0001a00 con 0x7f33c806db00 2023-11-27T17:53:28.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7f33c5ffb640 1 -- 172.21.15.31:0/2419475137 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc0a7050 con 0x7f33c806db00 2023-11-27T17:53:28.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f33c5ffb640 1 -- 172.21.15.31:0/2419475137 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0ab620 con 0x7f33c806db00 2023-11-27T17:53:28.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 -- 172.21.15.31:0/3592671359 shutdown_connections 2023-11-27T17:53:28.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 --2- 172.21.15.31:0/3592671359 >> v2:172.21.15.81:3300/0 conn(0x7f71840c8990 0x7f71840c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f4bfa7fc640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f4be00667f0 0x7f4be0068cb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc06c150 tx=0x7f4bec0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 --2- 172.21.15.31:0/3592671359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f718403bca0 0x7f718403cc20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 -- 172.21.15.31:0/3592671359 >> 172.21.15.31:0/3592671359 conn(0x7f7184044620 msgr2=0x7f7184044a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 -- 172.21.15.31:0/3592671359 shutdown_connections 2023-11-27T17:53:28.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 -- 172.21.15.31:0/3592671359 wait complete. 2023-11-27T17:53:28.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfdabb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf80704b0 0x7f5cf8142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfdabb640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf80b49d0 0x7f5cf81433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfdabb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cf8142420 0x7f5cf81e8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfdabb640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8143000 con 0x7f5cf8142420 2023-11-27T17:53:28.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfdabb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8137c90 con 0x7f5cf80704b0 2023-11-27T17:53:28.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfdabb640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8137f70 con 0x7f5cf80b49d0 2023-11-27T17:53:28.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.917+0000 7fdfaf59e640 1 -- start start 2023-11-27T17:53:28.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaf59e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdfa8007130 0x7fdfa80d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaf59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa803b0b0 0x7fdfa816eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaf59e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfa816efe0 0x7fdfa816aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaf59e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa80d14c0 con 0x7fdfa816efe0 2023-11-27T17:53:28.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaf59e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa8035440 con 0x7fdfa803b0b0 2023-11-27T17:53:28.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaf59e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa80343a0 con 0x7fdfa8007130 2023-11-27T17:53:28.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfa816efe0 0x7fdfa816aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfa816efe0 0x7fdfa816aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51146/0 (socket says 172.21.15.31:51146) 2023-11-27T17:53:28.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaed9d640 1 -- 172.21.15.31:0/475203776 learned_addr learned my addr 172.21.15.31:0/475203776 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f9af2d9d640 1 --2- 172.21.15.31:0/1871655086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b7bb0 0x7f9af40b6900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009ac0 tx=0x7f9aec01db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e471929826dd2cb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fd8a77fe640 1 --2- 172.21.15.31:0/2025521852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd890003bd0 0x7fd890003fd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd89c007e70 tx=0x7fd89c01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94601fb394046820 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f33cd775640 1 -- 172.21.15.31:0/2419475137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c806db00 msgr2=0x7f33c8147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f33cd775640 1 --2- 172.21.15.31:0/2419475137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c806db00 0x7f33c8147cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009740 tx=0x7f33bc01c1d0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfadd9b640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa803b0b0 0x7fdfa816eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f33cd775640 1 -- 172.21.15.31:0/2419475137 shutdown_connections 2023-11-27T17:53:28.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f33cd775640 1 --2- 172.21.15.31:0/2419475137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c806db00 0x7f33c8147cf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f33cd775640 1 -- 172.21.15.31:0/2419475137 >> 172.21.15.31:0/2419475137 conn(0x7f33c80bad90 msgr2=0x7f33c80bb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfd2ba640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cf8142420 0x7f5cf81e8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfd2ba640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cf8142420 0x7f5cf81e8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51132/0 (socket says 172.21.15.31:51132) 2023-11-27T17:53:28.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfd2ba640 1 -- 172.21.15.31:0/1717792593 learned_addr learned my addr 172.21.15.31:0/1717792593 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cf7fff640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf80b49d0 0x7f5cf81433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfae59c640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdfa8007130 0x7fdfa80d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfcab9640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf80704b0 0x7f5cf8142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f33cd775640 1 -- 172.21.15.31:0/2419475137 shutdown_connections 2023-11-27T17:53:28.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 Processor -- start 2023-11-27T17:53:28.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f33cd775640 1 -- 172.21.15.31:0/2419475137 wait complete. 2023-11-27T17:53:28.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f9af159a640 1 -- 172.21.15.31:0/1871655086 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0a6a30 con 0x7f9af40b7bb0 2023-11-27T17:53:28.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f9af159a640 1 -- 172.21.15.31:0/1871655086 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec0a6b90 con 0x7f9af40b7bb0 2023-11-27T17:53:28.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f9af159a640 1 -- 172.21.15.31:0/1871655086 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0ae440 con 0x7f9af40b7bb0 2023-11-27T17:53:28.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 -- start start 2023-11-27T17:53:28.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfd2ba640 1 -- 172.21.15.31:0/1717792593 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf80b49d0 msgr2=0x7f5cf81433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfd2ba640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf80b49d0 0x7f5cf81433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfd2ba640 1 -- 172.21.15.31:0/1717792593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf80704b0 msgr2=0x7f5cf8142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfd2ba640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf80704b0 0x7f5cf8142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfd2ba640 1 -- 172.21.15.31:0/1717792593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec0094d0 con 0x7f5cf8142420 2023-11-27T17:53:28.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaed9d640 1 -- 172.21.15.31:0/475203776 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdfa8007130 msgr2=0x7fdfa80d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaed9d640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdfa8007130 0x7fdfa80d0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaed9d640 1 -- 172.21.15.31:0/475203776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa803b0b0 msgr2=0x7fdfa816eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaed9d640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa803b0b0 0x7fdfa816eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaed9d640 1 -- 172.21.15.31:0/475203776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa00094d0 con 0x7fdfa816efe0 2023-11-27T17:53:28.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfd2ba640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cf8142420 0x7f5cf81e8bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009fd0 tx=0x7f5cf000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f718403bca0 0x7f71840c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840c8990 0x7f718416e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71840cece0 0x7f71840c6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71840c7320 con 0x7f71840cece0 2023-11-27T17:53:28.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71840cc1e0 con 0x7f71840c8990 2023-11-27T17:53:28.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7193668640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71840bc350 con 0x7f718403bca0 2023-11-27T17:53:28.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f9af8dac640 1 -- 172.21.15.31:0/1871655086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b7bb0 msgr2=0x7f9af40b6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f9af8dac640 1 --2- 172.21.15.31:0/1871655086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b7bb0 0x7f9af40b6900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9aec009ac0 tx=0x7f9aec01db10 comp rx=0 tx=0).stop 2023-11-27T17:53:28.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cf57fa640 1 -- 172.21.15.31:0/1717792593 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0014420 con 0x7f5cf8142420 2023-11-27T17:53:28.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfdabb640 1 -- 172.21.15.31:0/1717792593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf8145460 con 0x7f5cf8142420 2023-11-27T17:53:28.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfdabb640 1 -- 172.21.15.31:0/1717792593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf8145110 con 0x7f5cf8142420 2023-11-27T17:53:28.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f9af8dac640 1 -- 172.21.15.31:0/1871655086 shutdown_connections 2023-11-27T17:53:28.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f9af8dac640 1 --2- 172.21.15.31:0/1871655086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b7bb0 0x7f9af40b6900 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f9af8dac640 1 -- 172.21.15.31:0/1871655086 >> 172.21.15.31:0/1871655086 conn(0x7f9af40b95a0 msgr2=0x7f9af40b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f9af8dac640 1 -- 172.21.15.31:0/1871655086 shutdown_connections 2023-11-27T17:53:28.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0a58d0 con 0x7fd890003bd0 2023-11-27T17:53:28.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c0a5a50 con 0x7fd890003bd0 2023-11-27T17:53:28.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fd8a67fc640 1 -- 172.21.15.31:0/2025521852 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0a5e00 con 0x7fd890003bd0 2023-11-27T17:53:28.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fd8add9f640 1 -- 172.21.15.31:0/2025521852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd890003bd0 msgr2=0x7fd890003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fd8add9f640 1 --2- 172.21.15.31:0/2025521852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd890003bd0 0x7fd890003fd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd89c007e70 tx=0x7fd89c01c9e0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7190c03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840c8990 0x7f718416e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7190c03640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840c8990 0x7f718416e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:51782/0 (socket says 172.21.15.31:51782) 2023-11-27T17:53:28.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7190c03640 1 -- 172.21.15.31:0/2533146756 learned_addr learned my addr 172.21.15.31:0/2533146756 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7191404640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f718403bca0 0x7f71840c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f33cd775640 1 Processor -- start 2023-11-27T17:53:28.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaed9d640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfa816efe0 0x7fdfa816aec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0062150 tx=0x7fdfb0067fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdf9effd640 1 -- 172.21.15.31:0/475203776 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb006bd30 con 0x7fdfa816efe0 2023-11-27T17:53:28.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdf9effd640 1 -- 172.21.15.31:0/475203776 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb0092400 con 0x7fdfa816efe0 2023-11-27T17:53:28.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdf9effd640 1 -- 172.21.15.31:0/475203776 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00927b0 con 0x7fdfa816efe0 2023-11-27T17:53:28.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaf59e640 1 -- 172.21.15.31:0/475203776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa8033e20 con 0x7fdfa816efe0 2023-11-27T17:53:28.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7fdfaf59e640 1 -- 172.21.15.31:0/475203776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa80340c0 con 0x7fdfa816efe0 2023-11-27T17:53:28.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7fd8add9f640 1 -- 172.21.15.31:0/2025521852 shutdown_connections 2023-11-27T17:53:28.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7fd8add9f640 1 --2- 172.21.15.31:0/2025521852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd890003bd0 0x7fd890003fd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7fd8add9f640 1 -- 172.21.15.31:0/2025521852 >> 172.21.15.31:0/2025521852 conn(0x7fd8a806a730 msgr2=0x7fd8a806ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f33cd775640 1 -- start start 2023-11-27T17:53:28.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cf57fa640 1 -- 172.21.15.31:0/1717792593 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf0014580 con 0x7f5cf8142420 2023-11-27T17:53:28.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cf57fa640 1 -- 172.21.15.31:0/1717792593 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0014910 con 0x7f5cf8142420 2023-11-27T17:53:28.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f5cfdabb640 1 -- 172.21.15.31:0/1717792593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd8005260 con 0x7f5cf8142420 2023-11-27T17:53:28.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7191404640 1 -- 172.21.15.31:0/2533146756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840c8990 msgr2=0x7f718416e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7191404640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840c8990 0x7f718416e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.971 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7191404640 1 -- 172.21.15.31:0/2533146756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71840cece0 msgr2=0x7f71840c6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7191404640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71840cece0 0x7f71840c6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7191404640 1 -- 172.21.15.31:0/2533146756 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188009420 con 0x7f718403bca0 2023-11-27T17:53:28.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f7191404640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f718403bca0 0x7f71840c80b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f71880ac000 tx=0x7f718801ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.921+0000 7f9af8dac640 1 -- 172.21.15.31:0/1871655086 wait complete. 2023-11-27T17:53:28.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af8dac640 1 Processor -- start 2023-11-27T17:53:28.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33cd775640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c806db00 0x7f33c806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33cd775640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c8072330 0x7f33c80b7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7fd8add9f640 1 -- 172.21.15.31:0/2025521852 shutdown_connections 2023-11-27T17:53:28.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33cd775640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c81418c0 0x7f33c81e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33cd775640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c81e88a0 con 0x7f33c806db00 2023-11-27T17:53:28.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33cd775640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80b9510 con 0x7f33c81418c0 2023-11-27T17:53:28.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33cd775640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80b84c0 con 0x7f33c8072330 2023-11-27T17:53:28.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33c6ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c806db00 0x7f33c806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33c6ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c806db00 0x7f33c806fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51172/0 (socket says 172.21.15.31:51172) 2023-11-27T17:53:28.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33c6ffd640 1 -- 172.21.15.31:0/2413983405 learned_addr learned my addr 172.21.15.31:0/2413983405 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33c77fe640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c81418c0 0x7f33c81e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33c6ffd640 1 -- 172.21.15.31:0/2413983405 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c8072330 msgr2=0x7f33c80b7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33c6ffd640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c8072330 0x7f33c80b7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33c6ffd640 1 -- 172.21.15.31:0/2413983405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c81418c0 msgr2=0x7f33c81e92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33c6ffd640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c81418c0 0x7f33c81e92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33c6ffd640 1 -- 172.21.15.31:0/2413983405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc009420 con 0x7f33c806db00 2023-11-27T17:53:28.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33c77fe640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c81418c0 0x7f33c81e92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:28.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f33c6ffd640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c806db00 0x7f33c806fef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f33b800b440 tx=0x7f33b800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af8dac640 1 -- start start 2023-11-27T17:53:28.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af8dac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af40729c0 0x7f9af41e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af8dac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b2bc0 0x7f9af406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af8dac640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af40b7bb0 0x7f9af414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af8dac640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40a0cc0 con 0x7f9af40729c0 2023-11-27T17:53:28.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af8dac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af4070e40 con 0x7f9af40b2bc0 2023-11-27T17:53:28.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af8dac640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af41e81b0 con 0x7f9af40b7bb0 2023-11-27T17:53:28.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7fdfaf59e640 1 -- 172.21.15.31:0/475203776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa8008180 con 0x7fdfa816efe0 2023-11-27T17:53:28.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7fd8add9f640 1 -- 172.21.15.31:0/2025521852 wait complete. 2023-11-27T17:53:28.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7fd8add9f640 1 Processor -- start 2023-11-27T17:53:28.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f5cf57fa640 1 -- 172.21.15.31:0/1717792593 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5cf0014a70 con 0x7f5cf8142420 2023-11-27T17:53:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b2bc0 0x7f9af406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b2bc0 0x7f9af406f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:51796/0 (socket says 172.21.15.31:51796) 2023-11-27T17:53:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af1d9b640 1 -- 172.21.15.31:0/60530387 learned_addr learned my addr 172.21.15.31:0/60530387 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af259c640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af40729c0 0x7f9af41e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af1d9b640 1 -- 172.21.15.31:0/60530387 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af40b7bb0 msgr2=0x7f9af414fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af1d9b640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af40b7bb0 0x7f9af414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af1d9b640 1 -- 172.21.15.31:0/60530387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af40729c0 msgr2=0x7f9af41e7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af1d9b640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af40729c0 0x7f9af41e7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af1d9b640 1 -- 172.21.15.31:0/60530387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec009770 con 0x7f9af40b2bc0 2023-11-27T17:53:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f9af1d9b640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b2bc0 0x7f9af406f120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400c500 tx=0x7f9ae400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7fdf9effd640 1 -- 172.21.15.31:0/475203776 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fdfb0092910 con 0x7fdfa816efe0 2023-11-27T17:53:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7fdf9effd640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdf90066870 0x7fdf90068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7fdfae59c640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdf90066870 0x7fdf90068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7fd8add9f640 1 -- start start 2023-11-27T17:53:28.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f5cf57fa640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f5cdc066820 0x7f5cdc068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.925+0000 7f5cf57fa640 1 -- 172.21.15.31:0/1717792593 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cf0085400 con 0x7f5cf8142420 2023-11-27T17:53:28.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f5cfcab9640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f5cdc066820 0x7f5cdc068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f9ae2ffd640 1 -- 172.21.15.31:0/60530387 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4005220 con 0x7f9af40b2bc0 2023-11-27T17:53:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f9ae2ffd640 1 -- 172.21.15.31:0/60530387 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae4005380 con 0x7f9af40b2bc0 2023-11-27T17:53:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f9ae2ffd640 1 -- 172.21.15.31:0/60530387 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4007270 con 0x7f9af40b2bc0 2023-11-27T17:53:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f9af8dac640 1 -- 172.21.15.31:0/60530387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af40a0a70 con 0x7f9af40b2bc0 2023-11-27T17:53:28.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f9af8dac640 1 -- 172.21.15.31:0/60530387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af4070a60 con 0x7f9af40b2bc0 2023-11-27T17:53:28.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8add9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd890003bd0 0x7fd8a80bc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8add9f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a8144630 0x7fd8a8137e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8add9f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8a8144a90 0x7fd8a8138390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8add9f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a81597a0 con 0x7fd8a8144630 2023-11-27T17:53:28.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8add9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8142320 con 0x7fd890003bd0 2023-11-27T17:53:28.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8add9f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8155a30 con 0x7fd8a8144a90 2023-11-27T17:53:28.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8a6ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a8144630 0x7fd8a8137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8a6ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a8144630 0x7fd8a8137e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51200/0 (socket says 172.21.15.31:51200) 2023-11-27T17:53:28.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd890003bd0 0x7fd8a80bc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8a6ffd640 1 -- 172.21.15.31:0/2800969705 learned_addr learned my addr 172.21.15.31:0/2800969705 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8a7fff640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8a8144a90 0x7fd8a8138390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fdfae59c640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdf90066870 0x7fdf90068d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00b2000 tx=0x7fdfa00aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f5cfcab9640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f5cdc066820 0x7f5cdc068ce0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009870 tx=0x7f5cec0aa070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f9af8dac640 1 -- 172.21.15.31:0/60530387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af40705e0 con 0x7f9af40b2bc0 2023-11-27T17:53:28.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8a6ffd640 1 -- 172.21.15.31:0/2800969705 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8a8144a90 msgr2=0x7fd8a8138390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8a6ffd640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8a8144a90 0x7fd8a8138390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8a6ffd640 1 -- 172.21.15.31:0/2800969705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd890003bd0 msgr2=0x7fd8a80bc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8a6ffd640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd890003bd0 0x7fd8a80bc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8a6ffd640 1 -- 172.21.15.31:0/2800969705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a8155c80 con 0x7fd8a8144630 2023-11-27T17:53:28.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8a77fe640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd890003bd0 0x7fd8a80bc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:28.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8a6ffd640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a8144630 0x7fd8a8137e50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00049d0 tx=0x7fd8a0007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7ff9730bc640 1 Processor -- start 2023-11-27T17:53:28.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7ff9730bc640 1 -- start start 2023-11-27T17:53:28.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7ff9730bc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff96c0704b0 0x7ff96c0b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7ff9730bc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff96c0b49d0 0x7ff96c141d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7ff9730bc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff96c142250 0x7ff96c14b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f5cf57fa640 1 -- 172.21.15.31:0/1717792593 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5cf0052670 con 0x7f5cf8142420 2023-11-27T17:53:28.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f9ae2ffd640 1 -- 172.21.15.31:0/60530387 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9ae40073d0 con 0x7f9af40b2bc0 2023-11-27T17:53:28.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f9ae2ffd640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9ad4066820 0x7f9ad4068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f9ae2ffd640 1 -- 172.21.15.31:0/60530387 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ae4084680 con 0x7f9af40b2bc0 2023-11-27T17:53:28.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7ff9730bc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c070d40 con 0x7ff96c0704b0 2023-11-27T17:53:28.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7ff9730bc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c0725b0 con 0x7ff96c142250 2023-11-27T17:53:28.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7ff9730bc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c1426e0 con 0x7ff96c0b49d0 2023-11-27T17:53:28.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd88ffff640 1 -- 172.21.15.31:0/2800969705 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0015420 con 0x7fd8a8144630 2023-11-27T17:53:28.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f33af7fe640 1 -- 172.21.15.31:0/2413983405 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8011890 con 0x7f33c806db00 2023-11-27T17:53:28.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f9af259c640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9ad4066820 0x7f9ad4068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fdf9effd640 1 -- 172.21.15.31:0/475203776 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfb00cf400 con 0x7fdfa816efe0 2023-11-27T17:53:28.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8add9f640 1 -- 172.21.15.31:0/2800969705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a8141e00 con 0x7fd8a8144630 2023-11-27T17:53:28.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7fd8add9f640 1 -- 172.21.15.31:0/2800969705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a8142490 con 0x7fd8a8144630 2023-11-27T17:53:28.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f33cd775640 1 -- 172.21.15.31:0/2413983405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c81e8af0 con 0x7f33c806db00 2023-11-27T17:53:28.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7f33cd775640 1 -- 172.21.15.31:0/2413983405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c8072080 con 0x7f33c806db00 2023-11-27T17:53:28.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7ff9720ba640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff96c0704b0 0x7ff96c0b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7ff9720ba640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff96c0704b0 0x7ff96c0b9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51202/0 (socket says 172.21.15.31:51202) 2023-11-27T17:53:28.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7ff9720ba640 1 -- 172.21.15.31:0/1974554228 learned_addr learned my addr 172.21.15.31:0/1974554228 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:28.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.929+0000 7ff9728bb640 1 --2- 172.21.15.31:0/1974554228 >> v2:172.21.15.81:3300/0 conn(0x7ff96c142250 0x7ff96c14b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7ff9718b9640 1 --2- 172.21.15.31:0/1974554228 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff96c0b49d0 0x7ff96c141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7ff9720ba640 1 -- 172.21.15.31:0/1974554228 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff96c0b49d0 msgr2=0x7ff96c141d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7ff9720ba640 1 --2- 172.21.15.31:0/1974554228 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff96c0b49d0 0x7ff96c141d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7ff9720ba640 1 -- 172.21.15.31:0/1974554228 >> v2:172.21.15.81:3300/0 conn(0x7ff96c142250 msgr2=0x7ff96c14b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:28.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7ff9720ba640 1 --2- 172.21.15.31:0/1974554228 >> v2:172.21.15.81:3300/0 conn(0x7ff96c142250 0x7ff96c14b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7ff9720ba640 1 -- 172.21.15.31:0/1974554228 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c071780 con 0x7ff96c0704b0 2023-11-27T17:53:28.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7f9af259c640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9ad4066820 0x7f9ad4068ce0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000f70 tx=0x7f9ae8007df0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7f33cd775640 1 -- 172.21.15.31:0/2413983405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c81e9010 con 0x7f33c806db00 2023-11-27T17:53:28.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7fd8add9f640 1 -- 172.21.15.31:0/2800969705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a80bce30 con 0x7fd8a8144630 2023-11-27T17:53:28.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7ff9720ba640 1 --2- 172.21.15.31:0/1974554228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff96c0704b0 0x7ff96c0b9fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0b9f40 tx=0x7ff96801f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88568bd0b2927329 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7f7181ffb640 1 -- 172.21.15.31:0/2533146756 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880bf610 con 0x7f718403bca0 2023-11-27T17:53:28.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7f7181ffb640 1 -- 172.21.15.31:0/2533146756 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71880bf770 con 0x7f718403bca0 2023-11-27T17:53:28.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7f7181ffb640 1 -- 172.21.15.31:0/2533146756 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71880bfb20 con 0x7f718403bca0 2023-11-27T17:53:28.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7f7193668640 1 -- 172.21.15.31:0/2533146756 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71840cc430 con 0x7f718403bca0 2023-11-27T17:53:28.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.933+0000 7f7193668640 1 -- 172.21.15.31:0/2533146756 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71840cbd20 con 0x7f718403bca0 2023-11-27T17:53:28.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.937+0000 7f4bebfff640 1 -- 172.21.15.31:0/2956778195 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f4bf4053ee0 con 0x7f4bfc0a2160 2023-11-27T17:53:28.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.937+0000 7f7193668640 1 -- 172.21.15.31:0/2533146756 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71840056f0 con 0x7f718403bca0 2023-11-27T17:53:28.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.937+0000 7f7181ffb640 1 -- 172.21.15.31:0/2533146756 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f71880b5400 con 0x7f718403bca0 2023-11-27T17:53:28.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.937+0000 7f7181ffb640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7170066870 0x7f7170068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.937+0000 7f7181ffb640 1 -- 172.21.15.31:0/2533146756 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71880a8050 con 0x7f718403bca0 2023-11-27T17:53:28.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.937+0000 7f7190c03640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7170066870 0x7f7170068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:28.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.937+0000 7f7190c03640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7170066870 0x7f7170068d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f71840bd090 tx=0x7f717c007f20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:28.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7fdf9effd640 1 -- 172.21.15.31:0/475203776 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fdfb00cb040 con 0x7fdfa816efe0 2023-11-27T17:53:28.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7f33af7fe640 1 -- 172.21.15.31:0/2413983405 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b8009240 con 0x7f33c806db00 2023-11-27T17:53:28.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7f33af7fe640 1 -- 172.21.15.31:0/2413983405 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b8011bf0 con 0x7f33c806db00 2023-11-27T17:53:28.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7fd88ffff640 1 -- 172.21.15.31:0/2800969705 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a0015580 con 0x7fd8a8144630 2023-11-27T17:53:28.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7fd88ffff640 1 -- 172.21.15.31:0/2800969705 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00158f0 con 0x7fd8a8144630 2023-11-27T17:53:28.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7ff9710b8640 1 -- 172.21.15.31:0/1974554228 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9680af600 con 0x7ff96c0704b0 2023-11-27T17:53:28.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7ff9710b8640 1 -- 172.21.15.31:0/1974554228 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9680ab050 con 0x7ff96c0704b0 2023-11-27T17:53:28.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7ff9730bc640 1 -- 172.21.15.31:0/1974554228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff96c0704b0 msgr2=0x7ff96c0b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:28.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7ff9730bc640 1 --2- 172.21.15.31:0/1974554228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff96c0704b0 0x7ff96c0b9fb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff96c0b9f40 tx=0x7ff96801f180 comp rx=0 tx=0).stop 2023-11-27T17:53:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7f33af7fe640 1 -- 172.21.15.31:0/2413983405 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f33b8004020 con 0x7f33c806db00 2023-11-27T17:53:28.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7ff9730bc640 1 -- 172.21.15.31:0/1974554228 shutdown_connections 2023-11-27T17:53:28.998 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7ff9730bc640 1 --2- 172.21.15.31:0/1974554228 >> v2:172.21.15.81:3300/0 conn(0x7ff96c142250 0x7ff96c14b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7ff9730bc640 1 --2- 172.21.15.31:0/1974554228 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff96c0b49d0 0x7ff96c141d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.941+0000 7ff9730bc640 1 --2- 172.21.15.31:0/1974554228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff96c0704b0 0x7ff96c0b9fb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:28.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7ff9730bc640 1 -- 172.21.15.31:0/1974554228 >> 172.21.15.31:0/1974554228 conn(0x7ff96c0bdab0 msgr2=0x7ff96c0bde90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:28.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7f33af7fe640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f33b40667e0 0x7f33b4068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:28.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7fd88ffff640 1 -- 172.21.15.31:0/2800969705 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fd8a0015a50 con 0x7fd8a8144630 2023-11-27T17:53:29.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7f33af7fe640 1 -- 172.21.15.31:0/2413983405 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33b80849c0 con 0x7f33c806db00 2023-11-27T17:53:29.000 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7f33c67fc640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f33b40667e0 0x7f33b4068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:29.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7fd88ffff640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd8940667f0 0x7fd894068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:29.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7fd88ffff640 1 -- 172.21.15.31:0/2800969705 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8a0085c30 con 0x7fd8a8144630 2023-11-27T17:53:29.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7f9ae2ffd640 1 -- 172.21.15.31:0/60530387 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9ae4051810 con 0x7f9af40b2bc0 2023-11-27T17:53:29.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7fd8a77fe640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd8940667f0 0x7fd894068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:29.002 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7f33c67fc640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f33b40667e0 0x7f33b4068ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0ad000 tx=0x7f33bc004740 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:29.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7ff9730bc640 1 -- 172.21.15.31:0/1974554228 shutdown_connections 2023-11-27T17:53:29.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7ff9730bc640 1 -- 172.21.15.31:0/1974554228 wait complete. 2023-11-27T17:53:29.003 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.945+0000 7fd8a77fe640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd8940667f0 0x7fd894068cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0af000 tx=0x7fd89c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:29.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9730bc640 1 Processor -- start 2023-11-27T17:53:29.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9730bc640 1 -- start start 2023-11-27T17:53:29.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9730bc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff96c0704b0 0x7ff96c14ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:29.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9730bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96c0b49d0 0x7ff96c144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:29.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9730bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff96c142250 0x7ff96c144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:29.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9730bc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c0b77f0 con 0x7ff96c142250 2023-11-27T17:53:29.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9730bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c14b2e0 con 0x7ff96c0b49d0 2023-11-27T17:53:29.005 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9730bc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c14a570 con 0x7ff96c0704b0 2023-11-27T17:53:29.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9728bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff96c142250 0x7ff96c144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:29.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9728bb640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff96c142250 0x7ff96c144fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51206/0 (socket says 172.21.15.31:51206) 2023-11-27T17:53:29.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9728bb640 1 -- 172.21.15.31:0/2899678116 learned_addr learned my addr 172.21.15.31:0/2899678116 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:29.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9720ba640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff96c0704b0 0x7ff96c14ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:29.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9718b9640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96c0b49d0 0x7ff96c144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:29.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9728bb640 1 -- 172.21.15.31:0/2899678116 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff96c0704b0 msgr2=0x7ff96c14ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9728bb640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff96c0704b0 0x7ff96c14ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9728bb640 1 -- 172.21.15.31:0/2899678116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96c0b49d0 msgr2=0x7ff96c144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9728bb640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96c0b49d0 0x7ff96c144a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9728bb640 1 -- 172.21.15.31:0/2899678116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96800b580 con 0x7ff96c142250 2023-11-27T17:53:29.006 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9718b9640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96c0b49d0 0x7ff96c144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:29.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7ff9728bb640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff96c142250 0x7ff96c144fb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff964009ee0 tx=0x7ff964008630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:29.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7f7181ffb640 1 -- 172.21.15.31:0/2533146756 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f71880ec2d0 con 0x7f718403bca0 2023-11-27T17:53:29.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.949+0000 7f33af7fe640 1 -- 172.21.15.31:0/2413983405 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f33b8051a80 con 0x7f33c806db00 2023-11-27T17:53:29.007 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.961+0000 7fd88ffff640 1 -- 172.21.15.31:0/2800969705 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fd8a0052e50 con 0x7fd8a8144630 2023-11-27T17:53:29.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.961+0000 7ff962ffd640 1 -- 172.21.15.31:0/2899678116 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96400d520 con 0x7ff96c142250 2023-11-27T17:53:29.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.961+0000 7ff962ffd640 1 -- 172.21.15.31:0/2899678116 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff964008e30 con 0x7ff96c142250 2023-11-27T17:53:29.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.961+0000 7ff9730bc640 1 -- 172.21.15.31:0/2899678116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c1dc720 con 0x7ff96c142250 2023-11-27T17:53:29.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.961+0000 7ff962ffd640 1 -- 172.21.15.31:0/2899678116 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff964003bc0 con 0x7ff96c142250 2023-11-27T17:53:29.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.961+0000 7ff9730bc640 1 -- 172.21.15.31:0/2899678116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c1dcce0 con 0x7ff96c142250 2023-11-27T17:53:29.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.961+0000 7ff9730bc640 1 -- 172.21.15.31:0/2899678116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c074960 con 0x7ff96c142250 2023-11-27T17:53:29.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.961+0000 7ff962ffd640 1 -- 172.21.15.31:0/2899678116 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7ff964003d20 con 0x7ff96c142250 2023-11-27T17:53:29.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.961+0000 7ff962ffd640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ff9500667f0 0x7ff950068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:29.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.965+0000 7ff962ffd640 1 -- 172.21.15.31:0/2899678116 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff964084750 con 0x7ff96c142250 2023-11-27T17:53:29.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.965+0000 7ff9720ba640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ff9500667f0 0x7ff950068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:29.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.965+0000 7ff9720ba640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ff9500667f0 0x7ff950068cb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff9680b1000 tx=0x7ff9680aa000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:29.010 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:28.973+0000 7ff962ffd640 1 -- 172.21.15.31:0/2899678116 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7ff9640518f0 con 0x7ff96c142250 2023-11-27T17:53:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5cfdabb640 1 -- 172.21.15.31:0/1717792593 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5cd80057e0 con 0x7f5cf8142420 2023-11-27T17:53:29.243 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5cf57fa640 1 -- 172.21.15.31:0/1717792593 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5cf0055c90 con 0x7f5cf8142420 2023-11-27T17:53:29.246 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-11-27T17:53:29.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5ce2ffd640 1 -- 172.21.15.31:0/1717792593 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f5cdc066820 msgr2=0x7f5cdc068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5ce2ffd640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f5cdc066820 0x7f5cdc068ce0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009870 tx=0x7f5cec0aa070 comp rx=0 tx=0).stop 2023-11-27T17:53:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5ce2ffd640 1 -- 172.21.15.31:0/1717792593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cf8142420 msgr2=0x7f5cf81e8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5ce2ffd640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cf8142420 0x7f5cf81e8bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009fd0 tx=0x7f5cf000e4b0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5ce2ffd640 1 -- 172.21.15.31:0/1717792593 shutdown_connections 2023-11-27T17:53:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5ce2ffd640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f5cdc066820 0x7f5cdc068ce0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5ce2ffd640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5cf8142420 0x7f5cf81e8bb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5ce2ffd640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5cf80b49d0 0x7f5cf81433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5ce2ffd640 1 --2- 172.21.15.31:0/1717792593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf80704b0 0x7f5cf8142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5ce2ffd640 1 -- 172.21.15.31:0/1717792593 >> 172.21.15.31:0/1717792593 conn(0x7f5cf80bdab0 msgr2=0x7f5cf80bde90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:29.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5ce2ffd640 1 -- 172.21.15.31:0/1717792593 shutdown_connections 2023-11-27T17:53:29.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.241+0000 7f5ce2ffd640 1 -- 172.21.15.31:0/1717792593 wait complete. 2023-11-27T17:53:29.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.253+0000 7f4c0196d640 1 -- 172.21.15.31:0/2956778195 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4bd8005510 con 0x7f4bfc0a2160 2023-11-27T17:53:29.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.253+0000 7f4bebfff640 1 -- 172.21.15.31:0/2956778195 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4bf4057500 con 0x7f4bfc0a2160 2023-11-27T17:53:29.259 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-11-27T17:53:29.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7fdfaf59e640 1 -- 172.21.15.31:0/475203776 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdfa80052a0 con 0x7fdfa816efe0 2023-11-27T17:53:29.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7fdf9effd640 1 -- 172.21.15.31:0/475203776 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdfb00ce660 con 0x7fdfa816efe0 2023-11-27T17:53:29.260 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-11-27T17:53:29.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f9af8dac640 1 -- 172.21.15.31:0/60530387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9af4070f80 con 0x7f9af40b2bc0 2023-11-27T17:53:29.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f4c0196d640 1 -- 172.21.15.31:0/2956778195 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f4be00667f0 msgr2=0x7f4be0068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f4c0196d640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f4be00667f0 0x7f4be0068cb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc06c150 tx=0x7f4bec0a6000 comp rx=0 tx=0).stop 2023-11-27T17:53:29.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f4c0196d640 1 -- 172.21.15.31:0/2956778195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4bfc0a2160 msgr2=0x7f4bfc1478e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f4c0196d640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4bfc0a2160 0x7f4bfc1478e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400e780 tx=0x7f4bf400ec40 comp rx=0 tx=0).stop 2023-11-27T17:53:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f4c0196d640 1 -- 172.21.15.31:0/2956778195 shutdown_connections 2023-11-27T17:53:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f4c0196d640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f4be00667f0 0x7f4be0068cb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f4c0196d640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bfc14c950 0x7f4bfc146380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f4c0196d640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4bfc0b4d10 0x7f4bfc145e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f4c0196d640 1 --2- 172.21.15.31:0/2956778195 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4bfc0a2160 0x7f4bfc1478e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f4c0196d640 1 -- 172.21.15.31:0/2956778195 >> 172.21.15.31:0/2956778195 conn(0x7f4bfc0b95a0 msgr2=0x7f4bfc14ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f4c0196d640 1 -- 172.21.15.31:0/2956778195 shutdown_connections 2023-11-27T17:53:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f4c0196d640 1 -- 172.21.15.31:0/2956778195 wait complete. 2023-11-27T17:53:29.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.257+0000 7f9ae2ffd640 1 -- 172.21.15.31:0/60530387 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9af4070f80 con 0x7f9af40b2bc0 2023-11-27T17:53:29.264 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-11-27T17:53:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7fdfaf59e640 1 -- 172.21.15.31:0/475203776 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdf90066870 msgr2=0x7fdf90068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7fdfaf59e640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdf90066870 0x7fdf90068d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00b2000 tx=0x7fdfa00aa070 comp rx=0 tx=0).stop 2023-11-27T17:53:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7fdfaf59e640 1 -- 172.21.15.31:0/475203776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfa816efe0 msgr2=0x7fdfa816aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7fdfaf59e640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfa816efe0 0x7fdfa816aec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0062150 tx=0x7fdfb0067fd0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7fdfaf59e640 1 -- 172.21.15.31:0/475203776 shutdown_connections 2023-11-27T17:53:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7fdfaf59e640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdf90066870 0x7fdf90068d30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7fdfaf59e640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdfa816efe0 0x7fdfa816aec0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7fdfaf59e640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa803b0b0 0x7fdfa816eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7fdfaf59e640 1 --2- 172.21.15.31:0/475203776 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdfa8007130 0x7fdfa80d0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7fdfaf59e640 1 -- 172.21.15.31:0/475203776 >> 172.21.15.31:0/475203776 conn(0x7fdfa803ee00 msgr2=0x7fdfa8037970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:29.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7fdfaf59e640 1 -- 172.21.15.31:0/475203776 shutdown_connections 2023-11-27T17:53:29.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7fdfaf59e640 1 -- 172.21.15.31:0/475203776 wait complete. 2023-11-27T17:53:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7f9af8dac640 1 -- 172.21.15.31:0/60530387 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9ad4066820 msgr2=0x7f9ad4068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7f9af8dac640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9ad4066820 0x7f9ad4068ce0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000f70 tx=0x7f9ae8007df0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7f9af8dac640 1 -- 172.21.15.31:0/60530387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b2bc0 msgr2=0x7f9af406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7f9af8dac640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b2bc0 0x7f9af406f120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400c500 tx=0x7f9ae400c9c0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7f9af8dac640 1 -- 172.21.15.31:0/60530387 shutdown_connections 2023-11-27T17:53:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7f9af8dac640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9ad4066820 0x7f9ad4068ce0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7f9af8dac640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9af40b7bb0 0x7f9af414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7f9af8dac640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9af40b2bc0 0x7f9af406f120 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7f9af8dac640 1 --2- 172.21.15.31:0/60530387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9af40729c0 0x7f9af41e7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7f9af8dac640 1 -- 172.21.15.31:0/60530387 >> 172.21.15.31:0/60530387 conn(0x7f9af40b95a0 msgr2=0x7f9af40bc270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7f9af8dac640 1 -- 172.21.15.31:0/60530387 shutdown_connections 2023-11-27T17:53:29.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.261+0000 7f9af8dac640 1 -- 172.21.15.31:0/60530387 wait complete. 2023-11-27T17:53:29.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-11-27T17:53:29.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.273+0000 7f7193668640 1 -- 172.21.15.31:0/2533146756 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f71840bcde0 con 0x7f718403bca0 2023-11-27T17:53:29.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.273+0000 7f7181ffb640 1 -- 172.21.15.31:0/2533146756 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71880ef8f0 con 0x7f718403bca0 2023-11-27T17:53:29.276 INFO:teuthology.orchestra.run.smithi031.stdout:55834574852 2023-11-27T17:53:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.273+0000 7fd8add9f640 1 -- 172.21.15.31:0/2800969705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd8a804e850 con 0x7fd8a8144630 2023-11-27T17:53:29.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.273+0000 7fd88ffff640 1 -- 172.21.15.31:0/2800969705 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8a0056470 con 0x7fd8a8144630 2023-11-27T17:53:29.277 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-11-27T17:53:29.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7f7193668640 1 -- 172.21.15.31:0/2533146756 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7170066870 msgr2=0x7f7170068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7f7193668640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7170066870 0x7f7170068d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f71840bd090 tx=0x7f717c007f20 comp rx=0 tx=0).stop 2023-11-27T17:53:29.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7f7193668640 1 -- 172.21.15.31:0/2533146756 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f718403bca0 msgr2=0x7f71840c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7f7193668640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f718403bca0 0x7f71840c80b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f71880ac000 tx=0x7f718801ac50 comp rx=0 tx=0).stop 2023-11-27T17:53:29.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7f7193668640 1 -- 172.21.15.31:0/2533146756 shutdown_connections 2023-11-27T17:53:29.280 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7f7193668640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7170066870 0x7f7170068d30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7fd8add9f640 1 -- 172.21.15.31:0/2800969705 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd8940667f0 msgr2=0x7fd894068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.281 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7fd8add9f640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd8940667f0 0x7fd894068cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0af000 tx=0x7fd89c009040 comp rx=0 tx=0).stop 2023-11-27T17:53:29.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7fd8add9f640 1 -- 172.21.15.31:0/2800969705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a8144630 msgr2=0x7fd8a8137e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7fd8add9f640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a8144630 0x7fd8a8137e50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd8a00049d0 tx=0x7fd8a0007700 comp rx=0 tx=0).stop 2023-11-27T17:53:29.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7fd8add9f640 1 -- 172.21.15.31:0/2800969705 shutdown_connections 2023-11-27T17:53:29.282 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7fd8add9f640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd8940667f0 0x7fd894068cb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7fd8add9f640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd8a8144a90 0x7fd8a8138390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7fd8add9f640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8a8144630 0x7fd8a8137e50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.283 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7fd8add9f640 1 --2- 172.21.15.31:0/2800969705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd890003bd0 0x7fd8a80bc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7fd8add9f640 1 -- 172.21.15.31:0/2800969705 >> 172.21.15.31:0/2800969705 conn(0x7fd8a806a730 msgr2=0x7fd8a8070510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:29.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7f7193668640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71840cece0 0x7f71840c6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7fd8add9f640 1 -- 172.21.15.31:0/2800969705 shutdown_connections 2023-11-27T17:53:29.285 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7fd8add9f640 1 -- 172.21.15.31:0/2800969705 wait complete. 2023-11-27T17:53:29.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7f7193668640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71840c8990 0x7f718416e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7f7193668640 1 --2- 172.21.15.31:0/2533146756 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f718403bca0 0x7f71840c80b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7f7193668640 1 -- 172.21.15.31:0/2533146756 >> 172.21.15.31:0/2533146756 conn(0x7f7184044620 msgr2=0x7f71840b9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:29.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7f7193668640 1 -- 172.21.15.31:0/2533146756 shutdown_connections 2023-11-27T17:53:29.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.277+0000 7f7193668640 1 -- 172.21.15.31:0/2533146756 wait complete. 2023-11-27T17:53:29.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.281+0000 7f33cd775640 1 -- 172.21.15.31:0/2413983405 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f33c81e9010 con 0x7f33c806db00 2023-11-27T17:53:29.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.281+0000 7f33af7fe640 1 -- 172.21.15.31:0/2413983405 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f33c81e9010 con 0x7f33c806db00 2023-11-27T17:53:29.289 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2023-11-27T17:53:29.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.281+0000 7ff9730bc640 1 -- 172.21.15.31:0/2899678116 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff96c0b94a0 con 0x7ff96c142250 2023-11-27T17:53:29.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.281+0000 7ff962ffd640 1 -- 172.21.15.31:0/2899678116 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff96400d680 con 0x7ff96c142250 2023-11-27T17:53:29.291 INFO:teuthology.orchestra.run.smithi031.stdout:55834574854 2023-11-27T17:53:29.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-11-27T17:53:29.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7ff9730bc640 1 -- 172.21.15.31:0/2899678116 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ff9500667f0 msgr2=0x7ff950068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7ff9730bc640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ff9500667f0 0x7ff950068cb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff9680b1000 tx=0x7ff9680aa000 comp rx=0 tx=0).stop 2023-11-27T17:53:29.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7f33cd775640 1 -- 172.21.15.31:0/2413983405 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f33b40667e0 msgr2=0x7f33b4068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7f33cd775640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f33b40667e0 0x7f33b4068ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0ad000 tx=0x7f33bc004740 comp rx=0 tx=0).stop 2023-11-27T17:53:29.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7f33cd775640 1 -- 172.21.15.31:0/2413983405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c806db00 msgr2=0x7f33c806fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7f33cd775640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c806db00 0x7f33c806fef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f33b800b440 tx=0x7f33b800b900 comp rx=0 tx=0).stop 2023-11-27T17:53:29.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7f33cd775640 1 -- 172.21.15.31:0/2413983405 shutdown_connections 2023-11-27T17:53:29.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7f33cd775640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f33b40667e0 0x7f33b4068ca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7f33cd775640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33c81418c0 0x7f33c81e92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7f33cd775640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f33c8072330 0x7f33c80b7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7f33cd775640 1 --2- 172.21.15.31:0/2413983405 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33c806db00 0x7f33c806fef0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7f33cd775640 1 -- 172.21.15.31:0/2413983405 >> 172.21.15.31:0/2413983405 conn(0x7f33c80bad90 msgr2=0x7f33c806c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:29.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7ff9730bc640 1 -- 172.21.15.31:0/2899678116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff96c142250 msgr2=0x7ff96c144fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:29.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7ff9730bc640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff96c142250 0x7ff96c144fb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff964009ee0 tx=0x7ff964008630 comp rx=0 tx=0).stop 2023-11-27T17:53:29.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7f33cd775640 1 -- 172.21.15.31:0/2413983405 shutdown_connections 2023-11-27T17:53:29.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7f33cd775640 1 -- 172.21.15.31:0/2413983405 wait complete. 2023-11-27T17:53:29.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7ff9730bc640 1 -- 172.21.15.31:0/2899678116 shutdown_connections 2023-11-27T17:53:29.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7ff9730bc640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ff9500667f0 0x7ff950068cb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7ff9730bc640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff96c142250 0x7ff96c144fb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7ff9730bc640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff96c0b49d0 0x7ff96c144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7ff9730bc640 1 --2- 172.21.15.31:0/2899678116 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ff96c0704b0 0x7ff96c14ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:29.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7ff9730bc640 1 -- 172.21.15.31:0/2899678116 >> 172.21.15.31:0/2899678116 conn(0x7ff96c0bdab0 msgr2=0x7ff96c140260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:29.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7ff9730bc640 1 -- 172.21.15.31:0/2899678116 shutdown_connections 2023-11-27T17:53:29.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:29.285+0000 7ff9730bc640 1 -- 172.21.15.31:0/2899678116 wait complete. 2023-11-27T17:53:29.299 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-11-27T17:53:29.302 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-11-27T17:53:29.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-11-27T17:53:29.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-11-27T17:53:29.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-11-27T17:53:29.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-11-27T17:53:30.272 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-27T17:53:30.294 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-27T17:53:30.300 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-27T17:53:30.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-27T17:53:30.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-27T17:53:30.314 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-27T17:53:30.314 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-27T17:53:30.316 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-27T17:53:30.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.449+0000 7fb110ada640 1 Processor -- start 2023-11-27T17:53:30.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.449+0000 7fb110ada640 1 -- start start 2023-11-27T17:53:30.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.449+0000 7fb110ada640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb10c0b2bc0 0x7fb10c0b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.449+0000 7fb110ada640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b79e0 0x7fb10c0b6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.449+0000 7fb110ada640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb10c0b7e50 con 0x7fb10c0729c0 2023-11-27T17:53:30.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.449+0000 7fb110ada640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10c0b1e80 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.449+0000 7fb110ada640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c0b4950 con 0x7fb10c0b79e0 2023-11-27T17:53:30.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.453+0000 7fb109d9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb10c0729c0 0x7fb10c0b61f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46152/0 (socket says 172.21.15.31:46152) 2023-11-27T17:53:30.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.453+0000 7fb109d9b640 1 -- 172.21.15.31:0/4148621908 learned_addr learned my addr 172.21.15.31:0/4148621908 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:30.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.453+0000 7fb10ad9d640 1 --2- 172.21.15.31:0/4148621908 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b79e0 0x7fb10c0b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.453+0000 7fb10a59c640 1 --2- 172.21.15.31:0/4148621908 >> v2:172.21.15.81:3300/0 conn(0x7fb10c0b2bc0 0x7fb10c0b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.453+0000 7fb10ad9d640 1 -- 172.21.15.31:0/4148621908 >> v2:172.21.15.81:3300/0 conn(0x7fb10c0b2bc0 msgr2=0x7fb10c0b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:30.459 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.453+0000 7fb10ad9d640 1 --2- 172.21.15.31:0/4148621908 >> v2:172.21.15.81:3300/0 conn(0x7fb10c0b2bc0 0x7fb10c0b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.453+0000 7fb10ad9d640 1 -- 172.21.15.31:0/4148621908 >> v1:172.21.15.31:6789/0 conn(0x7fb10c0729c0 legacy=0x7fb10c0b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.453+0000 7fb10ad9d640 1 -- 172.21.15.31:0/4148621908 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c0b9060 con 0x7fb10c0b79e0 2023-11-27T17:53:30.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.453+0000 7fb10959a640 1 -- 172.21.15.31:0/4148621908 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606683896 0 0) 0x7fb10c0b7e50 con 0x7fb10c0729c0 2023-11-27T17:53:30.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.457+0000 7fb10ad9d640 1 --2- 172.21.15.31:0/4148621908 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b79e0 0x7fb10c0b6900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0097c0 tx=0x7fb0fc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9df8b7faf00d0d23 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.457+0000 7fb10959a640 1 -- 172.21.15.31:0/4148621908 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0ad640 con 0x7fb10c0b79e0 2023-11-27T17:53:30.461 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.457+0000 7fb10959a640 1 -- 172.21.15.31:0/4148621908 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0fc0ad7a0 con 0x7fb10c0b79e0 2023-11-27T17:53:30.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.457+0000 7fb110ada640 1 -- 172.21.15.31:0/4148621908 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b79e0 msgr2=0x7fb10c0b6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.457+0000 7fb110ada640 1 --2- 172.21.15.31:0/4148621908 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b79e0 0x7fb10c0b6900 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0097c0 tx=0x7fb0fc01c4a0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.457+0000 7fb110ada640 1 -- 172.21.15.31:0/4148621908 shutdown_connections 2023-11-27T17:53:30.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.457+0000 7fb110ada640 1 --2- 172.21.15.31:0/4148621908 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b79e0 0x7fb10c0b6900 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.457+0000 7fb110ada640 1 --2- 172.21.15.31:0/4148621908 >> v2:172.21.15.81:3300/0 conn(0x7fb10c0b2bc0 0x7fb10c0b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.462 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.457+0000 7fb110ada640 1 -- 172.21.15.31:0/4148621908 >> 172.21.15.31:0/4148621908 conn(0x7fb10c0b95a0 msgr2=0x7fb10c0b9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.463 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.457+0000 7fb110ada640 1 -- 172.21.15.31:0/4148621908 shutdown_connections 2023-11-27T17:53:30.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.457+0000 7fb110ada640 1 -- 172.21.15.31:0/4148621908 wait complete. 2023-11-27T17:53:30.464 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb110ada640 1 Processor -- start 2023-11-27T17:53:30.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb110ada640 1 -- start start 2023-11-27T17:53:30.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb110ada640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10c0729c0 0x7fb10c1e82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.465 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb110ada640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b2bc0 0x7fb10c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb110ada640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb10c1453c0 0x7fb10c155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb110ada640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c1e8ac0 con 0x7fb10c1453c0 2023-11-27T17:53:30.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb110ada640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c1e8da0 con 0x7fb10c0729c0 2023-11-27T17:53:30.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb110ada640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c1e9080 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.466 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb109d9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b2bc0 0x7fb10c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb109d9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b2bc0 0x7fb10c070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:38800/0 (socket says 172.21.15.31:38800) 2023-11-27T17:53:30.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb109d9b640 1 -- 172.21.15.31:0/2561727937 learned_addr learned my addr 172.21.15.31:0/2561727937 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:30.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb10ad9d640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb10c1453c0 0x7fb10c155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb10a59c640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10c0729c0 0x7fb10c1e82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb109d9b640 1 -- 172.21.15.31:0/2561727937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10c0729c0 msgr2=0x7fb10c1e82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb109d9b640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10c0729c0 0x7fb10c1e82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb109d9b640 1 -- 172.21.15.31:0/2561727937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb10c1453c0 msgr2=0x7fb10c155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb109d9b640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb10c1453c0 0x7fb10c155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb109d9b640 1 -- 172.21.15.31:0/2561727937 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc009420 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb10a59c640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10c0729c0 0x7fb10c1e82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:30.467 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.461+0000 7fb10ad9d640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb10c1453c0 0x7fb10c155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:30.468 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.465+0000 7fb109d9b640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b2bc0 0x7fb10c070560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c780 tx=0x7fb10400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.465+0000 7fb0faffd640 1 -- 172.21.15.31:0/2561727937 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10400ce90 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.465+0000 7fb110ada640 1 -- 172.21.15.31:0/2561727937 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c155010 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.465+0000 7fb110ada640 1 -- 172.21.15.31:0/2561727937 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c0711a0 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.469+0000 7fb0faffd640 1 -- 172.21.15.31:0/2561727937 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10400a640 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.469+0000 7fb0faffd640 1 -- 172.21.15.31:0/2561727937 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10400aa70 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.469+0000 7fb0faffd640 1 -- 172.21.15.31:0/2561727937 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb10400ac90 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.469+0000 7fb0faffd640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb0ec066870 0x7fb0ec068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.469+0000 7fb10a59c640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb0ec066870 0x7fb0ec068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.469+0000 7fb0faffd640 1 -- 172.21.15.31:0/2561727937 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb104083a50 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.469+0000 7fb10a59c640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb0ec066870 0x7fb0ec068d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb100009bb0 tx=0x7fb100008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.473+0000 7fb110ada640 1 -- 172.21.15.31:0/2561727937 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f0005260 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.485+0000 7fb0faffd640 1 -- 172.21.15.31:0/2561727937 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb104018020 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.497+0000 7f7f95c75640 1 Processor -- start 2023-11-27T17:53:30.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.497+0000 7f7f95c75640 1 -- start start 2023-11-27T17:53:30.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.497+0000 7f7f95c75640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900b9eb0 0x7f7f900b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.497+0000 7f7f95c75640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f900b4950 con 0x7f7f900b3ae0 2023-11-27T17:53:30.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.497+0000 7f7f95c75640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f90149ee0 con 0x7f7f90152cf0 2023-11-27T17:53:30.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.497+0000 7f7f95c75640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f900b6450 con 0x7f7f900b9eb0 2023-11-27T17:53:30.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.497+0000 7f7f8ffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7f900b3ae0 0x7f7f901497d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46156/0 (socket says 172.21.15.31:46156) 2023-11-27T17:53:30.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.497+0000 7f7f8ffff640 1 -- 172.21.15.31:0/2775939952 learned_addr learned my addr 172.21.15.31:0/2775939952 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:30.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8f7fe640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900b9eb0 0x7f7f900b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654125917 0 0) 0x7f7f900b4950 con 0x7f7f900b3ae0 2023-11-27T17:53:30.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5e6385640 1 Processor -- start 2023-11-27T17:53:30.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5e6385640 1 -- start start 2023-11-27T17:53:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f78003530 con 0x7f7f900b3ae0 2023-11-27T17:53:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332913939 0 0) 0x7f7f90149ee0 con 0x7f7f90152cf0 2023-11-27T17:53:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f900b4950 con 0x7f7f90152cf0 2023-11-27T17:53:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3929974633 0 0) 0x7f7f78003530 con 0x7f7f900b3ae0 2023-11-27T17:53:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900b9eb0 msgr2=0x7f7f900b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900b9eb0 0x7f7f900b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fafbe6bc640 1 Processor -- start 2023-11-27T17:53:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 >> v1:172.21.15.81:6789/0 conn(0x7f7f90152cf0 legacy=0x7f7f900b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f900b4ec0 con 0x7f7f900b3ae0 2023-11-27T17:53:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f7f80001680 con 0x7f7f900b3ae0 2023-11-27T17:53:30.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 >> v1:172.21.15.31:6789/0 conn(0x7f7f900b3ae0 legacy=0x7f7f901497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5e6385640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd5e00b9830 0x7fd5e006f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5e6385640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5e00b9c10 0x7fd5e0153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5e6385640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e00702a0 con 0x7fd5e00716c0 2023-11-27T17:53:30.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5e6385640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e006fd40 con 0x7fd5e00b9830 2023-11-27T17:53:30.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5e6385640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e006ffc0 con 0x7fd5e00b9c10 2023-11-27T17:53:30.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900b9eb0 0x7f7f78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f78005180 0x7f7f78003770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5df7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd5e00716c0 0x7fd5e0149b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46162/0 (socket says 172.21.15.31:46162) 2023-11-27T17:53:30.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5df7fe640 1 -- 172.21.15.31:0/531452605 learned_addr learned my addr 172.21.15.31:0/531452605 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:30.509 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f78003cb0 0x7f7f78004130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fafbe6bc640 1 -- start start 2023-11-27T17:53:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f84001240 con 0x7f7f78003cb0 2023-11-27T17:53:30.510 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7800ba70 con 0x7f7f78005180 2023-11-27T17:53:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5e4922640 1 --2- 172.21.15.31:0/531452605 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5e00b9c10 0x7fd5e0153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8f7fe640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900b9eb0 0x7f7f78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8effd640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f78005180 0x7f7f78003770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7800bc30 con 0x7f7f900b9eb0 2023-11-27T17:53:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fafbe6bc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fafb80b9630 0x7fafb8147890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fafbe6bc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafb80b5b10 0x7fafb8071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fafbe6bc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb8147dd0 con 0x7fafb80722f0 2023-11-27T17:53:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fafbe6bc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb80b7010 con 0x7fafb80b9630 2023-11-27T17:53:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fafbe6bc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb80b4490 con 0x7fafb80b5b10 2023-11-27T17:53:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8ffff640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f78003cb0 0x7f7f78004130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.512 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5deffd640 1 -- 172.21.15.31:0/531452605 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765619835 0 0) 0x7fd5d0001120 con 0x7fd5e00716c0 2023-11-27T17:53:30.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5deffd640 1 -- 172.21.15.31:0/531452605 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5c8003530 con 0x7fd5e00716c0 2023-11-27T17:53:30.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fafb77fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafb80b5b10 0x7fafb8071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fafbcc59640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fafb80722f0 0x7fafb80b4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.31:48130/0 (socket says 172.21.15.31:48130) 2023-11-27T17:53:30.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fafbcc59640 1 -- 172.21.15.31:0/3872293559 learned_addr learned my addr 172.21.15.31:0/3872293559 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:30.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fafb7fff640 1 --2- 172.21.15.31:0/3872293559 >> v2:172.21.15.31:3300/0 conn(0x7fafb80b9630 0x7fafb8147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f91b0ba4640 1 Processor -- start 2023-11-27T17:53:30.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f95a775f640 1 Processor -- start 2023-11-27T17:53:30.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5e4922640 1 -- 172.21.15.31:0/531452605 >> v2:172.21.15.31:3300/0 conn(0x7fd5e00b9830 msgr2=0x7fd5e006f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:30.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5e4922640 1 --2- 172.21.15.31:0/531452605 >> v2:172.21.15.31:3300/0 conn(0x7fd5e00b9830 0x7fd5e006f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5e4922640 1 -- 172.21.15.31:0/531452605 >> v1:172.21.15.31:6789/0 conn(0x7fd5e00716c0 legacy=0x7fd5e0149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7fd5e4922640 1 -- 172.21.15.31:0/531452605 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e0149340 con 0x7fd5e00b9c10 2023-11-27T17:53:30.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f95a775f640 1 -- start start 2023-11-27T17:53:30.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f91b0ba4640 1 -- start start 2023-11-27T17:53:30.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8effd640 1 -- 172.21.15.31:0/2775939952 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900b9eb0 msgr2=0x7f7f78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:30.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8effd640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900b9eb0 0x7f7f78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8effd640 1 -- 172.21.15.31:0/2775939952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f78003cb0 msgr2=0x7f7f78004130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:30.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8effd640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f78003cb0 0x7f7f78004130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8effd640 1 -- 172.21.15.31:0/2775939952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f78003530 con 0x7f7f78005180 2023-11-27T17:53:30.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fafb7fff640 1 -- 172.21.15.31:0/3872293559 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafb80b5b10 msgr2=0x7fafb8071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:30.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fafb7fff640 1 --2- 172.21.15.31:0/3872293559 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafb80b5b10 0x7fafb8071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fafb7fff640 1 -- 172.21.15.31:0/3872293559 >> v1:172.21.15.81:6789/0 conn(0x7fafb80722f0 legacy=0x7fafb80b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fafb6ffd640 1 -- 172.21.15.31:0/3872293559 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897034365 0 0) 0x7fafb00014a0 con 0x7fafb80722f0 2023-11-27T17:53:30.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91b0ba4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f91ac0b5ba0 0x7f91ac147890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91b0ba4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f91ac0b5030 0x7f91ac0721f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91b0ba4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac147dd0 con 0x7f91ac071db0 2023-11-27T17:53:30.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91b0ba4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac0b7010 con 0x7f91ac0b5ba0 2023-11-27T17:53:30.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91b0ba4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0b4490 con 0x7f91ac0b5030 2023-11-27T17:53:30.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.501+0000 7f7f8ffff640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f78003cb0 0x7f7f78004130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:30.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fb36733e640 1 Processor -- start 2023-11-27T17:53:30.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a775f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95a00ba830 0x7f95a00b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbced252640 1 Processor -- start 2023-11-27T17:53:30.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a775f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95a0148160 0x7f95a00b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.519 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a775f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f95a00714b0 0x7f95a0141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91aa59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f91ac0b5ba0 0x7f91ac147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91aa59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f91ac0b5ba0 0x7f91ac147890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:51864/0 (socket says 172.21.15.31:51864) 2023-11-27T17:53:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91aa59c640 1 -- 172.21.15.31:0/2243831451 learned_addr learned my addr 172.21.15.31:0/2243831451 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a54fb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95a00ba830 0x7f95a00b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a4cfa640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95a0148160 0x7f95a00b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a4cfa640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95a0148160 0x7f95a00b99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:38864/0 (socket says 172.21.15.31:38864) 2023-11-27T17:53:30.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a54fb640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f95a00ba830 0x7f95a00b47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:51878/0 (socket says 172.21.15.31:51878) 2023-11-27T17:53:30.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91aad9d640 1 --2- 172.21.15.31:0/2243831451 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f91ac0b5030 0x7f91ac0721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a4cfa640 1 -- 172.21.15.31:0/797833812 learned_addr learned my addr 172.21.15.31:0/797833812 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:30.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a775f640 1 -- 172.21.15.31:0/797833812 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a00b4da0 con 0x7f95a00714b0 2023-11-27T17:53:30.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a775f640 1 -- 172.21.15.31:0/797833812 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a0071ef0 con 0x7f95a00ba830 2023-11-27T17:53:30.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a775f640 1 -- 172.21.15.31:0/797833812 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0070430 con 0x7f95a0148160 2023-11-27T17:53:30.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fb36733e640 1 -- start start 2023-11-27T17:53:30.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fb36733e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb358038f60 0x7fb3580ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fb36733e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35803e090 con 0x7fb358007130 2023-11-27T17:53:30.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fb36733e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35803ec30 con 0x7fb3580cf2d0 2023-11-27T17:53:30.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fb36733e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35803a7a0 con 0x7fb358038f60 2023-11-27T17:53:30.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fb365b3b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb358038f60 0x7fb3580ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fb365b3b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb358038f60 0x7fb3580ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:51886/0 (socket says 172.21.15.31:51886) 2023-11-27T17:53:30.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fb365b3b640 1 -- 172.21.15.31:0/1869318677 learned_addr learned my addr 172.21.15.31:0/1869318677 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:30.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fd5e4922640 1 --2- 172.21.15.31:0/531452605 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5e00b9c10 0x7fd5e0153ab0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40097c0 tx=0x7fd5d401eab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d66dfd48c46afe8b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbced252640 1 -- start start 2023-11-27T17:53:30.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbced252640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbce0004a10 0x7fbce00d88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbced252640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce00d5370 con 0x7fbce00d5dc0 2023-11-27T17:53:30.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbced252640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce003bfb0 con 0x7fbce003c780 2023-11-27T17:53:30.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbced252640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce00d6270 con 0x7fbce0004a10 2023-11-27T17:53:30.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbce7fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbce003c780 0x7fbce00cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.31:48134/0 (socket says 172.21.15.31:48134) 2023-11-27T17:53:30.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbce7fff640 1 -- 172.21.15.31:0/1901712434 learned_addr learned my addr 172.21.15.31:0/1901712434 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:30.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a4cfa640 1 -- 172.21.15.31:0/797833812 >> v2:172.21.15.81:3300/0 conn(0x7f95a00ba830 msgr2=0x7f95a00b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:30.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a4cfa640 1 --2- 172.21.15.31:0/797833812 >> v2:172.21.15.81:3300/0 conn(0x7f95a00ba830 0x7f95a00b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a4cfa640 1 -- 172.21.15.31:0/797833812 >> v2:172.21.15.31:3300/0 conn(0x7f95a00714b0 msgr2=0x7f95a0141ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-27T17:53:30.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a4cfa640 1 --2- 172.21.15.31:0/797833812 >> v2:172.21.15.31:3300/0 conn(0x7f95a00714b0 0x7f95a0141ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a4cfa640 1 -- 172.21.15.31:0/797833812 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0070710 con 0x7f95a0148160 2023-11-27T17:53:30.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91aa59c640 1 -- 172.21.15.31:0/2243831451 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f91ac0b5030 msgr2=0x7f91ac0721f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:30.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91aa59c640 1 --2- 172.21.15.31:0/2243831451 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f91ac0b5030 0x7f91ac0721f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91aa59c640 1 -- 172.21.15.31:0/2243831451 >> v1:172.21.15.31:6789/0 conn(0x7f91ac071db0 legacy=0x7f91ac0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:30.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f91aa59c640 1 -- 172.21.15.31:0/2243831451 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac06f1d0 con 0x7f91ac0b5ba0 2023-11-27T17:53:30.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbce77fe640 1 --2- 172.21.15.31:0/1901712434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbce0004a10 0x7fbce00d88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f95a54fb640 1 --2- 172.21.15.31:0/797833812 >> v2:172.21.15.81:3300/0 conn(0x7f95a00ba830 0x7f95a00b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:30.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f7f8effd640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f78005180 0x7f7f78003770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f84007ec0 tx=0x7f7f8401c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59453f14bd4d5d3d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbce6ffd640 1 -- 172.21.15.31:0/1901712434 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795302613 0 0) 0x7fbce003bfb0 con 0x7fbce003c780 2023-11-27T17:53:30.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbce6ffd640 1 -- 172.21.15.31:0/1901712434 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd8003530 con 0x7fbce003c780 2023-11-27T17:53:30.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fd5deffd640 1 -- 172.21.15.31:0/531452605 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0001830 con 0x7fd5e00b9c10 2023-11-27T17:53:30.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fafb7fff640 1 -- 172.21.15.31:0/3872293559 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb806f1d0 con 0x7fafb80b9630 2023-11-27T17:53:30.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fafb77fe640 1 --2- 172.21.15.31:0/3872293559 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafb80b5b10 0x7fafb8071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:30.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840a57f0 con 0x7f7f78005180 2023-11-27T17:53:30.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fb365b3b640 1 -- 172.21.15.31:0/1869318677 >> v1:172.21.15.81:6789/0 conn(0x7fb3580cf2d0 legacy=0x7fb3580dff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fb365b3b640 1 -- 172.21.15.31:0/1869318677 >> v1:172.21.15.31:6789/0 conn(0x7fb358007130 legacy=0x7fb35803e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:30.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fb365b3b640 1 -- 172.21.15.31:0/1869318677 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35803aa80 con 0x7fb358038f60 2023-11-27T17:53:30.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f840a5950 con 0x7f7f78005180 2023-11-27T17:53:30.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7f7f8e7fc640 1 -- 172.21.15.31:0/2775939952 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f840a5d00 con 0x7f7f78005180 2023-11-27T17:53:30.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fd5deffd640 1 -- 172.21.15.31:0/531452605 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d40a8530 con 0x7fd5e00b9c10 2023-11-27T17:53:30.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fd5deffd640 1 -- 172.21.15.31:0/531452605 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40a88c0 con 0x7fd5e00b9c10 2023-11-27T17:53:30.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbce77fe640 1 -- 172.21.15.31:0/1901712434 >> v1:172.21.15.81:6789/0 conn(0x7fbce003c780 legacy=0x7fbce00cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbce77fe640 1 -- 172.21.15.31:0/1901712434 >> v1:172.21.15.31:6789/0 conn(0x7fbce00d5dc0 legacy=0x7fbce00dfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fbce77fe640 1 -- 172.21.15.31:0/1901712434 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce003cb60 con 0x7fbce0004a10 2023-11-27T17:53:30.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fd5e6385640 1 -- 172.21.15.31:0/531452605 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5e00b9c10 msgr2=0x7fd5e0153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.505+0000 7fd5e6385640 1 --2- 172.21.15.31:0/531452605 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5e00b9c10 0x7fd5e0153ab0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40097c0 tx=0x7fd5d401eab0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fafb7fff640 1 --2- 172.21.15.31:0/3872293559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb80b9630 0x7fafb8147890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fafa80097f0 tx=0x7fafa801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217040bb9b934e4c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 -- 172.21.15.31:0/531452605 shutdown_connections 2023-11-27T17:53:30.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 --2- 172.21.15.31:0/531452605 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5e00b9c10 0x7fd5e0153ab0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 --2- 172.21.15.31:0/531452605 >> v2:172.21.15.31:3300/0 conn(0x7fd5e00b9830 0x7fd5e006f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 -- 172.21.15.31:0/531452605 >> 172.21.15.31:0/531452605 conn(0x7fd5e006a730 msgr2=0x7fd5e006ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f91aa59c640 1 --2- 172.21.15.31:0/2243831451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91ac0b5ba0 0x7f91ac147890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9194008870 tx=0x7f919401e9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc2d1b87fa5d0e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fafb6ffd640 1 -- 172.21.15.31:0/3872293559 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80a8970 con 0x7fafb80b9630 2023-11-27T17:53:30.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fafb6ffd640 1 -- 172.21.15.31:0/3872293559 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa80a8ad0 con 0x7fafb80b9630 2023-11-27T17:53:30.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fafb6ffd640 1 -- 172.21.15.31:0/3872293559 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80a8e60 con 0x7fafb80b9630 2023-11-27T17:53:30.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f95a4cfa640 1 --2- 172.21.15.31:0/797833812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95a0148160 0x7f95a00b99b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f95a00bebd0 tx=0x7f959c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2efa2ccf993fd5f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fafbe6bc640 1 -- 172.21.15.31:0/3872293559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb80b9630 msgr2=0x7fafb8147890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fafbe6bc640 1 --2- 172.21.15.31:0/3872293559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb80b9630 0x7fafb8147890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fafa80097f0 tx=0x7fafa801ec70 comp rx=0 tx=0).stop 2023-11-27T17:53:30.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f7f95c75640 1 -- 172.21.15.31:0/2775939952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f78005180 msgr2=0x7f7f78003770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f7f95c75640 1 --2- 172.21.15.31:0/2775939952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f78005180 0x7f7f78003770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7f84007ec0 tx=0x7f7f8401c9e0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 -- 172.21.15.31:0/531452605 shutdown_connections 2023-11-27T17:53:30.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fafbe6bc640 1 -- 172.21.15.31:0/3872293559 shutdown_connections 2023-11-27T17:53:30.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fafbe6bc640 1 --2- 172.21.15.31:0/3872293559 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafb80b5b10 0x7fafb8071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fafbe6bc640 1 --2- 172.21.15.31:0/3872293559 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb80b9630 0x7fafb8147890 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fafbe6bc640 1 -- 172.21.15.31:0/3872293559 >> 172.21.15.31:0/3872293559 conn(0x7fafb806a730 msgr2=0x7fafb806ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f9597fff640 1 -- 172.21.15.31:0/797833812 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0ad660 con 0x7f95a0148160 2023-11-27T17:53:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f7f8ffff640 1 -- 172.21.15.31:0/2775939952 reap_dead start 2023-11-27T17:53:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f9597fff640 1 -- 172.21.15.31:0/797833812 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c0ad7c0 con 0x7f95a0148160 2023-11-27T17:53:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f9597fff640 1 -- 172.21.15.31:0/797833812 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0adb50 con 0x7f95a0148160 2023-11-27T17:53:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f91a959a640 1 -- 172.21.15.31:0/2243831451 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91940a7810 con 0x7f91ac0b5ba0 2023-11-27T17:53:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f91a959a640 1 -- 172.21.15.31:0/2243831451 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91940ab070 con 0x7f91ac0b5ba0 2023-11-27T17:53:30.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f91a959a640 1 -- 172.21.15.31:0/2243831451 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91940a7b90 con 0x7f91ac0b5ba0 2023-11-27T17:53:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f7f95c75640 1 -- 172.21.15.31:0/2775939952 shutdown_connections 2023-11-27T17:53:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f7f95c75640 1 -- 172.21.15.31:0/2775939952 >> 172.21.15.31:0/2775939952 conn(0x7f7f9006a730 msgr2=0x7f7f9006ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fb365b3b640 1 --2- 172.21.15.31:0/1869318677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358038f60 0x7fb3580ced90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0098a0 tx=0x7fb35c01c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af71841c4d6d86e4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2243831451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91ac0b5ba0 msgr2=0x7f91ac147890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f91b0ba4640 1 --2- 172.21.15.31:0/2243831451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91ac0b5ba0 0x7f91ac147890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9194008870 tx=0x7f919401e9a0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f95a775f640 1 -- 172.21.15.31:0/797833812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95a0148160 msgr2=0x7f95a00b99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f95a775f640 1 --2- 172.21.15.31:0/797833812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95a0148160 0x7f95a00b99b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f95a00bebd0 tx=0x7f959c01c450 comp rx=0 tx=0).stop 2023-11-27T17:53:30.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fb36533a640 1 -- 172.21.15.31:0/1869318677 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35c0ac410 con 0x7fb358038f60 2023-11-27T17:53:30.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fb36533a640 1 -- 172.21.15.31:0/1869318677 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35c0ac570 con 0x7fb358038f60 2023-11-27T17:53:30.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fb36733e640 1 -- 172.21.15.31:0/1869318677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358038f60 msgr2=0x7fb3580ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fb36733e640 1 --2- 172.21.15.31:0/1869318677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358038f60 0x7fb3580ced90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0098a0 tx=0x7fb35c01c500 comp rx=0 tx=0).stop 2023-11-27T17:53:30.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 -- 172.21.15.31:0/1869318677 shutdown_connections 2023-11-27T17:53:30.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 --2- 172.21.15.31:0/1869318677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb358038f60 0x7fb3580ced90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 -- 172.21.15.31:0/1869318677 >> 172.21.15.31:0/1869318677 conn(0x7fb35803ee00 msgr2=0x7fb35803f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f7f95c75640 1 -- 172.21.15.31:0/2775939952 shutdown_connections 2023-11-27T17:53:30.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f7f95c75640 1 -- 172.21.15.31:0/2775939952 wait complete. 2023-11-27T17:53:30.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f95c75640 1 Processor -- start 2023-11-27T17:53:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 -- 172.21.15.31:0/531452605 wait complete. 2023-11-27T17:53:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 Processor -- start 2023-11-27T17:53:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 -- start start 2023-11-27T17:53:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5e00716c0 0x7fd5e00b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5e00b9830 0x7fd5e0136550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e00b9c10 0x7fd5e00b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00b84d0 con 0x7fd5e00b9c10 2023-11-27T17:53:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00b9160 con 0x7fd5e00716c0 2023-11-27T17:53:30.539 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fd5e6385640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00b7e10 con 0x7fd5e00b9830 2023-11-27T17:53:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fbce77fe640 1 --2- 172.21.15.31:0/1901712434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbce0004a10 0x7fbce00d88b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40097f0 tx=0x7fbcd401ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=684a70343cf1834 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fbce6ffd640 1 -- 172.21.15.31:0/1901712434 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40a89b0 con 0x7fbce0004a10 2023-11-27T17:53:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fbce6ffd640 1 -- 172.21.15.31:0/1901712434 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd40a8b10 con 0x7fbce0004a10 2023-11-27T17:53:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fbce6ffd640 1 -- 172.21.15.31:0/1901712434 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd40a8ea0 con 0x7fbce0004a10 2023-11-27T17:53:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f95a775f640 1 -- 172.21.15.31:0/797833812 shutdown_connections 2023-11-27T17:53:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f95a775f640 1 --2- 172.21.15.31:0/797833812 >> v2:172.21.15.31:3300/0 conn(0x7f95a00714b0 0x7f95a0141ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f95a775f640 1 --2- 172.21.15.31:0/797833812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95a0148160 0x7f95a00b99b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.540 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f95a775f640 1 --2- 172.21.15.31:0/797833812 >> v2:172.21.15.81:3300/0 conn(0x7f95a00ba830 0x7f95a00b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f95a775f640 1 -- 172.21.15.31:0/797833812 >> 172.21.15.31:0/797833812 conn(0x7f95a006e8a0 msgr2=0x7f95a006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f95a775f640 1 -- 172.21.15.31:0/797833812 shutdown_connections 2023-11-27T17:53:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f95a775f640 1 -- 172.21.15.31:0/797833812 wait complete. 2023-11-27T17:53:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a775f640 1 Processor -- start 2023-11-27T17:53:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fafbe6bc640 1 -- 172.21.15.31:0/3872293559 shutdown_connections 2023-11-27T17:53:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7fafbe6bc640 1 -- 172.21.15.31:0/3872293559 wait complete. 2023-11-27T17:53:30.541 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafbe6bc640 1 Processor -- start 2023-11-27T17:53:30.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2243831451 shutdown_connections 2023-11-27T17:53:30.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f91b0ba4640 1 --2- 172.21.15.31:0/2243831451 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f91ac0b5030 0x7f91ac0721f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f91b0ba4640 1 --2- 172.21.15.31:0/2243831451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91ac0b5ba0 0x7f91ac147890 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9194008870 tx=0x7f919401e9a0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.509+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2243831451 >> 172.21.15.31:0/2243831451 conn(0x7f91ac06a730 msgr2=0x7f91ac06ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.542 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a775f640 1 -- start start 2023-11-27T17:53:30.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5dffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5e00716c0 0x7fd5e00b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5df7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5e00b9830 0x7fd5e0136550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fbced252640 1 -- 172.21.15.31:0/1901712434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbce0004a10 msgr2=0x7fbce00d88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fbced252640 1 --2- 172.21.15.31:0/1901712434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbce0004a10 0x7fbce00d88b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40097f0 tx=0x7fbcd401ecb0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 -- 172.21.15.31:0/1869318677 shutdown_connections 2023-11-27T17:53:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5df7fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5e00b9830 0x7fd5e0136550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:38878/0 (socket says 172.21.15.31:38878) 2023-11-27T17:53:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5df7fe640 1 -- 172.21.15.31:0/2692816114 learned_addr learned my addr 172.21.15.31:0/2692816114 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5e4922640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e00b9c10 0x7fd5e00b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.544 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 -- 172.21.15.31:0/1869318677 wait complete. 2023-11-27T17:53:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f95c75640 1 -- start start 2023-11-27T17:53:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f95c75640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f78005180 0x7f7f9013abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f95c75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f90147d40 0x7f7f90139200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f95c75640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900716d0 0x7f7f90146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f95c75640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90138d70 con 0x7f7f78005180 2023-11-27T17:53:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f95c75640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9013b120 con 0x7f7f90147d40 2023-11-27T17:53:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f95c75640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9013a550 con 0x7f7f900716d0 2023-11-27T17:53:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5e4922640 1 -- 172.21.15.31:0/2692816114 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5e00b9830 msgr2=0x7fd5e0136550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.545 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5e4922640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5e00b9830 0x7fd5e0136550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5e4922640 1 -- 172.21.15.31:0/2692816114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5e00716c0 msgr2=0x7fd5e00b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5e4922640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5e00716c0 0x7fd5e00b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5e4922640 1 -- 172.21.15.31:0/2692816114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d4009420 con 0x7fd5e00b9c10 2023-11-27T17:53:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5e4922640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e00b9c10 0x7fd5e00b7430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40af000 tx=0x7fd5d401b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a775f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95a00714b0 0x7f95a00b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a775f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95a00ba830 0x7f95a01e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a775f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a0148160 0x7f95a0149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.546 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a775f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a01e3810 con 0x7f95a0148160 2023-11-27T17:53:30.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a775f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0134bf0 con 0x7f95a00714b0 2023-11-27T17:53:30.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a775f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0149ea0 con 0x7f95a00ba830 2023-11-27T17:53:30.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a5cfc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a0148160 0x7f95a0149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a5cfc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a0148160 0x7f95a0149960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51282/0 (socket says 172.21.15.31:51282) 2023-11-27T17:53:30.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a5cfc640 1 -- 172.21.15.31:0/135594114 learned_addr learned my addr 172.21.15.31:0/135594114 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:30.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafbe6bc640 1 -- start start 2023-11-27T17:53:30.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafbe6bc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafb80722f0 0x7fafb8144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafbe6bc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb80b5b10 0x7fafb814a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.547 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafbe6bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb80b9630 0x7fafb8139280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafbe6bc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81550c0 con 0x7fafb80b5b10 2023-11-27T17:53:30.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafbe6bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb81445a0 con 0x7fafb80b9630 2023-11-27T17:53:30.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafbe6bc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb8154cd0 con 0x7fafb80722f0 2023-11-27T17:53:30.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a4cfa640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95a00ba830 0x7f95a01e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a54fb640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95a00714b0 0x7f95a00b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.548 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f8f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f78005180 0x7f7f9013abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f8f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f78005180 0x7f7f9013abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51268/0 (socket says 172.21.15.31:51268) 2023-11-27T17:53:30.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f8f7fe640 1 -- 172.21.15.31:0/577612654 learned_addr learned my addr 172.21.15.31:0/577612654 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:30.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f8ffff640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900716d0 0x7f7f90146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f8f7fe640 1 -- 172.21.15.31:0/577612654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900716d0 msgr2=0x7f7f90146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f8f7fe640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900716d0 0x7f7f90146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f8f7fe640 1 -- 172.21.15.31:0/577612654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f90147d40 msgr2=0x7f7f90139200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-27T17:53:30.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f8f7fe640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f90147d40 0x7f7f90139200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f8f7fe640 1 -- 172.21.15.31:0/577612654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f901381a0 con 0x7f7f78005180 2023-11-27T17:53:30.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafb7fff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafb80722f0 0x7fafb8144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafb77fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb80b5b10 0x7fafb814a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafb77fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb80b5b10 0x7fafb814a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51294/0 (socket says 172.21.15.31:51294) 2023-11-27T17:53:30.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafb77fe640 1 -- 172.21.15.31:0/2131827754 learned_addr learned my addr 172.21.15.31:0/2131827754 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:30.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafbcc59640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb80b9630 0x7fafb8139280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fbced252640 1 -- 172.21.15.31:0/1901712434 shutdown_connections 2023-11-27T17:53:30.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fbced252640 1 --2- 172.21.15.31:0/1901712434 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbce0004a10 0x7fbce00d88b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fbced252640 1 -- 172.21.15.31:0/1901712434 >> 172.21.15.31:0/1901712434 conn(0x7fbce0006310 msgr2=0x7fbce0006720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fbced252640 1 -- 172.21.15.31:0/1901712434 shutdown_connections 2023-11-27T17:53:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5dcff9640 1 -- 172.21.15.31:0/2692816114 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40b0640 con 0x7fd5e00b9c10 2023-11-27T17:53:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5dcff9640 1 -- 172.21.15.31:0/2692816114 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d40b07a0 con 0x7fd5e00b9c10 2023-11-27T17:53:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5dcff9640 1 -- 172.21.15.31:0/2692816114 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d40b0b30 con 0x7fd5e00b9c10 2023-11-27T17:53:30.551 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f8f7fe640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f78005180 0x7f7f9013abe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f88011e60 tx=0x7f7f8800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5e6385640 1 -- 172.21.15.31:0/2692816114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e00b80f0 con 0x7fd5e00b9c10 2023-11-27T17:53:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fd5e6385640 1 -- 172.21.15.31:0/2692816114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e00b4030 con 0x7fd5e00b9c10 2023-11-27T17:53:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a5cfc640 1 -- 172.21.15.31:0/135594114 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95a00ba830 msgr2=0x7f95a01e32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a5cfc640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95a00ba830 0x7f95a01e32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a5cfc640 1 -- 172.21.15.31:0/135594114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95a00714b0 msgr2=0x7f95a00b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a5cfc640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95a00714b0 0x7f95a00b74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a5cfc640 1 -- 172.21.15.31:0/135594114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c0094d0 con 0x7f95a0148160 2023-11-27T17:53:30.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f77fff640 1 -- 172.21.15.31:0/577612654 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800e040 con 0x7f7f78005180 2023-11-27T17:53:30.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f77fff640 1 -- 172.21.15.31:0/577612654 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8800f040 con 0x7f7f78005180 2023-11-27T17:53:30.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f77fff640 1 -- 172.21.15.31:0/577612654 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88015850 con 0x7f7f78005180 2023-11-27T17:53:30.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a5cfc640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a0148160 0x7f95a0149960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f959000b440 tx=0x7f959000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 Processor -- start 2023-11-27T17:53:30.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f9595ffb640 1 -- 172.21.15.31:0/135594114 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590011890 con 0x7f95a0148160 2023-11-27T17:53:30.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f9595ffb640 1 -- 172.21.15.31:0/135594114 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95900119f0 con 0x7f95a0148160 2023-11-27T17:53:30.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f9595ffb640 1 -- 172.21.15.31:0/135594114 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9590011da0 con 0x7f95a0148160 2023-11-27T17:53:30.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a775f640 1 -- 172.21.15.31:0/135594114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a00b70a0 con 0x7f95a0148160 2023-11-27T17:53:30.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f95a775f640 1 -- 172.21.15.31:0/135594114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a01e3ca0 con 0x7f95a0148160 2023-11-27T17:53:30.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafb7fff640 1 -- 172.21.15.31:0/2131827754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb80b9630 msgr2=0x7fafb8139280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafb7fff640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb80b9630 0x7fafb8139280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafb7fff640 1 -- 172.21.15.31:0/2131827754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb80b5b10 msgr2=0x7fafb814a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafb7fff640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb80b5b10 0x7fafb814a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fafb7fff640 1 -- 172.21.15.31:0/2131827754 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa8009420 con 0x7fafb80722f0 2023-11-27T17:53:30.555 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 -- start start 2023-11-27T17:53:30.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fbced252640 1 -- 172.21.15.31:0/1901712434 wait complete. 2023-11-27T17:53:30.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbced252640 1 Processor -- start 2023-11-27T17:53:30.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb358007130 0x7fb3580ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb358038f60 0x7fb358038260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3580cf2d0 0x7fb3580387a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580cd240 con 0x7fb358007130 2023-11-27T17:53:30.556 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580d3cc0 con 0x7fb3580cf2d0 2023-11-27T17:53:30.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7fb36733e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580d53c0 con 0x7fb358038f60 2023-11-27T17:53:30.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f95c75640 1 -- 172.21.15.31:0/577612654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f900b34e0 con 0x7f7f78005180 2023-11-27T17:53:30.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.513+0000 7f7f95c75640 1 -- 172.21.15.31:0/577612654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f90138440 con 0x7f7f78005180 2023-11-27T17:53:30.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fafb7fff640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafb80722f0 0x7fafb8144060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fafa80af000 tx=0x7fafa801ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb366b3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3580cf2d0 0x7fb3580387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb366b3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3580cf2d0 0x7fb3580387a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:51944/0 (socket says 172.21.15.31:51944) 2023-11-27T17:53:30.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb366b3d640 1 -- 172.21.15.31:0/3297854782 learned_addr learned my addr 172.21.15.31:0/3297854782 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:30.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2243831451 shutdown_connections 2023-11-27T17:53:30.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb365b3b640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb358038f60 0x7fb358038260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb36633c640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb358007130 0x7fb3580ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f95a775f640 1 -- 172.21.15.31:0/135594114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9580005260 con 0x7f95a0148160 2023-11-27T17:53:30.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f7f95c75640 1 -- 172.21.15.31:0/577612654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f9004e850 con 0x7f7f78005180 2023-11-27T17:53:30.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb366b3d640 1 -- 172.21.15.31:0/3297854782 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb358038f60 msgr2=0x7fb358038260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb366b3d640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb358038f60 0x7fb358038260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb366b3d640 1 -- 172.21.15.31:0/3297854782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb358007130 msgr2=0x7fb3580ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb366b3d640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb358007130 0x7fb3580ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb366b3d640 1 -- 172.21.15.31:0/3297854782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c0094d0 con 0x7fb3580cf2d0 2023-11-27T17:53:30.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb36633c640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb358007130 0x7fb3580ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:30.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2243831451 wait complete. 2023-11-27T17:53:30.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb366b3d640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3580cf2d0 0x7fb3580387a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb36002cef0 tx=0x7fb360067fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fd5e6385640 1 -- 172.21.15.31:0/2692816114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e004e850 con 0x7fd5e00b9c10 2023-11-27T17:53:30.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fafb4ff9640 1 -- 172.21.15.31:0/2131827754 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80a8970 con 0x7fafb80722f0 2023-11-27T17:53:30.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fafb4ff9640 1 -- 172.21.15.31:0/2131827754 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa80b9410 con 0x7fafb80722f0 2023-11-27T17:53:30.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fafb4ff9640 1 -- 172.21.15.31:0/2131827754 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80b9800 con 0x7fafb80722f0 2023-11-27T17:53:30.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fafbe6bc640 1 -- 172.21.15.31:0/2131827754 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb81549f0 con 0x7fafb80722f0 2023-11-27T17:53:30.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fafbe6bc640 1 -- 172.21.15.31:0/2131827754 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb814a4b0 con 0x7fafb80722f0 2023-11-27T17:53:30.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb356ffd640 1 -- 172.21.15.31:0/3297854782 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360092400 con 0x7fb3580cf2d0 2023-11-27T17:53:30.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbced252640 1 -- start start 2023-11-27T17:53:30.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbced252640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce0004a10 0x7fbce00d4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbced252640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbce003c780 0x7fbce0036b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbced252640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbce00d5dc0 0x7fbce0037a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbced252640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce016ec90 con 0x7fbce00d5dc0 2023-11-27T17:53:30.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbced252640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce00d48b0 con 0x7fbce0004a10 2023-11-27T17:53:30.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbced252640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce016e1e0 con 0x7fbce003c780 2023-11-27T17:53:30.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbce7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce0004a10 0x7fbce00d4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbce7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce0004a10 0x7fbce00d4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:51958/0 (socket says 172.21.15.31:51958) 2023-11-27T17:53:30.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbce7fff640 1 -- 172.21.15.31:0/2465429127 learned_addr learned my addr 172.21.15.31:0/2465429127 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:30.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbce77fe640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbce003c780 0x7fbce0036b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91b0ba4640 1 Processor -- start 2023-11-27T17:53:30.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbce7fff640 1 -- 172.21.15.31:0/2465429127 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbce003c780 msgr2=0x7fbce0036b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbce7fff640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbce003c780 0x7fbce0036b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbce7fff640 1 -- 172.21.15.31:0/2465429127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbce00d5dc0 msgr2=0x7fbce0037a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-27T17:53:30.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbce7fff640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbce00d5dc0 0x7fbce0037a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbce7fff640 1 -- 172.21.15.31:0/2465429127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd4009420 con 0x7fbce0004a10 2023-11-27T17:53:30.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91b0ba4640 1 -- start start 2023-11-27T17:53:30.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbce7fff640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce0004a10 0x7fbce00d4340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00c4d0 tx=0x7fbcdc00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91b0ba4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91ac071db0 0x7f91ac148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91b0ba4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f91ac0b5030 0x7f91ac0bae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91b0ba4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91ac0b22e0 0x7f91ac140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91b0ba4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0bb3b0 con 0x7f91ac071db0 2023-11-27T17:53:30.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91b0ba4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac13fc00 con 0x7f91ac0b22e0 2023-11-27T17:53:30.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91b0ba4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0b3700 con 0x7f91ac0b5030 2023-11-27T17:53:30.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f9595ffb640 1 -- 172.21.15.31:0/135594114 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f959001a400 con 0x7f95a0148160 2023-11-27T17:53:30.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f9595ffb640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f95840668c0 0x7f9584068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f9595ffb640 1 -- 172.21.15.31:0/135594114 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9590084450 con 0x7f95a0148160 2023-11-27T17:53:30.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f95a54fb640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f95840668c0 0x7f9584068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb356ffd640 1 -- 172.21.15.31:0/3297854782 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3600925a0 con 0x7fb3580cf2d0 2023-11-27T17:53:30.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb356ffd640 1 -- 172.21.15.31:0/3297854782 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360092950 con 0x7fb3580cf2d0 2023-11-27T17:53:30.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb36733e640 1 -- 172.21.15.31:0/3297854782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3580d56a0 con 0x7fb3580cf2d0 2023-11-27T17:53:30.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb36733e640 1 -- 172.21.15.31:0/3297854782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3580d6220 con 0x7fb3580cf2d0 2023-11-27T17:53:30.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fb36733e640 1 -- 172.21.15.31:0/3297854782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb358008180 con 0x7fb3580cf2d0 2023-11-27T17:53:30.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91a9d9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f91ac0b5030 0x7f91ac0bae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91aa59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91ac071db0 0x7f91ac148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91aa59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91ac071db0 0x7f91ac148500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51308/0 (socket says 172.21.15.31:51308) 2023-11-27T17:53:30.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91aa59c640 1 -- 172.21.15.31:0/2614320706 learned_addr learned my addr 172.21.15.31:0/2614320706 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:30.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7f91aad9d640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91ac0b22e0 0x7f91ac140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.517+0000 7fbce4ff9640 1 -- 172.21.15.31:0/2465429127 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc005cf0 con 0x7fbce0004a10 2023-11-27T17:53:30.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7f95a54fb640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f95840668c0 0x7f9584068d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f959800d620 tx=0x7f9598007810 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7f7f77fff640 1 -- 172.21.15.31:0/577612654 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f7f880159b0 con 0x7f7f78005180 2023-11-27T17:53:30.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7f7f77fff640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7f7c0668c0 0x7f7f7c068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7f7f77fff640 1 -- 172.21.15.31:0/577612654 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f88085620 con 0x7f7f78005180 2023-11-27T17:53:30.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7f7f8effd640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7f7c0668c0 0x7f7f7c068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fd5dcff9640 1 -- 172.21.15.31:0/2692816114 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fd5d40b7040 con 0x7fd5e00b9c10 2023-11-27T17:53:30.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fbced252640 1 -- 172.21.15.31:0/2465429127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce0036380 con 0x7fbce0004a10 2023-11-27T17:53:30.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fbced252640 1 -- 172.21.15.31:0/2465429127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce016e740 con 0x7fbce0004a10 2023-11-27T17:53:30.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fbced252640 1 -- 172.21.15.31:0/2465429127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce00056f0 con 0x7fbce0004a10 2023-11-27T17:53:30.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7f7f8effd640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7f7c0668c0 0x7f7f7c068d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f840af000 tx=0x7f7f840a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fbce4ff9640 1 -- 172.21.15.31:0/2465429127 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc005e50 con 0x7fbce0004a10 2023-11-27T17:53:30.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fbce4ff9640 1 -- 172.21.15.31:0/2465429127 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc007270 con 0x7fbce0004a10 2023-11-27T17:53:30.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fd5dcff9640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd5cc0668f0 0x7fd5cc068db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fd5dcff9640 1 -- 172.21.15.31:0/2692816114 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5d4121d70 con 0x7fd5e00b9c10 2023-11-27T17:53:30.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fb356ffd640 1 -- 172.21.15.31:0/3297854782 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb36009b3f0 con 0x7fb3580cf2d0 2023-11-27T17:53:30.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fb356ffd640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb344066840 0x7fb344068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fb356ffd640 1 -- 172.21.15.31:0/3297854782 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3600fe1e0 con 0x7fb3580cf2d0 2023-11-27T17:53:30.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fd5dffff640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd5cc0668f0 0x7fd5cc068db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7f91a9d9b640 1 -- 172.21.15.31:0/2614320706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91ac0b22e0 msgr2=0x7f91ac140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7f91a9d9b640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91ac0b22e0 0x7f91ac140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7f91a9d9b640 1 -- 172.21.15.31:0/2614320706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91ac071db0 msgr2=0x7f91ac148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7f91a9d9b640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91ac071db0 0x7f91ac148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7f91a9d9b640 1 -- 172.21.15.31:0/2614320706 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9194008550 con 0x7f91ac0b5030 2023-11-27T17:53:30.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fd5dffff640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd5cc0668f0 0x7fd5cc068db0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800a400 tx=0x7fd5d800d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7f91a9d9b640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f91ac0b5030 0x7f91ac0bae70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f919c00c360 tx=0x7f919c00c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fb36633c640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb344066840 0x7fb344068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fb36633c640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb344066840 0x7fb344068d00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb350007fd0 tx=0x7fb350009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fafb4ff9640 1 -- 172.21.15.31:0/2131827754 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fafa80b7040 con 0x7fafb80722f0 2023-11-27T17:53:30.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fafb4ff9640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7faf980668c0 0x7faf98068d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fafb4ff9640 1 -- 172.21.15.31:0/2131827754 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafa81218c0 con 0x7fafb80722f0 2023-11-27T17:53:30.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.521+0000 7fafb77fe640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7faf980668c0 0x7faf98068d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.525+0000 7f91a2ffd640 1 -- 172.21.15.31:0/2614320706 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c003600 con 0x7f91ac0b5030 2023-11-27T17:53:30.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.525+0000 7fafb77fe640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7faf980668c0 0x7faf98068d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fafb8144760 tx=0x7fafa0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.525+0000 7fd5dcff9640 1 -- 172.21.15.31:0/2692816114 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fd5d40ef000 con 0x7fd5e00b9c10 2023-11-27T17:53:30.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.525+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2614320706 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac0b2770 con 0x7f91ac0b5030 2023-11-27T17:53:30.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.525+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2614320706 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac0b2d30 con 0x7f91ac0b5030 2023-11-27T17:53:30.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.525+0000 7f91a2ffd640 1 -- 172.21.15.31:0/2614320706 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919c003760 con 0x7f91ac0b5030 2023-11-27T17:53:30.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.525+0000 7f91a2ffd640 1 -- 172.21.15.31:0/2614320706 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c003b10 con 0x7f91ac0b5030 2023-11-27T17:53:30.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.525+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2614320706 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9190005260 con 0x7f91ac0b5030 2023-11-27T17:53:30.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.525+0000 7f91a2ffd640 1 -- 172.21.15.31:0/2614320706 <== mon.2 v2:172.21.15.81:3301/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f919c003c70 con 0x7f91ac0b5030 2023-11-27T17:53:30.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.525+0000 7f91a2ffd640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f918c066840 0x7f918c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.525+0000 7f91aa59c640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f918c066840 0x7f918c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.525+0000 7f91a2ffd640 1 -- 172.21.15.31:0/2614320706 <== mon.2 v2:172.21.15.81:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f919c083a40 con 0x7f91ac0b5030 2023-11-27T17:53:30.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.529+0000 7fafbe6bc640 1 -- 172.21.15.31:0/2131827754 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb814a6a0 con 0x7fafb80722f0 2023-11-27T17:53:30.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.529+0000 7f91aa59c640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f918c066840 0x7f918c068d00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f919401c5d0 tx=0x7f919400a040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.529+0000 7f7f77fff640 1 -- 172.21.15.31:0/577612654 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f7f88052700 con 0x7f7f78005180 2023-11-27T17:53:30.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.533+0000 7fb356ffd640 1 -- 172.21.15.31:0/3297854782 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb3600cb500 con 0x7fb3580cf2d0 2023-11-27T17:53:30.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.537+0000 7fbce4ff9640 1 -- 172.21.15.31:0/2465429127 <== mon.1 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fbcdc0073d0 con 0x7fbce0004a10 2023-11-27T17:53:30.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.537+0000 7fbce4ff9640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbcd8066c00 0x7fbcd80690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:30.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.537+0000 7f9595ffb640 1 -- 172.21.15.31:0/135594114 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9590051670 con 0x7f95a0148160 2023-11-27T17:53:30.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.537+0000 7fbce77fe640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbcd8066c00 0x7fbcd80690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:30.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.537+0000 7fbce77fe640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbcd8066c00 0x7fbcd80690c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40b2000 tx=0x7fbcd4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:30.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.537+0000 7fbce4ff9640 1 -- 172.21.15.31:0/2465429127 <== mon.1 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbcdc083c60 con 0x7fbce0004a10 2023-11-27T17:53:30.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.537+0000 7f91a2ffd640 1 -- 172.21.15.31:0/2614320706 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f919c050d60 con 0x7f91ac0b5030 2023-11-27T17:53:30.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.545+0000 7fbce4ff9640 1 -- 172.21.15.31:0/2465429127 <== mon.1 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fbcdc050e80 con 0x7fbce0004a10 2023-11-27T17:53:30.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.549+0000 7fafb4ff9640 1 -- 172.21.15.31:0/2131827754 <== mon.2 v2:172.21.15.81:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fafa80eec00 con 0x7fafb80722f0 2023-11-27T17:53:30.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.785+0000 7fb110ada640 1 -- 172.21.15.31:0/2561727937 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb0f0005510 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.785+0000 7fb0faffd640 1 -- 172.21.15.31:0/2561727937 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb104050c70 con 0x7fb10c0b2bc0 2023-11-27T17:53:30.791 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-11-27T17:53:30.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.789+0000 7fb0f8ff9640 1 -- 172.21.15.31:0/2561727937 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb0ec066870 msgr2=0x7fb0ec068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.789+0000 7fb0f8ff9640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb0ec066870 0x7fb0ec068d30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb100009bb0 tx=0x7fb100008040 comp rx=0 tx=0).stop 2023-11-27T17:53:30.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.789+0000 7fb0f8ff9640 1 -- 172.21.15.31:0/2561727937 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b2bc0 msgr2=0x7fb10c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.789+0000 7fb0f8ff9640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b2bc0 0x7fb10c070560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb10400c780 tx=0x7fb10400cc40 comp rx=0 tx=0).stop 2023-11-27T17:53:30.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.789+0000 7fb0f8ff9640 1 -- 172.21.15.31:0/2561727937 shutdown_connections 2023-11-27T17:53:30.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.789+0000 7fb0f8ff9640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb0ec066870 0x7fb0ec068d30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.789+0000 7fb0f8ff9640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb10c1453c0 0x7fb10c155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.789+0000 7fb0f8ff9640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb10c0b2bc0 0x7fb10c070560 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.789+0000 7fb0f8ff9640 1 --2- 172.21.15.31:0/2561727937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb10c0729c0 0x7fb10c1e82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.789+0000 7fb0f8ff9640 1 -- 172.21.15.31:0/2561727937 >> 172.21.15.31:0/2561727937 conn(0x7fb10c0b95a0 msgr2=0x7fb10c0bb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.789+0000 7fb0f8ff9640 1 -- 172.21.15.31:0/2561727937 shutdown_connections 2023-11-27T17:53:30.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.789+0000 7fb0f8ff9640 1 -- 172.21.15.31:0/2561727937 wait complete. 2023-11-27T17:53:30.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.809+0000 7f7f95c75640 1 -- 172.21.15.31:0/577612654 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7f9006b570 con 0x7f7f78005180 2023-11-27T17:53:30.815 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2023-11-27T17:53:30.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.813+0000 7f7f77fff640 1 -- 172.21.15.31:0/577612654 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f8800fea0 con 0x7f7f78005180 2023-11-27T17:53:30.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-11-27T17:53:30.817 DEBUG:teuthology.parallel:result is None 2023-11-27T17:53:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.813+0000 7f7f75ffb640 1 -- 172.21.15.31:0/577612654 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7f7c0668c0 msgr2=0x7f7f7c068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.813+0000 7f7f75ffb640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7f7c0668c0 0x7f7f7c068d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f840af000 tx=0x7f7f840a7070 comp rx=0 tx=0).stop 2023-11-27T17:53:30.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.813+0000 7f7f75ffb640 1 -- 172.21.15.31:0/577612654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f78005180 msgr2=0x7f7f9013abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.813+0000 7f7f75ffb640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f78005180 0x7f7f9013abe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f88011e60 tx=0x7f7f8800f580 comp rx=0 tx=0).stop 2023-11-27T17:53:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.813+0000 7f7f75ffb640 1 -- 172.21.15.31:0/577612654 shutdown_connections 2023-11-27T17:53:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.817+0000 7f7f75ffb640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7f7c0668c0 0x7f7f7c068d80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.817+0000 7f7f75ffb640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7f900716d0 0x7f7f90146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.817+0000 7f7f75ffb640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f90147d40 0x7f7f90139200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.817+0000 7f7f75ffb640 1 --2- 172.21.15.31:0/577612654 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7f78005180 0x7f7f9013abe0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.817+0000 7f7f75ffb640 1 -- 172.21.15.31:0/577612654 >> 172.21.15.31:0/577612654 conn(0x7f7f9006a730 msgr2=0x7f7f90151d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.817+0000 7f7f75ffb640 1 -- 172.21.15.31:0/577612654 shutdown_connections 2023-11-27T17:53:30.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.817+0000 7f7f75ffb640 1 -- 172.21.15.31:0/577612654 wait complete. 2023-11-27T17:53:30.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.821+0000 7fd5e6385640 1 -- 172.21.15.31:0/2692816114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd5e004e850 con 0x7fd5e00b9c10 2023-11-27T17:53:30.827 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5dcff9640 1 -- 172.21.15.31:0/2692816114 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd5d40b5090 con 0x7fd5e00b9c10 2023-11-27T17:53:30.828 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2023-11-27T17:53:30.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5e6385640 1 -- 172.21.15.31:0/2692816114 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd5cc0668f0 msgr2=0x7fd5cc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5e6385640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd5cc0668f0 0x7fd5cc068db0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800a400 tx=0x7fd5d800d040 comp rx=0 tx=0).stop 2023-11-27T17:53:30.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5e6385640 1 -- 172.21.15.31:0/2692816114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e00b9c10 msgr2=0x7fd5e00b7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5e6385640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e00b9c10 0x7fd5e00b7430 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd5d40af000 tx=0x7fd5d401b850 comp rx=0 tx=0).stop 2023-11-27T17:53:30.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5e6385640 1 -- 172.21.15.31:0/2692816114 shutdown_connections 2023-11-27T17:53:30.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5e6385640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd5cc0668f0 0x7fd5cc068db0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5e6385640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd5e00b9c10 0x7fd5e00b7430 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5e6385640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd5e00b9830 0x7fd5e0136550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5e6385640 1 --2- 172.21.15.31:0/2692816114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5e00716c0 0x7fd5e00b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5e6385640 1 -- 172.21.15.31:0/2692816114 >> 172.21.15.31:0/2692816114 conn(0x7fd5e006a730 msgr2=0x7fd5e013f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5e6385640 1 -- 172.21.15.31:0/2692816114 shutdown_connections 2023-11-27T17:53:30.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.825+0000 7fd5e6385640 1 -- 172.21.15.31:0/2692816114 wait complete. 2023-11-27T17:53:30.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.833+0000 7f95a775f640 1 -- 172.21.15.31:0/135594114 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9580005510 con 0x7f95a0148160 2023-11-27T17:53:30.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.833+0000 7f9595ffb640 1 -- 172.21.15.31:0/135594114 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9590015020 con 0x7f95a0148160 2023-11-27T17:53:30.839 INFO:teuthology.orchestra.run.smithi031.stdout:55834574856 2023-11-27T17:53:30.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.837+0000 7f95a775f640 1 -- 172.21.15.31:0/135594114 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f95840668c0 msgr2=0x7f9584068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.837+0000 7f95a775f640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f95840668c0 0x7f9584068d80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f959800d620 tx=0x7f9598007810 comp rx=0 tx=0).stop 2023-11-27T17:53:30.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.837+0000 7f95a775f640 1 -- 172.21.15.31:0/135594114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a0148160 msgr2=0x7f95a0149960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.837+0000 7f95a775f640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a0148160 0x7f95a0149960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f959000b440 tx=0x7f959000b900 comp rx=0 tx=0).stop 2023-11-27T17:53:30.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.837+0000 7f95a775f640 1 -- 172.21.15.31:0/135594114 shutdown_connections 2023-11-27T17:53:30.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.837+0000 7f95a775f640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f95840668c0 0x7f9584068d80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.837+0000 7f95a775f640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f95a0148160 0x7f95a0149960 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.837+0000 7f95a775f640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f95a00ba830 0x7f95a01e32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.837+0000 7f95a775f640 1 --2- 172.21.15.31:0/135594114 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95a00714b0 0x7f95a00b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.837+0000 7f95a775f640 1 -- 172.21.15.31:0/135594114 >> 172.21.15.31:0/135594114 conn(0x7f95a006e8a0 msgr2=0x7f95a0140d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.837+0000 7f95a775f640 1 -- 172.21.15.31:0/135594114 shutdown_connections 2023-11-27T17:53:30.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.837+0000 7f95a775f640 1 -- 172.21.15.31:0/135594114 wait complete. 2023-11-27T17:53:30.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-11-27T17:53:30.845 DEBUG:teuthology.parallel:result is None 2023-11-27T17:53:30.855 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fb36733e640 1 -- 172.21.15.31:0/3297854782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb3580052a0 con 0x7fb3580cf2d0 2023-11-27T17:53:30.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 -- 172.21.15.31:0/2131827754 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fafb804e850 con 0x7fafb80722f0 2023-11-27T17:53:30.856 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fb356ffd640 1 -- 172.21.15.31:0/3297854782 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb3600ceb20 con 0x7fb3580cf2d0 2023-11-27T17:53:30.856 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-11-27T17:53:30.857 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafb4ff9640 1 -- 172.21.15.31:0/2131827754 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fafa80b5030 con 0x7fafb80722f0 2023-11-27T17:53:30.857 INFO:teuthology.orchestra.run.smithi031.stdout:55834574857 2023-11-27T17:53:30.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-11-27T17:53:30.859 DEBUG:teuthology.parallel:result is None 2023-11-27T17:53:30.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-11-27T17:53:30.860 DEBUG:teuthology.parallel:result is None 2023-11-27T17:53:30.860 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 -- 172.21.15.31:0/2131827754 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7faf980668c0 msgr2=0x7faf98068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7faf980668c0 0x7faf98068d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fafb8144760 tx=0x7fafa0008040 comp rx=0 tx=0).stop 2023-11-27T17:53:30.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 -- 172.21.15.31:0/2131827754 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafb80722f0 msgr2=0x7fafb8144060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafb80722f0 0x7fafb8144060 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fafa80af000 tx=0x7fafa801ba10 comp rx=0 tx=0).stop 2023-11-27T17:53:30.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 -- 172.21.15.31:0/2131827754 shutdown_connections 2023-11-27T17:53:30.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7faf980668c0 0x7faf98068d80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb80b9630 0x7fafb8139280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fafb80b5b10 0x7fafb814a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 --2- 172.21.15.31:0/2131827754 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fafb80722f0 0x7fafb8144060 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 -- 172.21.15.31:0/2131827754 >> 172.21.15.31:0/2131827754 conn(0x7fafb806a730 msgr2=0x7fafb80b8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.861 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 -- 172.21.15.31:0/2131827754 shutdown_connections 2023-11-27T17:53:30.862 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.853+0000 7fafbe6bc640 1 -- 172.21.15.31:0/2131827754 wait complete. 2023-11-27T17:53:30.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fb36733e640 1 -- 172.21.15.31:0/3297854782 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb344066840 msgr2=0x7fb344068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fb36733e640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb344066840 0x7fb344068d00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb350007fd0 tx=0x7fb350009040 comp rx=0 tx=0).stop 2023-11-27T17:53:30.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fb36733e640 1 -- 172.21.15.31:0/3297854782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3580cf2d0 msgr2=0x7fb3580387a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fb36733e640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3580cf2d0 0x7fb3580387a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb36002cef0 tx=0x7fb360067fd0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fb36733e640 1 -- 172.21.15.31:0/3297854782 shutdown_connections 2023-11-27T17:53:30.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fb36733e640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb344066840 0x7fb344068d00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fb36733e640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3580cf2d0 0x7fb3580387a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fb36733e640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb358038f60 0x7fb358038260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fb36733e640 1 --2- 172.21.15.31:0/3297854782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb358007130 0x7fb3580ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fb36733e640 1 -- 172.21.15.31:0/3297854782 >> 172.21.15.31:0/3297854782 conn(0x7fb35803ee00 msgr2=0x7fb35803e520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fb36733e640 1 -- 172.21.15.31:0/3297854782 shutdown_connections 2023-11-27T17:53:30.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fb36733e640 1 -- 172.21.15.31:0/3297854782 wait complete. 2023-11-27T17:53:30.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.857+0000 7fbced252640 1 -- 172.21.15.31:0/2465429127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbce00416d0 con 0x7fbce0004a10 2023-11-27T17:53:30.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbce4ff9640 1 -- 172.21.15.31:0/2465429127 <== mon.1 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbcdc017090 con 0x7fbce0004a10 2023-11-27T17:53:30.865 INFO:teuthology.orchestra.run.smithi031.stdout:55834574855 2023-11-27T17:53:30.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbced252640 1 -- 172.21.15.31:0/2465429127 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbcd8066c00 msgr2=0x7fbcd80690c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbced252640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbcd8066c00 0x7fbcd80690c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40b2000 tx=0x7fbcd4008040 comp rx=0 tx=0).stop 2023-11-27T17:53:30.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbced252640 1 -- 172.21.15.31:0/2465429127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce0004a10 msgr2=0x7fbce00d4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbced252640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce0004a10 0x7fbce00d4340 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00c4d0 tx=0x7fbcdc00c990 comp rx=0 tx=0).stop 2023-11-27T17:53:30.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbced252640 1 -- 172.21.15.31:0/2465429127 shutdown_connections 2023-11-27T17:53:30.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbced252640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbcd8066c00 0x7fbcd80690c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbced252640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbce00d5dc0 0x7fbce0037a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbced252640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbce003c780 0x7fbce0036b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbced252640 1 --2- 172.21.15.31:0/2465429127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbce0004a10 0x7fbce00d4340 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbced252640 1 -- 172.21.15.31:0/2465429127 >> 172.21.15.31:0/2465429127 conn(0x7fbce0006310 msgr2=0x7fbce0041bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbced252640 1 -- 172.21.15.31:0/2465429127 shutdown_connections 2023-11-27T17:53:30.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.861+0000 7fbced252640 1 -- 172.21.15.31:0/2465429127 wait complete. 2023-11-27T17:53:30.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2614320706 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f91900057e0 con 0x7f91ac0b5030 2023-11-27T17:53:30.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91a2ffd640 1 -- 172.21.15.31:0/2614320706 <== mon.2 v2:172.21.15.81:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f919c017090 con 0x7f91ac0b5030 2023-11-27T17:53:30.876 INFO:teuthology.orchestra.run.smithi031.stdout:55834574853 2023-11-27T17:53:30.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2614320706 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f918c066840 msgr2=0x7f918c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f918c066840 0x7f918c068d00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f919401c5d0 tx=0x7f919400a040 comp rx=0 tx=0).stop 2023-11-27T17:53:30.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2614320706 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f91ac0b5030 msgr2=0x7f91ac0bae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:30.878 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f91ac0b5030 0x7f91ac0bae70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f919c00c360 tx=0x7f919c00c820 comp rx=0 tx=0).stop 2023-11-27T17:53:30.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2614320706 shutdown_connections 2023-11-27T17:53:30.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f918c066840 0x7f918c068d00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91ac0b22e0 0x7f91ac140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f91ac0b5030 0x7f91ac0bae70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 --2- 172.21.15.31:0/2614320706 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91ac071db0 0x7f91ac148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:30.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2614320706 >> 172.21.15.31:0/2614320706 conn(0x7f91ac06a730 msgr2=0x7f91ac0700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:30.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2614320706 shutdown_connections 2023-11-27T17:53:30.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:30.873+0000 7f91b0ba4640 1 -- 172.21.15.31:0/2614320706 wait complete. 2023-11-27T17:53:30.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-11-27T17:53:30.880 DEBUG:teuthology.parallel:result is None 2023-11-27T17:53:30.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-11-27T17:53:30.886 DEBUG:teuthology.parallel:result is None 2023-11-27T17:53:30.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-11-27T17:53:30.887 DEBUG:teuthology.parallel:result is None 2023-11-27T17:53:30.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-11-27T17:53:30.896 DEBUG:teuthology.parallel:result is None 2023-11-27T17:53:30.897 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-27T17:53:30.897 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:53:31.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.041+0000 7fcbc7d5d640 1 Processor -- start 2023-11-27T17:53:31.047 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.041+0000 7fcbc7d5d640 1 -- start start 2023-11-27T17:53:31.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcbc0148ce0 0x7fcbc006b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcbc00b9070 0x7fcbc014b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.048 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcbc00b94b0 0x7fcbc014bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc00bc8b0 con 0x7fcbc00b9070 2023-11-27T17:53:31.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc00bcb90 con 0x7fcbc0148ce0 2023-11-27T17:53:31.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc01490c0 con 0x7fcbc00b94b0 2023-11-27T17:53:31.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc52f8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcbc00b9070 0x7fcbc014b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.049 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc52f8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcbc00b9070 0x7fcbc014b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51316/0 (socket says 172.21.15.31:51316) 2023-11-27T17:53:31.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc52f8640 1 -- 172.21.15.31:0/516682255 learned_addr learned my addr 172.21.15.31:0/516682255 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:31.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc5af9640 1 --2- 172.21.15.31:0/516682255 >> v2:172.21.15.81:3300/0 conn(0x7fcbc0148ce0 0x7fcbc006b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc62fa640 1 --2- 172.21.15.31:0/516682255 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcbc00b94b0 0x7fcbc014bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.050 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc52f8640 1 -- 172.21.15.31:0/516682255 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcbc00b94b0 msgr2=0x7fcbc014bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:31.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc52f8640 1 --2- 172.21.15.31:0/516682255 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcbc00b94b0 0x7fcbc014bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc52f8640 1 -- 172.21.15.31:0/516682255 >> v2:172.21.15.81:3300/0 conn(0x7fcbc0148ce0 msgr2=0x7fcbc006b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:31.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc52f8640 1 --2- 172.21.15.31:0/516682255 >> v2:172.21.15.81:3300/0 conn(0x7fcbc0148ce0 0x7fcbc006b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc52f8640 1 -- 172.21.15.31:0/516682255 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc006dbd0 con 0x7fcbc00b9070 2023-11-27T17:53:31.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc62fa640 1 --2- 172.21.15.31:0/516682255 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcbc00b94b0 0x7fcbc014bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:31.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc52f8640 1 --2- 172.21.15.31:0/516682255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00b9070 0x7fcbc014b690 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00bc600 tx=0x7fcbb001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3698fc0c1133bac5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:31.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc4af7640 1 -- 172.21.15.31:0/516682255 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00ab600 con 0x7fcbc00b9070 2023-11-27T17:53:31.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc4af7640 1 -- 172.21.15.31:0/516682255 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb00a7050 con 0x7fcbc00b9070 2023-11-27T17:53:31.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc4af7640 1 -- 172.21.15.31:0/516682255 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00ab980 con 0x7fcbc00b9070 2023-11-27T17:53:31.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/516682255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00b9070 msgr2=0x7fcbc014b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 --2- 172.21.15.31:0/516682255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00b9070 0x7fcbc014b690 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00bc600 tx=0x7fcbb001c500 comp rx=0 tx=0).stop 2023-11-27T17:53:31.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/516682255 shutdown_connections 2023-11-27T17:53:31.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 --2- 172.21.15.31:0/516682255 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcbc00b94b0 0x7fcbc014bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 --2- 172.21.15.31:0/516682255 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00b9070 0x7fcbc014b690 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 --2- 172.21.15.31:0/516682255 >> v2:172.21.15.81:3300/0 conn(0x7fcbc0148ce0 0x7fcbc006b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/516682255 >> 172.21.15.31:0/516682255 conn(0x7fcbc00b9f60 msgr2=0x7fcbc00ba370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:31.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/516682255 shutdown_connections 2023-11-27T17:53:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.045+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/516682255 wait complete. 2023-11-27T17:53:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc7d5d640 1 Processor -- start 2023-11-27T17:53:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc7d5d640 1 -- start start 2023-11-27T17:53:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc7d5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbc00b9070 0x7fcbc01437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc7d5d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00b94b0 0x7fcbc0147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc7d5d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcbc0148ce0 0x7fcbc013f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc7d5d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc0143cf0 con 0x7fcbc00b94b0 2023-11-27T17:53:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc7d5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc01484e0 con 0x7fcbc00b9070 2023-11-27T17:53:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc7d5d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc0146af0 con 0x7fcbc0148ce0 2023-11-27T17:53:31.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc52f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00b94b0 0x7fcbc0147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc52f8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00b94b0 0x7fcbc0147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51330/0 (socket says 172.21.15.31:51330) 2023-11-27T17:53:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc52f8640 1 -- 172.21.15.31:0/4259973429 learned_addr learned my addr 172.21.15.31:0/4259973429 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc62fa640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcbc0148ce0 0x7fcbc013f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc52f8640 1 -- 172.21.15.31:0/4259973429 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcbc0148ce0 msgr2=0x7fcbc013f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc52f8640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcbc0148ce0 0x7fcbc013f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc52f8640 1 -- 172.21.15.31:0/4259973429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbc00b9070 msgr2=0x7fcbc01437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc52f8640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbc00b9070 0x7fcbc01437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc52f8640 1 -- 172.21.15.31:0/4259973429 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb0009480 con 0x7fcbc00b94b0 2023-11-27T17:53:31.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc52f8640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00b94b0 0x7fcbc0147fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcbb001cda0 tx=0x7fcbb00192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:31.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbb67fc640 1 -- 172.21.15.31:0/4259973429 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0005db0 con 0x7fcbc00b94b0 2023-11-27T17:53:31.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbb67fc640 1 -- 172.21.15.31:0/4259973429 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb0003720 con 0x7fcbc00b94b0 2023-11-27T17:53:31.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/4259973429 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc0149770 con 0x7fcbc00b94b0 2023-11-27T17:53:31.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbb67fc640 1 -- 172.21.15.31:0/4259973429 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0003a90 con 0x7fcbc00b94b0 2023-11-27T17:53:31.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/4259973429 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc0147510 con 0x7fcbc00b94b0 2023-11-27T17:53:31.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/4259973429 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc004e850 con 0x7fcbc00b94b0 2023-11-27T17:53:31.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbb67fc640 1 -- 172.21.15.31:0/4259973429 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fcbb00b2070 con 0x7fcbc00b94b0 2023-11-27T17:53:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbb67fc640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fcba4066820 0x7fcba4068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbb67fc640 1 -- 172.21.15.31:0/4259973429 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbb011d8e0 con 0x7fcbc00b94b0 2023-11-27T17:53:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.049+0000 7fcbc5af9640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fcba4066820 0x7fcba4068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.053+0000 7fcbc5af9640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fcba4066820 0x7fcba4068ce0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00a790 tx=0x7fcbbc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:31.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.057+0000 7fcbb67fc640 1 -- 172.21.15.31:0/4259973429 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fcbb00eaa70 con 0x7fcbc00b94b0 2023-11-27T17:53:31.209 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.205+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/4259973429 --> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbc006d730 con 0x7fcba4066820 2023-11-27T17:53:31.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.225+0000 7fcbb67fc640 1 -- 172.21.15.31:0/4259973429 <== mgr.4101 v2:172.21.15.31:6832/1886714170 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264510 (secure 0 0 0) 0x7fcbbc00a430 con 0x7fcba4066820 2023-11-27T17:53:31.232 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:31.234 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-11-27T17:53:31.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.229+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/4259973429 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fcba4066820 msgr2=0x7fcba4068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.229+0000 7fcbc7d5d640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fcba4066820 0x7fcba4068ce0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00a790 tx=0x7fcbbc008040 comp rx=0 tx=0).stop 2023-11-27T17:53:31.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.229+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/4259973429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00b94b0 msgr2=0x7fcbc0147fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.229+0000 7fcbc7d5d640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00b94b0 0x7fcbc0147fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcbb001cda0 tx=0x7fcbb00192a0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.229+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/4259973429 shutdown_connections 2023-11-27T17:53:31.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.229+0000 7fcbc7d5d640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fcba4066820 0x7fcba4068ce0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.229+0000 7fcbc7d5d640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fcbc0148ce0 0x7fcbc013f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.229+0000 7fcbc7d5d640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcbc00b94b0 0x7fcbc0147fa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.229+0000 7fcbc7d5d640 1 --2- 172.21.15.31:0/4259973429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcbc00b9070 0x7fcbc01437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.229+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/4259973429 >> 172.21.15.31:0/4259973429 conn(0x7fcbc00b9f60 msgr2=0x7fcbc0151100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:31.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.229+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/4259973429 shutdown_connections 2023-11-27T17:53:31.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.229+0000 7fcbc7d5d640 1 -- 172.21.15.31:0/4259973429 wait complete. 2023-11-27T17:53:31.249 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-27T17:53:31.100405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2883584,"data_stored":1750798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001944"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395865+0000","last_change":"2023-11-27T17:53:24.062894+0000","last_active":"2023-11-27T17:53:25.395865+0000","last_peered":"2023-11-27T17:53:25.395865+0000","last_clean":"2023-11-27T17:53:25.395865+0000","last_became_active":"2023-11-27T17:53:24.062500+0000","last_became_peered":"2023-11-27T17:53:24.062500+0000","last_unstale":"2023-11-27T17:53:25.395865+0000","last_undegraded":"2023-11-27T17:53:25.395865+0000","last_fullsized":"2023-11-27T17:53:25.395865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:29:16.084481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011846+0000","last_change":"2023-11-27T17:53:24.036794+0000","last_active":"2023-11-27T17:53:25.011846+0000","last_peered":"2023-11-27T17:53:25.011846+0000","last_clean":"2023-11-27T17:53:25.011846+0000","last_became_active":"2023-11-27T17:53:24.036027+0000","last_became_peered":"2023-11-27T17:53:24.036027+0000","last_unstale":"2023-11-27T17:53:25.011846+0000","last_undegraded":"2023-11-27T17:53:25.011846+0000","last_fullsized":"2023-11-27T17:53:25.011846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:05.212482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003604+0000","last_change":"2023-11-27T17:53:24.029493+0000","last_active":"2023-11-27T17:53:26.003604+0000","last_peered":"2023-11-27T17:53:26.003604+0000","last_clean":"2023-11-27T17:53:26.003604+0000","last_became_active":"2023-11-27T17:53:24.028728+0000","last_became_peered":"2023-11-27T17:53:24.028728+0000","last_unstale":"2023-11-27T17:53:26.003604+0000","last_undegraded":"2023-11-27T17:53:26.003604+0000","last_fullsized":"2023-11-27T17:53:26.003604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:02:45.456945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016367+0000","last_change":"2023-11-27T17:53:24.051148+0000","last_active":"2023-11-27T17:53:25.016367+0000","last_peered":"2023-11-27T17:53:25.016367+0000","last_clean":"2023-11-27T17:53:25.016367+0000","last_became_active":"2023-11-27T17:53:24.050514+0000","last_became_peered":"2023-11-27T17:53:24.050514+0000","last_unstale":"2023-11-27T17:53:25.016367+0000","last_undegraded":"2023-11-27T17:53:25.016367+0000","last_fullsized":"2023-11-27T17:53:25.016367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:31:47.833242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395427+0000","last_change":"2023-11-27T17:53:24.058848+0000","last_active":"2023-11-27T17:53:25.395427+0000","last_peered":"2023-11-27T17:53:25.395427+0000","last_clean":"2023-11-27T17:53:25.395427+0000","last_became_active":"2023-11-27T17:53:24.057769+0000","last_became_peered":"2023-11-27T17:53:24.057769+0000","last_unstale":"2023-11-27T17:53:25.395427+0000","last_undegraded":"2023-11-27T17:53:25.395427+0000","last_fullsized":"2023-11-27T17:53:25.395427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:42.148671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016789+0000","last_change":"2023-11-27T17:53:24.033343+0000","last_active":"2023-11-27T17:53:25.016789+0000","last_peered":"2023-11-27T17:53:25.016789+0000","last_clean":"2023-11-27T17:53:25.016789+0000","last_became_active":"2023-11-27T17:53:24.032589+0000","last_became_peered":"2023-11-27T17:53:24.032589+0000","last_unstale":"2023-11-27T17:53:25.016789+0000","last_undegraded":"2023-11-27T17:53:25.016789+0000","last_fullsized":"2023-11-27T17:53:25.016789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:18.581213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.394947+0000","last_change":"2023-11-27T17:53:24.058949+0000","last_active":"2023-11-27T17:53:25.394947+0000","last_peered":"2023-11-27T17:53:25.394947+0000","last_clean":"2023-11-27T17:53:25.394947+0000","last_became_active":"2023-11-27T17:53:24.058569+0000","last_became_peered":"2023-11-27T17:53:24.058569+0000","last_unstale":"2023-11-27T17:53:25.394947+0000","last_undegraded":"2023-11-27T17:53:25.394947+0000","last_fullsized":"2023-11-27T17:53:25.394947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:00.496330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478419+0000","last_change":"2023-11-27T17:53:24.072983+0000","last_active":"2023-11-27T17:53:25.478419+0000","last_peered":"2023-11-27T17:53:25.478419+0000","last_clean":"2023-11-27T17:53:25.478419+0000","last_became_active":"2023-11-27T17:53:24.072703+0000","last_became_peered":"2023-11-27T17:53:24.072703+0000","last_unstale":"2023-11-27T17:53:25.478419+0000","last_undegraded":"2023-11-27T17:53:25.478419+0000","last_fullsized":"2023-11-27T17:53:25.478419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:09.583099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395982+0000","last_change":"2023-11-27T17:53:24.072810+0000","last_active":"2023-11-27T17:53:25.395982+0000","last_peered":"2023-11-27T17:53:25.395982+0000","last_clean":"2023-11-27T17:53:25.395982+0000","last_became_active":"2023-11-27T17:53:24.072518+0000","last_became_peered":"2023-11-27T17:53:24.072518+0000","last_unstale":"2023-11-27T17:53:25.395982+0000","last_undegraded":"2023-11-27T17:53:25.395982+0000","last_fullsized":"2023-11-27T17:53:25.395982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:05:46.880825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004775+0000","last_change":"2023-11-27T17:53:24.053163+0000","last_active":"2023-11-27T17:53:26.004775+0000","last_peered":"2023-11-27T17:53:26.004775+0000","last_clean":"2023-11-27T17:53:26.004775+0000","last_became_active":"2023-11-27T17:53:24.052872+0000","last_became_peered":"2023-11-27T17:53:24.052872+0000","last_unstale":"2023-11-27T17:53:26.004775+0000","last_undegraded":"2023-11-27T17:53:26.004775+0000","last_fullsized":"2023-11-27T17:53:26.004775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004476+0000","last_change":"2023-11-27T17:53:24.053130+0000","last_active":"2023-11-27T17:53:26.004476+0000","last_peered":"2023-11-27T17:53:26.004476+0000","last_clean":"2023-11-27T17:53:26.004476+0000","last_became_active":"2023-11-27T17:53:24.052787+0000","last_became_peered":"2023-11-27T17:53:24.052787+0000","last_unstale":"2023-11-27T17:53:26.004476+0000","last_undegraded":"2023-11-27T17:53:26.004476+0000","last_fullsized":"2023-11-27T17:53:26.004476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:05.212482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018380+0000","last_change":"2023-11-27T17:53:24.056001+0000","last_active":"2023-11-27T17:53:25.018380+0000","last_peered":"2023-11-27T17:53:25.018380+0000","last_clean":"2023-11-27T17:53:25.018380+0000","last_became_active":"2023-11-27T17:53:24.055416+0000","last_became_peered":"2023-11-27T17:53:24.055416+0000","last_unstale":"2023-11-27T17:53:25.018380+0000","last_undegraded":"2023-11-27T17:53:25.018380+0000","last_fullsized":"2023-11-27T17:53:25.018380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:55.367408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479176+0000","last_change":"2023-11-27T17:53:24.049800+0000","last_active":"2023-11-27T17:53:25.479176+0000","last_peered":"2023-11-27T17:53:25.479176+0000","last_clean":"2023-11-27T17:53:25.479176+0000","last_became_active":"2023-11-27T17:53:24.049305+0000","last_became_peered":"2023-11-27T17:53:24.049305+0000","last_unstale":"2023-11-27T17:53:25.479176+0000","last_undegraded":"2023-11-27T17:53:25.479176+0000","last_fullsized":"2023-11-27T17:53:25.479176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:31:47.833242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003229+0000","last_change":"2023-11-27T17:53:24.044494+0000","last_active":"2023-11-27T17:53:26.003229+0000","last_peered":"2023-11-27T17:53:26.003229+0000","last_clean":"2023-11-27T17:53:26.003229+0000","last_became_active":"2023-11-27T17:53:24.043437+0000","last_became_peered":"2023-11-27T17:53:24.043437+0000","last_unstale":"2023-11-27T17:53:26.003229+0000","last_undegraded":"2023-11-27T17:53:26.003229+0000","last_fullsized":"2023-11-27T17:53:26.003229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:58:40.376602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011549+0000","last_change":"2023-11-27T17:53:24.068179+0000","last_active":"2023-11-27T17:53:25.011549+0000","last_peered":"2023-11-27T17:53:25.011549+0000","last_clean":"2023-11-27T17:53:25.011549+0000","last_became_active":"2023-11-27T17:53:24.067950+0000","last_became_peered":"2023-11-27T17:53:24.067950+0000","last_unstale":"2023-11-27T17:53:25.011549+0000","last_undegraded":"2023-11-27T17:53:25.011549+0000","last_fullsized":"2023-11-27T17:53:25.011549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:08.111590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.015927+0000","last_change":"2023-11-27T17:53:24.039650+0000","last_active":"2023-11-27T17:53:25.015927+0000","last_peered":"2023-11-27T17:53:25.015927+0000","last_clean":"2023-11-27T17:53:25.015927+0000","last_became_active":"2023-11-27T17:53:24.032492+0000","last_became_peered":"2023-11-27T17:53:24.032492+0000","last_unstale":"2023-11-27T17:53:25.015927+0000","last_undegraded":"2023-11-27T17:53:25.015927+0000","last_fullsized":"2023-11-27T17:53:25.015927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016918+0000","last_change":"2023-11-27T17:53:24.044455+0000","last_active":"2023-11-27T17:53:25.016918+0000","last_peered":"2023-11-27T17:53:25.016918+0000","last_clean":"2023-11-27T17:53:25.016918+0000","last_became_active":"2023-11-27T17:53:24.043760+0000","last_became_peered":"2023-11-27T17:53:24.043760+0000","last_unstale":"2023-11-27T17:53:25.016918+0000","last_undegraded":"2023-11-27T17:53:25.016918+0000","last_fullsized":"2023-11-27T17:53:25.016918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:25:13.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508706+0000","last_change":"2023-11-27T17:53:24.061714+0000","last_active":"2023-11-27T17:53:25.508706+0000","last_peered":"2023-11-27T17:53:25.508706+0000","last_clean":"2023-11-27T17:53:25.508706+0000","last_became_active":"2023-11-27T17:53:24.061290+0000","last_became_peered":"2023-11-27T17:53:24.061290+0000","last_unstale":"2023-11-27T17:53:25.508706+0000","last_undegraded":"2023-11-27T17:53:25.508706+0000","last_fullsized":"2023-11-27T17:53:25.508706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:17.690966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395682+0000","last_change":"2023-11-27T17:53:24.060361+0000","last_active":"2023-11-27T17:53:25.395682+0000","last_peered":"2023-11-27T17:53:25.395682+0000","last_clean":"2023-11-27T17:53:25.395682+0000","last_became_active":"2023-11-27T17:53:24.060020+0000","last_became_peered":"2023-11-27T17:53:24.060020+0000","last_unstale":"2023-11-27T17:53:25.395682+0000","last_undegraded":"2023-11-27T17:53:25.395682+0000","last_fullsized":"2023-11-27T17:53:25.395682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:29:14.184726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004387+0000","last_change":"2023-11-27T17:53:24.060993+0000","last_active":"2023-11-27T17:53:26.004387+0000","last_peered":"2023-11-27T17:53:26.004387+0000","last_clean":"2023-11-27T17:53:26.004387+0000","last_became_active":"2023-11-27T17:53:24.060615+0000","last_became_peered":"2023-11-27T17:53:24.060615+0000","last_unstale":"2023-11-27T17:53:26.004387+0000","last_undegraded":"2023-11-27T17:53:26.004387+0000","last_fullsized":"2023-11-27T17:53:26.004387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:12.057622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003656+0000","last_change":"2023-11-27T17:53:24.034287+0000","last_active":"2023-11-27T17:53:26.003656+0000","last_peered":"2023-11-27T17:53:26.003656+0000","last_clean":"2023-11-27T17:53:26.003656+0000","last_became_active":"2023-11-27T17:53:24.033459+0000","last_became_peered":"2023-11-27T17:53:24.033459+0000","last_unstale":"2023-11-27T17:53:26.003656+0000","last_undegraded":"2023-11-27T17:53:26.003656+0000","last_fullsized":"2023-11-27T17:53:26.003656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:09.583099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017119+0000","last_change":"2023-11-27T17:53:24.043218+0000","last_active":"2023-11-27T17:53:25.017119+0000","last_peered":"2023-11-27T17:53:25.017119+0000","last_clean":"2023-11-27T17:53:25.017119+0000","last_became_active":"2023-11-27T17:53:24.042477+0000","last_became_peered":"2023-11-27T17:53:24.042477+0000","last_unstale":"2023-11-27T17:53:25.017119+0000","last_undegraded":"2023-11-27T17:53:25.017119+0000","last_fullsized":"2023-11-27T17:53:25.017119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:45.619458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478541+0000","last_change":"2023-11-27T17:53:24.064722+0000","last_active":"2023-11-27T17:53:25.478541+0000","last_peered":"2023-11-27T17:53:25.478541+0000","last_clean":"2023-11-27T17:53:25.478541+0000","last_became_active":"2023-11-27T17:53:24.064493+0000","last_became_peered":"2023-11-27T17:53:24.064493+0000","last_unstale":"2023-11-27T17:53:25.478541+0000","last_undegraded":"2023-11-27T17:53:25.478541+0000","last_fullsized":"2023-11-27T17:53:25.478541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:08.111590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016133+0000","last_change":"2023-11-27T17:53:24.052119+0000","last_active":"2023-11-27T17:53:25.016133+0000","last_peered":"2023-11-27T17:53:25.016133+0000","last_clean":"2023-11-27T17:53:25.016133+0000","last_became_active":"2023-11-27T17:53:24.051624+0000","last_became_peered":"2023-11-27T17:53:24.051624+0000","last_unstale":"2023-11-27T17:53:25.016133+0000","last_undegraded":"2023-11-27T17:53:25.016133+0000","last_fullsized":"2023-11-27T17:53:25.016133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479148+0000","last_change":"2023-11-27T17:53:24.067043+0000","last_active":"2023-11-27T17:53:25.479148+0000","last_peered":"2023-11-27T17:53:25.479148+0000","last_clean":"2023-11-27T17:53:25.479148+0000","last_became_active":"2023-11-27T17:53:24.066729+0000","last_became_peered":"2023-11-27T17:53:24.066729+0000","last_unstale":"2023-11-27T17:53:25.479148+0000","last_undegraded":"2023-11-27T17:53:25.479148+0000","last_fullsized":"2023-11-27T17:53:25.479148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004884+0000","last_change":"2023-11-27T17:53:24.036465+0000","last_active":"2023-11-27T17:53:26.004884+0000","last_peered":"2023-11-27T17:53:26.004884+0000","last_clean":"2023-11-27T17:53:26.004884+0000","last_became_active":"2023-11-27T17:53:24.035465+0000","last_became_peered":"2023-11-27T17:53:24.035465+0000","last_unstale":"2023-11-27T17:53:26.004884+0000","last_undegraded":"2023-11-27T17:53:26.004884+0000","last_fullsized":"2023-11-27T17:53:26.004884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011960+0000","last_change":"2023-11-27T17:53:24.050153+0000","last_active":"2023-11-27T17:53:25.011960+0000","last_peered":"2023-11-27T17:53:25.011960+0000","last_clean":"2023-11-27T17:53:25.011960+0000","last_became_active":"2023-11-27T17:53:24.049753+0000","last_became_peered":"2023-11-27T17:53:24.049753+0000","last_unstale":"2023-11-27T17:53:25.011960+0000","last_undegraded":"2023-11-27T17:53:25.011960+0000","last_fullsized":"2023-11-27T17:53:25.011960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479449+0000","last_change":"2023-11-27T17:53:24.067038+0000","last_active":"2023-11-27T17:53:25.479449+0000","last_peered":"2023-11-27T17:53:25.479449+0000","last_clean":"2023-11-27T17:53:25.479449+0000","last_became_active":"2023-11-27T17:53:24.066602+0000","last_became_peered":"2023-11-27T17:53:24.066602+0000","last_unstale":"2023-11-27T17:53:25.479449+0000","last_undegraded":"2023-11-27T17:53:25.479449+0000","last_fullsized":"2023-11-27T17:53:25.479449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:00.496330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003728+0000","last_change":"2023-11-27T17:53:24.052124+0000","last_active":"2023-11-27T17:53:26.003728+0000","last_peered":"2023-11-27T17:53:26.003728+0000","last_clean":"2023-11-27T17:53:26.003728+0000","last_became_active":"2023-11-27T17:53:24.051722+0000","last_became_peered":"2023-11-27T17:53:24.051722+0000","last_unstale":"2023-11-27T17:53:26.003728+0000","last_undegraded":"2023-11-27T17:53:26.003728+0000","last_fullsized":"2023-11-27T17:53:26.003728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:08.111590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017236+0000","last_change":"2023-11-27T17:53:24.051693+0000","last_active":"2023-11-27T17:53:25.017236+0000","last_peered":"2023-11-27T17:53:25.017236+0000","last_clean":"2023-11-27T17:53:25.017236+0000","last_became_active":"2023-11-27T17:53:24.051275+0000","last_became_peered":"2023-11-27T17:53:24.051275+0000","last_unstale":"2023-11-27T17:53:25.017236+0000","last_undegraded":"2023-11-27T17:53:25.017236+0000","last_fullsized":"2023-11-27T17:53:25.017236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:42.148671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508418+0000","last_change":"2023-11-27T17:53:24.071800+0000","last_active":"2023-11-27T17:53:25.508418+0000","last_peered":"2023-11-27T17:53:25.508418+0000","last_clean":"2023-11-27T17:53:25.508418+0000","last_became_active":"2023-11-27T17:53:24.071429+0000","last_became_peered":"2023-11-27T17:53:24.071429+0000","last_unstale":"2023-11-27T17:53:25.508418+0000","last_undegraded":"2023-11-27T17:53:25.508418+0000","last_fullsized":"2023-11-27T17:53:25.508418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:55.367408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003995+0000","last_change":"2023-11-27T17:53:24.050375+0000","last_active":"2023-11-27T17:53:26.003995+0000","last_peered":"2023-11-27T17:53:26.003995+0000","last_clean":"2023-11-27T17:53:26.003995+0000","last_became_active":"2023-11-27T17:53:24.050027+0000","last_became_peered":"2023-11-27T17:53:24.050027+0000","last_unstale":"2023-11-27T17:53:26.003995+0000","last_undegraded":"2023-11-27T17:53:26.003995+0000","last_fullsized":"2023-11-27T17:53:26.003995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:02:45.456945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017504+0000","last_change":"2023-11-27T17:53:24.053416+0000","last_active":"2023-11-27T17:53:25.017504+0000","last_peered":"2023-11-27T17:53:25.017504+0000","last_clean":"2023-11-27T17:53:25.017504+0000","last_became_active":"2023-11-27T17:53:24.053023+0000","last_became_peered":"2023-11-27T17:53:24.053023+0000","last_unstale":"2023-11-27T17:53:25.017504+0000","last_undegraded":"2023-11-27T17:53:25.017504+0000","last_fullsized":"2023-11-27T17:53:25.017504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:42.233281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479422+0000","last_change":"2023-11-27T17:53:23.058792+0000","last_active":"2023-11-27T17:53:25.479422+0000","last_peered":"2023-11-27T17:53:25.479422+0000","last_clean":"2023-11-27T17:53:25.479422+0000","last_became_active":"2023-11-27T17:53:23.058366+0000","last_became_peered":"2023-11-27T17:53:23.058366+0000","last_unstale":"2023-11-27T17:53:25.479422+0000","last_undegraded":"2023-11-27T17:53:25.479422+0000","last_fullsized":"2023-11-27T17:53:25.479422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:54.418108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004049+0000","last_change":"2023-11-27T17:53:24.038901+0000","last_active":"2023-11-27T17:53:26.004049+0000","last_peered":"2023-11-27T17:53:26.004049+0000","last_clean":"2023-11-27T17:53:26.004049+0000","last_became_active":"2023-11-27T17:53:24.038167+0000","last_became_peered":"2023-11-27T17:53:24.038167+0000","last_unstale":"2023-11-27T17:53:26.004049+0000","last_undegraded":"2023-11-27T17:53:26.004049+0000","last_fullsized":"2023-11-27T17:53:26.004049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004374+0000","last_change":"2023-11-27T17:53:23.043861+0000","last_active":"2023-11-27T17:53:26.004374+0000","last_peered":"2023-11-27T17:53:26.004374+0000","last_clean":"2023-11-27T17:53:26.004374+0000","last_became_active":"2023-11-27T17:53:23.043043+0000","last_became_peered":"2023-11-27T17:53:23.043043+0000","last_unstale":"2023-11-27T17:53:26.004374+0000","last_undegraded":"2023-11-27T17:53:26.004374+0000","last_fullsized":"2023-11-27T17:53:26.004374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:05:18.882272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478806+0000","last_change":"2023-11-27T17:53:23.041971+0000","last_active":"2023-11-27T17:53:25.478806+0000","last_peered":"2023-11-27T17:53:25.478806+0000","last_clean":"2023-11-27T17:53:25.478806+0000","last_became_active":"2023-11-27T17:53:23.041559+0000","last_became_peered":"2023-11-27T17:53:23.041559+0000","last_unstale":"2023-11-27T17:53:25.478806+0000","last_undegraded":"2023-11-27T17:53:25.478806+0000","last_fullsized":"2023-11-27T17:53:25.478806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:00:57.689429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478592+0000","last_change":"2023-11-27T17:53:24.050436+0000","last_active":"2023-11-27T17:53:25.478592+0000","last_peered":"2023-11-27T17:53:25.478592+0000","last_clean":"2023-11-27T17:53:25.478592+0000","last_became_active":"2023-11-27T17:53:24.050061+0000","last_became_peered":"2023-11-27T17:53:24.050061+0000","last_unstale":"2023-11-27T17:53:25.478592+0000","last_undegraded":"2023-11-27T17:53:25.478592+0000","last_fullsized":"2023-11-27T17:53:25.478592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:12.057622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016172+0000","last_change":"2023-11-27T17:53:23.053689+0000","last_active":"2023-11-27T17:53:25.016172+0000","last_peered":"2023-11-27T17:53:25.016172+0000","last_clean":"2023-11-27T17:53:25.016172+0000","last_became_active":"2023-11-27T17:53:23.053057+0000","last_became_peered":"2023-11-27T17:53:23.053057+0000","last_unstale":"2023-11-27T17:53:25.016172+0000","last_undegraded":"2023-11-27T17:53:25.016172+0000","last_fullsized":"2023-11-27T17:53:25.016172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:05:18.882272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011415+0000","last_change":"2023-11-27T17:53:24.054176+0000","last_active":"2023-11-27T17:53:25.011415+0000","last_peered":"2023-11-27T17:53:25.011415+0000","last_clean":"2023-11-27T17:53:25.011415+0000","last_became_active":"2023-11-27T17:53:24.053857+0000","last_became_peered":"2023-11-27T17:53:24.053857+0000","last_unstale":"2023-11-27T17:53:25.011415+0000","last_undegraded":"2023-11-27T17:53:25.011415+0000","last_fullsized":"2023-11-27T17:53:25.011415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:09.583099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004857+0000","last_change":"2023-11-27T17:53:23.056432+0000","last_active":"2023-11-27T17:53:26.004857+0000","last_peered":"2023-11-27T17:53:26.004857+0000","last_clean":"2023-11-27T17:53:26.004857+0000","last_became_active":"2023-11-27T17:53:23.055625+0000","last_became_peered":"2023-11-27T17:53:23.055625+0000","last_unstale":"2023-11-27T17:53:26.004857+0000","last_undegraded":"2023-11-27T17:53:26.004857+0000","last_fullsized":"2023-11-27T17:53:26.004857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:41.221801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016671+0000","last_change":"2023-11-27T17:53:24.043160+0000","last_active":"2023-11-27T17:53:25.016671+0000","last_peered":"2023-11-27T17:53:25.016671+0000","last_clean":"2023-11-27T17:53:25.016671+0000","last_became_active":"2023-11-27T17:53:24.042227+0000","last_became_peered":"2023-11-27T17:53:24.042227+0000","last_unstale":"2023-11-27T17:53:25.016671+0000","last_undegraded":"2023-11-27T17:53:25.016671+0000","last_fullsized":"2023-11-27T17:53:25.016671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:43:50.934311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016683+0000","last_change":"2023-11-27T17:53:23.055506+0000","last_active":"2023-11-27T17:53:25.016683+0000","last_peered":"2023-11-27T17:53:25.016683+0000","last_clean":"2023-11-27T17:53:25.016683+0000","last_became_active":"2023-11-27T17:53:23.054754+0000","last_became_peered":"2023-11-27T17:53:23.054754+0000","last_unstale":"2023-11-27T17:53:25.016683+0000","last_undegraded":"2023-11-27T17:53:25.016683+0000","last_fullsized":"2023-11-27T17:53:25.016683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:07.100110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003813+0000","last_change":"2023-11-27T17:53:24.053672+0000","last_active":"2023-11-27T17:53:26.003813+0000","last_peered":"2023-11-27T17:53:26.003813+0000","last_clean":"2023-11-27T17:53:26.003813+0000","last_became_active":"2023-11-27T17:53:24.053313+0000","last_became_peered":"2023-11-27T17:53:24.053313+0000","last_unstale":"2023-11-27T17:53:26.003813+0000","last_undegraded":"2023-11-27T17:53:26.003813+0000","last_fullsized":"2023-11-27T17:53:26.003813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:05.212482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.012084+0000","last_change":"2023-11-27T17:53:23.054682+0000","last_active":"2023-11-27T17:53:25.012084+0000","last_peered":"2023-11-27T17:53:25.012084+0000","last_clean":"2023-11-27T17:53:25.012084+0000","last_became_active":"2023-11-27T17:53:23.054371+0000","last_became_peered":"2023-11-27T17:53:23.054371+0000","last_unstale":"2023-11-27T17:53:25.012084+0000","last_undegraded":"2023-11-27T17:53:25.012084+0000","last_fullsized":"2023-11-27T17:53:25.012084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:05:18.882272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018654+0000","last_change":"2023-11-27T17:53:24.039799+0000","last_active":"2023-11-27T17:53:25.018654+0000","last_peered":"2023-11-27T17:53:25.018654+0000","last_clean":"2023-11-27T17:53:25.018654+0000","last_became_active":"2023-11-27T17:53:24.038490+0000","last_became_peered":"2023-11-27T17:53:24.038490+0000","last_unstale":"2023-11-27T17:53:25.018654+0000","last_undegraded":"2023-11-27T17:53:25.018654+0000","last_fullsized":"2023-11-27T17:53:25.018654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:17.690966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004368+0000","last_change":"2023-11-27T17:53:23.041778+0000","last_active":"2023-11-27T17:53:26.004368+0000","last_peered":"2023-11-27T17:53:26.004368+0000","last_clean":"2023-11-27T17:53:26.004368+0000","last_became_active":"2023-11-27T17:53:23.040987+0000","last_became_peered":"2023-11-27T17:53:23.040987+0000","last_unstale":"2023-11-27T17:53:26.004368+0000","last_undegraded":"2023-11-27T17:53:26.004368+0000","last_fullsized":"2023-11-27T17:53:26.004368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:54.418108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395177+0000","last_change":"2023-11-27T17:53:24.059693+0000","last_active":"2023-11-27T17:53:25.395177+0000","last_peered":"2023-11-27T17:53:25.395177+0000","last_clean":"2023-11-27T17:53:25.395177+0000","last_became_active":"2023-11-27T17:53:24.059382+0000","last_became_peered":"2023-11-27T17:53:24.059382+0000","last_unstale":"2023-11-27T17:53:25.395177+0000","last_undegraded":"2023-11-27T17:53:25.395177+0000","last_fullsized":"2023-11-27T17:53:25.395177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:25:13.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004024+0000","last_change":"2023-11-27T17:53:23.035915+0000","last_active":"2023-11-27T17:53:26.004024+0000","last_peered":"2023-11-27T17:53:26.004024+0000","last_clean":"2023-11-27T17:53:26.004024+0000","last_became_active":"2023-11-27T17:53:23.035185+0000","last_became_peered":"2023-11-27T17:53:23.035185+0000","last_unstale":"2023-11-27T17:53:26.004024+0000","last_undegraded":"2023-11-27T17:53:26.004024+0000","last_fullsized":"2023-11-27T17:53:26.004024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.633096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003295+0000","last_change":"2023-11-27T17:53:24.042633+0000","last_active":"2023-11-27T17:53:26.003295+0000","last_peered":"2023-11-27T17:53:26.003295+0000","last_clean":"2023-11-27T17:53:26.003295+0000","last_became_active":"2023-11-27T17:53:24.041865+0000","last_became_peered":"2023-11-27T17:53:24.041865+0000","last_unstale":"2023-11-27T17:53:26.003295+0000","last_undegraded":"2023-11-27T17:53:26.003295+0000","last_fullsized":"2023-11-27T17:53:26.003295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:55.429588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017332+0000","last_change":"2023-11-27T17:53:23.050229+0000","last_active":"2023-11-27T17:53:25.017332+0000","last_peered":"2023-11-27T17:53:25.017332+0000","last_clean":"2023-11-27T17:53:25.017332+0000","last_became_active":"2023-11-27T17:53:23.049600+0000","last_became_peered":"2023-11-27T17:53:23.049600+0000","last_unstale":"2023-11-27T17:53:25.017332+0000","last_undegraded":"2023-11-27T17:53:25.017332+0000","last_fullsized":"2023-11-27T17:53:25.017332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:54.355928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395687+0000","last_change":"2023-11-27T17:53:24.069376+0000","last_active":"2023-11-27T17:53:25.395687+0000","last_peered":"2023-11-27T17:53:25.395687+0000","last_clean":"2023-11-27T17:53:25.395687+0000","last_became_active":"2023-11-27T17:53:24.069060+0000","last_became_peered":"2023-11-27T17:53:24.069060+0000","last_unstale":"2023-11-27T17:53:25.395687+0000","last_undegraded":"2023-11-27T17:53:25.395687+0000","last_fullsized":"2023-11-27T17:53:25.395687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:35:18.811780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003937+0000","last_change":"2023-11-27T17:53:23.043670+0000","last_active":"2023-11-27T17:53:26.003937+0000","last_peered":"2023-11-27T17:53:26.003937+0000","last_clean":"2023-11-27T17:53:26.003937+0000","last_became_active":"2023-11-27T17:53:23.042834+0000","last_became_peered":"2023-11-27T17:53:23.042834+0000","last_unstale":"2023-11-27T17:53:26.003937+0000","last_undegraded":"2023-11-27T17:53:26.003937+0000","last_fullsized":"2023-11-27T17:53:26.003937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:00:57.689429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004035+0000","last_change":"2023-11-27T17:53:24.046699+0000","last_active":"2023-11-27T17:53:26.004035+0000","last_peered":"2023-11-27T17:53:26.004035+0000","last_clean":"2023-11-27T17:53:26.004035+0000","last_became_active":"2023-11-27T17:53:24.045787+0000","last_became_peered":"2023-11-27T17:53:24.045787+0000","last_unstale":"2023-11-27T17:53:26.004035+0000","last_undegraded":"2023-11-27T17:53:26.004035+0000","last_fullsized":"2023-11-27T17:53:26.004035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:09.583099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508349+0000","last_change":"2023-11-27T17:53:23.026816+0000","last_active":"2023-11-27T17:53:25.508349+0000","last_peered":"2023-11-27T17:53:25.508349+0000","last_clean":"2023-11-27T17:53:25.508349+0000","last_became_active":"2023-11-27T17:53:23.026389+0000","last_became_peered":"2023-11-27T17:53:23.026389+0000","last_unstale":"2023-11-27T17:53:25.508349+0000","last_undegraded":"2023-11-27T17:53:25.508349+0000","last_fullsized":"2023-11-27T17:53:25.508349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:51:12.666393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395043+0000","last_change":"2023-11-27T17:53:24.069115+0000","last_active":"2023-11-27T17:53:25.395043+0000","last_peered":"2023-11-27T17:53:25.395043+0000","last_clean":"2023-11-27T17:53:25.395043+0000","last_became_active":"2023-11-27T17:53:24.068805+0000","last_became_peered":"2023-11-27T17:53:24.068805+0000","last_unstale":"2023-11-27T17:53:25.395043+0000","last_undegraded":"2023-11-27T17:53:25.395043+0000","last_fullsized":"2023-11-27T17:53:25.395043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:18.581213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.019567+0000","last_change":"2023-11-27T17:53:23.038303+0000","last_active":"2023-11-27T17:53:25.019567+0000","last_peered":"2023-11-27T17:53:25.019567+0000","last_clean":"2023-11-27T17:53:25.019567+0000","last_became_active":"2023-11-27T17:53:23.037075+0000","last_became_peered":"2023-11-27T17:53:23.037075+0000","last_unstale":"2023-11-27T17:53:25.019567+0000","last_undegraded":"2023-11-27T17:53:25.019567+0000","last_fullsized":"2023-11-27T17:53:25.019567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:50.048292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395581+0000","last_change":"2023-11-27T17:53:24.069732+0000","last_active":"2023-11-27T17:53:25.395581+0000","last_peered":"2023-11-27T17:53:25.395581+0000","last_clean":"2023-11-27T17:53:25.395581+0000","last_became_active":"2023-11-27T17:53:24.069433+0000","last_became_peered":"2023-11-27T17:53:24.069433+0000","last_unstale":"2023-11-27T17:53:25.395581+0000","last_undegraded":"2023-11-27T17:53:25.395581+0000","last_fullsized":"2023-11-27T17:53:25.395581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:23.694932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508637+0000","last_change":"2023-11-27T17:53:23.046224+0000","last_active":"2023-11-27T17:53:25.508637+0000","last_peered":"2023-11-27T17:53:25.508637+0000","last_clean":"2023-11-27T17:53:25.508637+0000","last_became_active":"2023-11-27T17:53:23.045684+0000","last_became_peered":"2023-11-27T17:53:23.045684+0000","last_unstale":"2023-11-27T17:53:25.508637+0000","last_undegraded":"2023-11-27T17:53:25.508637+0000","last_fullsized":"2023-11-27T17:53:25.508637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.633096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.396046+0000","last_change":"2023-11-27T17:53:24.069521+0000","last_active":"2023-11-27T17:53:25.396046+0000","last_peered":"2023-11-27T17:53:25.396046+0000","last_clean":"2023-11-27T17:53:25.396046+0000","last_became_active":"2023-11-27T17:53:24.069223+0000","last_became_peered":"2023-11-27T17:53:24.069223+0000","last_unstale":"2023-11-27T17:53:25.396046+0000","last_undegraded":"2023-11-27T17:53:25.396046+0000","last_fullsized":"2023-11-27T17:53:25.396046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:52:03.352536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.012199+0000","last_change":"2023-11-27T17:53:23.032781+0000","last_active":"2023-11-27T17:53:25.012199+0000","last_peered":"2023-11-27T17:53:25.012199+0000","last_clean":"2023-11-27T17:53:25.012199+0000","last_became_active":"2023-11-27T17:53:23.032049+0000","last_became_peered":"2023-11-27T17:53:23.032049+0000","last_unstale":"2023-11-27T17:53:25.012199+0000","last_undegraded":"2023-11-27T17:53:25.012199+0000","last_fullsized":"2023-11-27T17:53:25.012199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:00:57.689429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016753+0000","last_change":"2023-11-27T17:53:24.050873+0000","last_active":"2023-11-27T17:53:25.016753+0000","last_peered":"2023-11-27T17:53:25.016753+0000","last_clean":"2023-11-27T17:53:25.016753+0000","last_became_active":"2023-11-27T17:53:24.050472+0000","last_became_peered":"2023-11-27T17:53:24.050472+0000","last_unstale":"2023-11-27T17:53:25.016753+0000","last_undegraded":"2023-11-27T17:53:25.016753+0000","last_fullsized":"2023-11-27T17:53:25.016753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:00.496330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508440+0000","last_change":"2023-11-27T17:53:23.052857+0000","last_active":"2023-11-27T17:53:25.508440+0000","last_peered":"2023-11-27T17:53:25.508440+0000","last_clean":"2023-11-27T17:53:25.508440+0000","last_became_active":"2023-11-27T17:53:23.052447+0000","last_became_peered":"2023-11-27T17:53:23.052447+0000","last_unstale":"2023-11-27T17:53:25.508440+0000","last_undegraded":"2023-11-27T17:53:25.508440+0000","last_fullsized":"2023-11-27T17:53:25.508440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:47.750203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395283+0000","last_change":"2023-11-27T17:53:24.073138+0000","last_active":"2023-11-27T17:53:25.395283+0000","last_peered":"2023-11-27T17:53:25.395283+0000","last_clean":"2023-11-27T17:53:25.395283+0000","last_became_active":"2023-11-27T17:53:24.072819+0000","last_became_peered":"2023-11-27T17:53:24.072819+0000","last_unstale":"2023-11-27T17:53:25.395283+0000","last_undegraded":"2023-11-27T17:53:25.395283+0000","last_fullsized":"2023-11-27T17:53:25.395283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:45.619458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T17:53:24.032108+0000","last_change":"2023-11-27T17:53:12.619175+0000","last_active":"2023-11-27T17:53:24.032108+0000","last_peered":"2023-11-27T17:53:24.032108+0000","last_clean":"2023-11-27T17:53:24.032108+0000","last_became_active":"2023-11-27T17:53:12.617047+0000","last_became_peered":"2023-11-27T17:53:12.617047+0000","last_unstale":"2023-11-27T17:53:24.032108+0000","last_undegraded":"2023-11-27T17:53:24.032108+0000","last_fullsized":"2023-11-27T17:53:24.032108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_clean_scrub_stamp":"2023-11-27T17:53:11.496632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:23:56.619761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016035+0000","last_change":"2023-11-27T17:53:23.049153+0000","last_active":"2023-11-27T17:53:25.016035+0000","last_peered":"2023-11-27T17:53:25.016035+0000","last_clean":"2023-11-27T17:53:25.016035+0000","last_became_active":"2023-11-27T17:53:23.044808+0000","last_became_peered":"2023-11-27T17:53:23.044808+0000","last_unstale":"2023-11-27T17:53:25.016035+0000","last_undegraded":"2023-11-27T17:53:25.016035+0000","last_fullsized":"2023-11-27T17:53:25.016035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:08.571619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478682+0000","last_change":"2023-11-27T17:53:24.071981+0000","last_active":"2023-11-27T17:53:25.478682+0000","last_peered":"2023-11-27T17:53:25.478682+0000","last_clean":"2023-11-27T17:53:25.478682+0000","last_became_active":"2023-11-27T17:53:24.071602+0000","last_became_peered":"2023-11-27T17:53:24.071602+0000","last_unstale":"2023-11-27T17:53:25.478682+0000","last_undegraded":"2023-11-27T17:53:25.478682+0000","last_fullsized":"2023-11-27T17:53:25.478682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:05.212482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.394663+0000","last_change":"2023-11-27T17:53:23.056689+0000","last_active":"2023-11-27T17:53:25.394663+0000","last_peered":"2023-11-27T17:53:25.394663+0000","last_clean":"2023-11-27T17:53:25.394663+0000","last_became_active":"2023-11-27T17:53:23.053330+0000","last_became_peered":"2023-11-27T17:53:23.053330+0000","last_unstale":"2023-11-27T17:53:25.394663+0000","last_undegraded":"2023-11-27T17:53:25.394663+0000","last_fullsized":"2023-11-27T17:53:25.394663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.633096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.002921+0000","last_change":"2023-11-27T17:53:24.055376+0000","last_active":"2023-11-27T17:53:26.002921+0000","last_peered":"2023-11-27T17:53:26.002921+0000","last_clean":"2023-11-27T17:53:26.002921+0000","last_became_active":"2023-11-27T17:53:24.054564+0000","last_became_peered":"2023-11-27T17:53:24.054564+0000","last_unstale":"2023-11-27T17:53:26.002921+0000","last_undegraded":"2023-11-27T17:53:26.002921+0000","last_fullsized":"2023-11-27T17:53:26.002921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:00:58.700909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508559+0000","last_change":"2023-11-27T17:53:23.039358+0000","last_active":"2023-11-27T17:53:25.508559+0000","last_peered":"2023-11-27T17:53:25.508559+0000","last_clean":"2023-11-27T17:53:25.508559+0000","last_became_active":"2023-11-27T17:53:23.038886+0000","last_became_peered":"2023-11-27T17:53:23.038886+0000","last_unstale":"2023-11-27T17:53:25.508559+0000","last_undegraded":"2023-11-27T17:53:25.508559+0000","last_fullsized":"2023-11-27T17:53:25.508559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:41.221801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011710+0000","last_change":"2023-11-27T17:53:24.040703+0000","last_active":"2023-11-27T17:53:25.011710+0000","last_peered":"2023-11-27T17:53:25.011710+0000","last_clean":"2023-11-27T17:53:25.011710+0000","last_became_active":"2023-11-27T17:53:24.039927+0000","last_became_peered":"2023-11-27T17:53:24.039927+0000","last_unstale":"2023-11-27T17:53:25.011710+0000","last_undegraded":"2023-11-27T17:53:25.011710+0000","last_fullsized":"2023-11-27T17:53:25.011710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:12.057622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017442+0000","last_change":"2023-11-27T17:53:23.053942+0000","last_active":"2023-11-27T17:53:25.017442+0000","last_peered":"2023-11-27T17:53:25.017442+0000","last_clean":"2023-11-27T17:53:25.017442+0000","last_became_active":"2023-11-27T17:53:23.053210+0000","last_became_peered":"2023-11-27T17:53:23.053210+0000","last_unstale":"2023-11-27T17:53:25.017442+0000","last_undegraded":"2023-11-27T17:53:25.017442+0000","last_fullsized":"2023-11-27T17:53:25.017442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:16.679486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018127+0000","last_change":"2023-11-27T17:53:24.037341+0000","last_active":"2023-11-27T17:53:25.018127+0000","last_peered":"2023-11-27T17:53:25.018127+0000","last_clean":"2023-11-27T17:53:25.018127+0000","last_became_active":"2023-11-27T17:53:24.036405+0000","last_became_peered":"2023-11-27T17:53:24.036405+0000","last_unstale":"2023-11-27T17:53:25.018127+0000","last_undegraded":"2023-11-27T17:53:25.018127+0000","last_fullsized":"2023-11-27T17:53:25.018127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:02:36.909088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.012159+0000","last_change":"2023-11-27T17:53:23.026507+0000","last_active":"2023-11-27T17:53:25.012159+0000","last_peered":"2023-11-27T17:53:25.012159+0000","last_clean":"2023-11-27T17:53:25.012159+0000","last_became_active":"2023-11-27T17:53:23.025698+0000","last_became_peered":"2023-11-27T17:53:23.025698+0000","last_unstale":"2023-11-27T17:53:25.012159+0000","last_undegraded":"2023-11-27T17:53:25.012159+0000","last_fullsized":"2023-11-27T17:53:25.012159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:54.355928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018672+0000","last_change":"2023-11-27T17:53:24.051723+0000","last_active":"2023-11-27T17:53:25.018672+0000","last_peered":"2023-11-27T17:53:25.018672+0000","last_clean":"2023-11-27T17:53:25.018672+0000","last_became_active":"2023-11-27T17:53:24.050835+0000","last_became_peered":"2023-11-27T17:53:24.050835+0000","last_unstale":"2023-11-27T17:53:25.018672+0000","last_undegraded":"2023-11-27T17:53:25.018672+0000","last_fullsized":"2023-11-27T17:53:25.018672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:35:18.811780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395790+0000","last_change":"2023-11-27T17:53:23.058458+0000","last_active":"2023-11-27T17:53:25.395790+0000","last_peered":"2023-11-27T17:53:25.395790+0000","last_clean":"2023-11-27T17:53:25.395790+0000","last_became_active":"2023-11-27T17:53:23.057577+0000","last_became_peered":"2023-11-27T17:53:23.057577+0000","last_unstale":"2023-11-27T17:53:25.395790+0000","last_undegraded":"2023-11-27T17:53:25.395790+0000","last_fullsized":"2023-11-27T17:53:25.395790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:07.100110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011937+0000","last_change":"2023-11-27T17:53:24.040681+0000","last_active":"2023-11-27T17:53:25.011937+0000","last_peered":"2023-11-27T17:53:25.011937+0000","last_clean":"2023-11-27T17:53:25.011937+0000","last_became_active":"2023-11-27T17:53:24.039794+0000","last_became_peered":"2023-11-27T17:53:24.039794+0000","last_unstale":"2023-11-27T17:53:25.011937+0000","last_undegraded":"2023-11-27T17:53:25.011937+0000","last_fullsized":"2023-11-27T17:53:25.011937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.241792+0000","last_change":"2023-11-27T17:53:23.033025+0000","last_active":"2023-11-27T17:53:26.241792+0000","last_peered":"2023-11-27T17:53:26.241792+0000","last_clean":"2023-11-27T17:53:26.241792+0000","last_became_active":"2023-11-27T17:53:23.031928+0000","last_became_peered":"2023-11-27T17:53:23.031928+0000","last_unstale":"2023-11-27T17:53:26.241792+0000","last_undegraded":"2023-11-27T17:53:26.241792+0000","last_fullsized":"2023-11-27T17:53:26.241792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:41.221801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479483+0000","last_change":"2023-11-27T17:53:24.045894+0000","last_active":"2023-11-27T17:53:25.479483+0000","last_peered":"2023-11-27T17:53:25.479483+0000","last_clean":"2023-11-27T17:53:25.479483+0000","last_became_active":"2023-11-27T17:53:24.045667+0000","last_became_peered":"2023-11-27T17:53:24.045667+0000","last_unstale":"2023-11-27T17:53:25.479483+0000","last_undegraded":"2023-11-27T17:53:25.479483+0000","last_fullsized":"2023-11-27T17:53:25.479483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:18.581213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004831+0000","last_change":"2023-11-27T17:53:23.058762+0000","last_active":"2023-11-27T17:53:26.004831+0000","last_peered":"2023-11-27T17:53:26.004831+0000","last_clean":"2023-11-27T17:53:26.004831+0000","last_became_active":"2023-11-27T17:53:23.058049+0000","last_became_peered":"2023-11-27T17:53:23.058049+0000","last_unstale":"2023-11-27T17:53:26.004831+0000","last_undegraded":"2023-11-27T17:53:26.004831+0000","last_fullsized":"2023-11-27T17:53:26.004831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:54.355928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003837+0000","last_change":"2023-11-27T17:53:24.036018+0000","last_active":"2023-11-27T17:53:26.003837+0000","last_peered":"2023-11-27T17:53:26.003837+0000","last_clean":"2023-11-27T17:53:26.003837+0000","last_became_active":"2023-11-27T17:53:24.035256+0000","last_became_peered":"2023-11-27T17:53:24.035256+0000","last_unstale":"2023-11-27T17:53:26.003837+0000","last_undegraded":"2023-11-27T17:53:26.003837+0000","last_fullsized":"2023-11-27T17:53:26.003837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.394659+0000","last_change":"2023-11-27T17:53:23.052731+0000","last_active":"2023-11-27T17:53:25.394659+0000","last_peered":"2023-11-27T17:53:25.394659+0000","last_clean":"2023-11-27T17:53:25.394659+0000","last_became_active":"2023-11-27T17:53:23.051967+0000","last_became_peered":"2023-11-27T17:53:23.051967+0000","last_unstale":"2023-11-27T17:53:25.394659+0000","last_undegraded":"2023-11-27T17:53:25.394659+0000","last_fullsized":"2023-11-27T17:53:25.394659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:41.221801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017633+0000","last_change":"2023-11-27T17:53:24.052937+0000","last_active":"2023-11-27T17:53:25.017633+0000","last_peered":"2023-11-27T17:53:25.017633+0000","last_clean":"2023-11-27T17:53:25.017633+0000","last_became_active":"2023-11-27T17:53:24.038020+0000","last_became_peered":"2023-11-27T17:53:24.038020+0000","last_unstale":"2023-11-27T17:53:25.017633+0000","last_undegraded":"2023-11-27T17:53:25.017633+0000","last_fullsized":"2023-11-27T17:53:25.017633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:41.644575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011631+0000","last_change":"2023-11-27T17:53:23.057464+0000","last_active":"2023-11-27T17:53:25.011631+0000","last_peered":"2023-11-27T17:53:25.011631+0000","last_clean":"2023-11-27T17:53:25.011631+0000","last_became_active":"2023-11-27T17:53:23.057190+0000","last_became_peered":"2023-11-27T17:53:23.057190+0000","last_unstale":"2023-11-27T17:53:25.011631+0000","last_undegraded":"2023-11-27T17:53:25.011631+0000","last_fullsized":"2023-11-27T17:53:25.011631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:54.418108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478786+0000","last_change":"2023-11-27T17:53:24.037009+0000","last_active":"2023-11-27T17:53:25.478786+0000","last_peered":"2023-11-27T17:53:25.478786+0000","last_clean":"2023-11-27T17:53:25.478786+0000","last_became_active":"2023-11-27T17:53:24.036291+0000","last_became_peered":"2023-11-27T17:53:24.036291+0000","last_unstale":"2023-11-27T17:53:25.478786+0000","last_undegraded":"2023-11-27T17:53:25.478786+0000","last_fullsized":"2023-11-27T17:53:25.478786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011932+0000","last_change":"2023-11-27T17:53:23.041287+0000","last_active":"2023-11-27T17:53:25.011932+0000","last_peered":"2023-11-27T17:53:25.011932+0000","last_clean":"2023-11-27T17:53:25.011932+0000","last_became_active":"2023-11-27T17:53:23.040654+0000","last_became_peered":"2023-11-27T17:53:23.040654+0000","last_unstale":"2023-11-27T17:53:25.011932+0000","last_undegraded":"2023-11-27T17:53:25.011932+0000","last_fullsized":"2023-11-27T17:53:25.011932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:02:44.445465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479554+0000","last_change":"2023-11-27T17:53:24.049816+0000","last_active":"2023-11-27T17:53:25.479554+0000","last_peered":"2023-11-27T17:53:25.479554+0000","last_clean":"2023-11-27T17:53:25.479554+0000","last_became_active":"2023-11-27T17:53:24.049411+0000","last_became_peered":"2023-11-27T17:53:24.049411+0000","last_unstale":"2023-11-27T17:53:25.479554+0000","last_undegraded":"2023-11-27T17:53:25.479554+0000","last_fullsized":"2023-11-27T17:53:25.479554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:25:13.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395686+0000","last_change":"2023-11-27T17:53:23.052664+0000","last_active":"2023-11-27T17:53:25.395686+0000","last_peered":"2023-11-27T17:53:25.395686+0000","last_clean":"2023-11-27T17:53:25.395686+0000","last_became_active":"2023-11-27T17:53:23.052116+0000","last_became_peered":"2023-11-27T17:53:23.052116+0000","last_unstale":"2023-11-27T17:53:25.395686+0000","last_undegraded":"2023-11-27T17:53:25.395686+0000","last_fullsized":"2023-11-27T17:53:25.395686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:11.046142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004154+0000","last_change":"2023-11-27T17:53:24.065880+0000","last_active":"2023-11-27T17:53:26.004154+0000","last_peered":"2023-11-27T17:53:26.004154+0000","last_clean":"2023-11-27T17:53:26.004154+0000","last_became_active":"2023-11-27T17:53:24.065598+0000","last_became_peered":"2023-11-27T17:53:24.065598+0000","last_unstale":"2023-11-27T17:53:26.004154+0000","last_undegraded":"2023-11-27T17:53:26.004154+0000","last_fullsized":"2023-11-27T17:53:26.004154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:08.111590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018350+0000","last_change":"2023-11-27T17:53:24.058438+0000","last_active":"2023-11-27T17:53:25.018350+0000","last_peered":"2023-11-27T17:53:25.018350+0000","last_clean":"2023-11-27T17:53:25.018350+0000","last_became_active":"2023-11-27T17:53:24.058100+0000","last_became_peered":"2023-11-27T17:53:24.058100+0000","last_unstale":"2023-11-27T17:53:25.018350+0000","last_undegraded":"2023-11-27T17:53:25.018350+0000","last_fullsized":"2023-11-27T17:53:25.018350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:23.694932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395155+0000","last_change":"2023-11-27T17:53:23.057372+0000","last_active":"2023-11-27T17:53:25.395155+0000","last_peered":"2023-11-27T17:53:25.395155+0000","last_clean":"2023-11-27T17:53:25.395155+0000","last_became_active":"2023-11-27T17:53:23.056729+0000","last_became_peered":"2023-11-27T17:53:23.056729+0000","last_unstale":"2023-11-27T17:53:25.395155+0000","last_undegraded":"2023-11-27T17:53:25.395155+0000","last_fullsized":"2023-11-27T17:53:25.395155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:54.355928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018999+0000","last_change":"2023-11-27T17:53:24.042985+0000","last_active":"2023-11-27T17:53:25.018999+0000","last_peered":"2023-11-27T17:53:25.018999+0000","last_clean":"2023-11-27T17:53:25.018999+0000","last_became_active":"2023-11-27T17:53:24.042169+0000","last_became_peered":"2023-11-27T17:53:24.042169+0000","last_unstale":"2023-11-27T17:53:25.018999+0000","last_undegraded":"2023-11-27T17:53:25.018999+0000","last_fullsized":"2023-11-27T17:53:25.018999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:29:14.184726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395483+0000","last_change":"2023-11-27T17:53:23.060149+0000","last_active":"2023-11-27T17:53:25.395483+0000","last_peered":"2023-11-27T17:53:25.395483+0000","last_clean":"2023-11-27T17:53:25.395483+0000","last_became_active":"2023-11-27T17:53:23.059061+0000","last_became_peered":"2023-11-27T17:53:23.059061+0000","last_unstale":"2023-11-27T17:53:25.395483+0000","last_undegraded":"2023-11-27T17:53:25.395483+0000","last_fullsized":"2023-11-27T17:53:25.395483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:02:44.445465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003787+0000","last_change":"2023-11-27T17:53:24.072023+0000","last_active":"2023-11-27T17:53:26.003787+0000","last_peered":"2023-11-27T17:53:26.003787+0000","last_clean":"2023-11-27T17:53:26.003787+0000","last_became_active":"2023-11-27T17:53:24.071654+0000","last_became_peered":"2023-11-27T17:53:24.071654+0000","last_unstale":"2023-11-27T17:53:26.003787+0000","last_undegraded":"2023-11-27T17:53:26.003787+0000","last_fullsized":"2023-11-27T17:53:26.003787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:12.057622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479498+0000","last_change":"2023-11-27T17:53:23.041663+0000","last_active":"2023-11-27T17:53:25.479498+0000","last_peered":"2023-11-27T17:53:25.479498+0000","last_clean":"2023-11-27T17:53:25.479498+0000","last_became_active":"2023-11-27T17:53:23.039923+0000","last_became_peered":"2023-11-27T17:53:23.039923+0000","last_unstale":"2023-11-27T17:53:25.479498+0000","last_undegraded":"2023-11-27T17:53:25.479498+0000","last_fullsized":"2023-11-27T17:53:25.479498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:58:39.365122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479266+0000","last_change":"2023-11-27T17:53:24.051978+0000","last_active":"2023-11-27T17:53:25.479266+0000","last_peered":"2023-11-27T17:53:25.479266+0000","last_clean":"2023-11-27T17:53:25.479266+0000","last_became_active":"2023-11-27T17:53:24.051656+0000","last_became_peered":"2023-11-27T17:53:24.051656+0000","last_unstale":"2023-11-27T17:53:25.479266+0000","last_undegraded":"2023-11-27T17:53:25.479266+0000","last_fullsized":"2023-11-27T17:53:25.479266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:43:50.934311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004097+0000","last_change":"2023-11-27T17:53:23.057889+0000","last_active":"2023-11-27T17:53:26.004097+0000","last_peered":"2023-11-27T17:53:26.004097+0000","last_clean":"2023-11-27T17:53:26.004097+0000","last_became_active":"2023-11-27T17:53:23.057602+0000","last_became_peered":"2023-11-27T17:53:23.057602+0000","last_unstale":"2023-11-27T17:53:26.004097+0000","last_undegraded":"2023-11-27T17:53:26.004097+0000","last_fullsized":"2023-11-27T17:53:26.004097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:05:18.882272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:53:31.254 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:53:31.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f1804af7640 1 Processor -- start 2023-11-27T17:53:31.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f1804af7640 1 -- start start 2023-11-27T17:53:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f1804af7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18000b30b0 0x7f18000b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f1804af7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f18000bd240 0x7f1800152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f1804af7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1800148930 con 0x7f18000b3a60 2023-11-27T17:53:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f1804af7640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000b52c0 con 0x7f18000bd240 2023-11-27T17:53:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f1804af7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000b7060 con 0x7f18000b30b0 2023-11-27T17:53:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f17fed9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f18000bd240 0x7f1800152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f17fed9d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f18000bd240 0x7f1800152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51340/0 (socket says 172.21.15.31:51340) 2023-11-27T17:53:31.401 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f17fed9d640 1 -- 172.21.15.31:0/2182086109 learned_addr learned my addr 172.21.15.31:0/2182086109 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:31.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f17fe59c640 1 --2- 172.21.15.31:0/2182086109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18000b30b0 0x7f18000b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f17fed9d640 1 -- 172.21.15.31:0/2182086109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18000b30b0 msgr2=0x7f18000b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:31.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f17fed9d640 1 --2- 172.21.15.31:0/2182086109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18000b30b0 0x7f18000b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f17fed9d640 1 -- 172.21.15.31:0/2182086109 >> v1:172.21.15.81:6789/0 conn(0x7f18000b3a60 legacy=0x7f180014b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:31.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f17fed9d640 1 -- 172.21.15.31:0/2182086109 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18000b3490 con 0x7f18000bd240 2023-11-27T17:53:31.402 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f17fed9d640 1 --2- 172.21.15.31:0/2182086109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18000bd240 0x7f1800152960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009e50 tx=0x7f17f801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a50e59ec0e482ac server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:31.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f17fd59a640 1 -- 172.21.15.31:0/2182086109 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80a5650 con 0x7f18000bd240 2023-11-27T17:53:31.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f17fd59a640 1 -- 172.21.15.31:0/2182086109 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f80a57b0 con 0x7f18000bd240 2023-11-27T17:53:31.403 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.397+0000 7f17fd59a640 1 -- 172.21.15.31:0/2182086109 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f80a5b40 con 0x7f18000bd240 2023-11-27T17:53:31.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 -- 172.21.15.31:0/2182086109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18000bd240 msgr2=0x7f1800152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 --2- 172.21.15.31:0/2182086109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18000bd240 0x7f1800152960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009e50 tx=0x7f17f801c9d0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 -- 172.21.15.31:0/2182086109 shutdown_connections 2023-11-27T17:53:31.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 --2- 172.21.15.31:0/2182086109 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18000bd240 0x7f1800152960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 --2- 172.21.15.31:0/2182086109 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18000b30b0 0x7f18000b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 -- 172.21.15.31:0/2182086109 >> 172.21.15.31:0/2182086109 conn(0x7f180006ab60 msgr2=0x7f18000bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:31.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 -- 172.21.15.31:0/2182086109 shutdown_connections 2023-11-27T17:53:31.404 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 -- 172.21.15.31:0/2182086109 wait complete. 2023-11-27T17:53:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 Processor -- start 2023-11-27T17:53:31.405 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 -- start start 2023-11-27T17:53:31.407 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18000b30b0 0x7f180014c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18000b3a60 0x7f1800072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18000bd240 0x7f18000718b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000725c0 con 0x7f18000b3a60 2023-11-27T17:53:31.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1800071df0 con 0x7f18000b30b0 2023-11-27T17:53:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1800070480 con 0x7f18000bd240 2023-11-27T17:53:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17fdd9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18000b3a60 0x7f1800072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17fdd9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18000b3a60 0x7f1800072080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51350/0 (socket says 172.21.15.31:51350) 2023-11-27T17:53:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17fdd9b640 1 -- 172.21.15.31:0/2916344873 learned_addr learned my addr 172.21.15.31:0/2916344873 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17fe59c640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18000b30b0 0x7f180014c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17fed9d640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18000bd240 0x7f18000718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17fdd9b640 1 -- 172.21.15.31:0/2916344873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18000bd240 msgr2=0x7f18000718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17fdd9b640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18000bd240 0x7f18000718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17fdd9b640 1 -- 172.21.15.31:0/2916344873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18000b30b0 msgr2=0x7f180014c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17fdd9b640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18000b30b0 0x7f180014c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17fdd9b640 1 -- 172.21.15.31:0/2916344873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f8009b30 con 0x7f18000b3a60 2023-11-27T17:53:31.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17fed9d640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18000bd240 0x7f18000718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:31.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17fdd9b640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18000b3a60 0x7f1800072080 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17f400c410 tx=0x7f17f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:31.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17eeffd640 1 -- 172.21.15.31:0/2916344873 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4011790 con 0x7f18000b3a60 2023-11-27T17:53:31.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17eeffd640 1 -- 172.21.15.31:0/2916344873 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f40118f0 con 0x7f18000b3a60 2023-11-27T17:53:31.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f17eeffd640 1 -- 172.21.15.31:0/2916344873 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4011ce0 con 0x7f18000b3a60 2023-11-27T17:53:31.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 -- 172.21.15.31:0/2916344873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180006fb50 con 0x7f18000b3a60 2023-11-27T17:53:31.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.401+0000 7f1804af7640 1 -- 172.21.15.31:0/2916344873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1800070110 con 0x7f18000b3a60 2023-11-27T17:53:31.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.405+0000 7f1804af7640 1 -- 172.21.15.31:0/2916344873 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180006fce0 con 0x7f18000b3a60 2023-11-27T17:53:31.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.405+0000 7f17eeffd640 1 -- 172.21.15.31:0/2916344873 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f17f401c460 con 0x7f18000b3a60 2023-11-27T17:53:31.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.405+0000 7f17eeffd640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17e00667f0 0x7f17e0068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.405+0000 7f17eeffd640 1 -- 172.21.15.31:0/2916344873 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17f4083f90 con 0x7f18000b3a60 2023-11-27T17:53:31.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.405+0000 7f17fe59c640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17e00667f0 0x7f17e0068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.405+0000 7f17fe59c640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17e00667f0 0x7f17e0068cb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f17f000a8d0 tx=0x7f17f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:31.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.409+0000 7f17eeffd640 1 -- 172.21.15.31:0/2916344873 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f17f40b5280 con 0x7f18000b3a60 2023-11-27T17:53:31.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.557+0000 7f1804af7640 1 -- 172.21.15.31:0/2916344873 --> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1800147e40 con 0x7f17e00667f0 2023-11-27T17:53:31.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.565+0000 7f17eeffd640 1 -- 172.21.15.31:0/2916344873 <== mgr.4101 v2:172.21.15.31:6832/1886714170 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264510 (secure 0 0 0) 0x7f1800147e40 con 0x7f17e00667f0 2023-11-27T17:53:31.572 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:31.574 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-11-27T17:53:31.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.569+0000 7f1804af7640 1 -- 172.21.15.31:0/2916344873 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17e00667f0 msgr2=0x7f17e0068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.569+0000 7f1804af7640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17e00667f0 0x7f17e0068cb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f17f000a8d0 tx=0x7f17f0008040 comp rx=0 tx=0).stop 2023-11-27T17:53:31.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.569+0000 7f1804af7640 1 -- 172.21.15.31:0/2916344873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18000b3a60 msgr2=0x7f1800072080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.569+0000 7f1804af7640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18000b3a60 0x7f1800072080 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f17f400c410 tx=0x7f17f400c8d0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.569+0000 7f1804af7640 1 -- 172.21.15.31:0/2916344873 shutdown_connections 2023-11-27T17:53:31.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.569+0000 7f1804af7640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17e00667f0 0x7f17e0068cb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.569+0000 7f1804af7640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18000bd240 0x7f18000718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.569+0000 7f1804af7640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18000b3a60 0x7f1800072080 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.569+0000 7f1804af7640 1 --2- 172.21.15.31:0/2916344873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18000b30b0 0x7f180014c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.569+0000 7f1804af7640 1 -- 172.21.15.31:0/2916344873 >> 172.21.15.31:0/2916344873 conn(0x7f180006ab60 msgr2=0x7f18000b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:31.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.569+0000 7f1804af7640 1 -- 172.21.15.31:0/2916344873 shutdown_connections 2023-11-27T17:53:31.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.569+0000 7f1804af7640 1 -- 172.21.15.31:0/2916344873 wait complete. 2023-11-27T17:53:31.590 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-27T17:53:31.100405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219016,"kb_used_data":2816,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755704,"statfs":{"total":773094113280,"available":772869840896,"internally_reserved":0,"allocated":2883584,"data_stored":1750798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001944"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395865+0000","last_change":"2023-11-27T17:53:24.062894+0000","last_active":"2023-11-27T17:53:25.395865+0000","last_peered":"2023-11-27T17:53:25.395865+0000","last_clean":"2023-11-27T17:53:25.395865+0000","last_became_active":"2023-11-27T17:53:24.062500+0000","last_became_peered":"2023-11-27T17:53:24.062500+0000","last_unstale":"2023-11-27T17:53:25.395865+0000","last_undegraded":"2023-11-27T17:53:25.395865+0000","last_fullsized":"2023-11-27T17:53:25.395865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:29:16.084481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011846+0000","last_change":"2023-11-27T17:53:24.036794+0000","last_active":"2023-11-27T17:53:25.011846+0000","last_peered":"2023-11-27T17:53:25.011846+0000","last_clean":"2023-11-27T17:53:25.011846+0000","last_became_active":"2023-11-27T17:53:24.036027+0000","last_became_peered":"2023-11-27T17:53:24.036027+0000","last_unstale":"2023-11-27T17:53:25.011846+0000","last_undegraded":"2023-11-27T17:53:25.011846+0000","last_fullsized":"2023-11-27T17:53:25.011846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:05.212482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003604+0000","last_change":"2023-11-27T17:53:24.029493+0000","last_active":"2023-11-27T17:53:26.003604+0000","last_peered":"2023-11-27T17:53:26.003604+0000","last_clean":"2023-11-27T17:53:26.003604+0000","last_became_active":"2023-11-27T17:53:24.028728+0000","last_became_peered":"2023-11-27T17:53:24.028728+0000","last_unstale":"2023-11-27T17:53:26.003604+0000","last_undegraded":"2023-11-27T17:53:26.003604+0000","last_fullsized":"2023-11-27T17:53:26.003604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:02:45.456945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016367+0000","last_change":"2023-11-27T17:53:24.051148+0000","last_active":"2023-11-27T17:53:25.016367+0000","last_peered":"2023-11-27T17:53:25.016367+0000","last_clean":"2023-11-27T17:53:25.016367+0000","last_became_active":"2023-11-27T17:53:24.050514+0000","last_became_peered":"2023-11-27T17:53:24.050514+0000","last_unstale":"2023-11-27T17:53:25.016367+0000","last_undegraded":"2023-11-27T17:53:25.016367+0000","last_fullsized":"2023-11-27T17:53:25.016367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:31:47.833242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395427+0000","last_change":"2023-11-27T17:53:24.058848+0000","last_active":"2023-11-27T17:53:25.395427+0000","last_peered":"2023-11-27T17:53:25.395427+0000","last_clean":"2023-11-27T17:53:25.395427+0000","last_became_active":"2023-11-27T17:53:24.057769+0000","last_became_peered":"2023-11-27T17:53:24.057769+0000","last_unstale":"2023-11-27T17:53:25.395427+0000","last_undegraded":"2023-11-27T17:53:25.395427+0000","last_fullsized":"2023-11-27T17:53:25.395427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:42.148671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016789+0000","last_change":"2023-11-27T17:53:24.033343+0000","last_active":"2023-11-27T17:53:25.016789+0000","last_peered":"2023-11-27T17:53:25.016789+0000","last_clean":"2023-11-27T17:53:25.016789+0000","last_became_active":"2023-11-27T17:53:24.032589+0000","last_became_peered":"2023-11-27T17:53:24.032589+0000","last_unstale":"2023-11-27T17:53:25.016789+0000","last_undegraded":"2023-11-27T17:53:25.016789+0000","last_fullsized":"2023-11-27T17:53:25.016789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:18.581213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.394947+0000","last_change":"2023-11-27T17:53:24.058949+0000","last_active":"2023-11-27T17:53:25.394947+0000","last_peered":"2023-11-27T17:53:25.394947+0000","last_clean":"2023-11-27T17:53:25.394947+0000","last_became_active":"2023-11-27T17:53:24.058569+0000","last_became_peered":"2023-11-27T17:53:24.058569+0000","last_unstale":"2023-11-27T17:53:25.394947+0000","last_undegraded":"2023-11-27T17:53:25.394947+0000","last_fullsized":"2023-11-27T17:53:25.394947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:00.496330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478419+0000","last_change":"2023-11-27T17:53:24.072983+0000","last_active":"2023-11-27T17:53:25.478419+0000","last_peered":"2023-11-27T17:53:25.478419+0000","last_clean":"2023-11-27T17:53:25.478419+0000","last_became_active":"2023-11-27T17:53:24.072703+0000","last_became_peered":"2023-11-27T17:53:24.072703+0000","last_unstale":"2023-11-27T17:53:25.478419+0000","last_undegraded":"2023-11-27T17:53:25.478419+0000","last_fullsized":"2023-11-27T17:53:25.478419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:09.583099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395982+0000","last_change":"2023-11-27T17:53:24.072810+0000","last_active":"2023-11-27T17:53:25.395982+0000","last_peered":"2023-11-27T17:53:25.395982+0000","last_clean":"2023-11-27T17:53:25.395982+0000","last_became_active":"2023-11-27T17:53:24.072518+0000","last_became_peered":"2023-11-27T17:53:24.072518+0000","last_unstale":"2023-11-27T17:53:25.395982+0000","last_undegraded":"2023-11-27T17:53:25.395982+0000","last_fullsized":"2023-11-27T17:53:25.395982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:05:46.880825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004775+0000","last_change":"2023-11-27T17:53:24.053163+0000","last_active":"2023-11-27T17:53:26.004775+0000","last_peered":"2023-11-27T17:53:26.004775+0000","last_clean":"2023-11-27T17:53:26.004775+0000","last_became_active":"2023-11-27T17:53:24.052872+0000","last_became_peered":"2023-11-27T17:53:24.052872+0000","last_unstale":"2023-11-27T17:53:26.004775+0000","last_undegraded":"2023-11-27T17:53:26.004775+0000","last_fullsized":"2023-11-27T17:53:26.004775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004476+0000","last_change":"2023-11-27T17:53:24.053130+0000","last_active":"2023-11-27T17:53:26.004476+0000","last_peered":"2023-11-27T17:53:26.004476+0000","last_clean":"2023-11-27T17:53:26.004476+0000","last_became_active":"2023-11-27T17:53:24.052787+0000","last_became_peered":"2023-11-27T17:53:24.052787+0000","last_unstale":"2023-11-27T17:53:26.004476+0000","last_undegraded":"2023-11-27T17:53:26.004476+0000","last_fullsized":"2023-11-27T17:53:26.004476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:05.212482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018380+0000","last_change":"2023-11-27T17:53:24.056001+0000","last_active":"2023-11-27T17:53:25.018380+0000","last_peered":"2023-11-27T17:53:25.018380+0000","last_clean":"2023-11-27T17:53:25.018380+0000","last_became_active":"2023-11-27T17:53:24.055416+0000","last_became_peered":"2023-11-27T17:53:24.055416+0000","last_unstale":"2023-11-27T17:53:25.018380+0000","last_undegraded":"2023-11-27T17:53:25.018380+0000","last_fullsized":"2023-11-27T17:53:25.018380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:55.367408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479176+0000","last_change":"2023-11-27T17:53:24.049800+0000","last_active":"2023-11-27T17:53:25.479176+0000","last_peered":"2023-11-27T17:53:25.479176+0000","last_clean":"2023-11-27T17:53:25.479176+0000","last_became_active":"2023-11-27T17:53:24.049305+0000","last_became_peered":"2023-11-27T17:53:24.049305+0000","last_unstale":"2023-11-27T17:53:25.479176+0000","last_undegraded":"2023-11-27T17:53:25.479176+0000","last_fullsized":"2023-11-27T17:53:25.479176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:31:47.833242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003229+0000","last_change":"2023-11-27T17:53:24.044494+0000","last_active":"2023-11-27T17:53:26.003229+0000","last_peered":"2023-11-27T17:53:26.003229+0000","last_clean":"2023-11-27T17:53:26.003229+0000","last_became_active":"2023-11-27T17:53:24.043437+0000","last_became_peered":"2023-11-27T17:53:24.043437+0000","last_unstale":"2023-11-27T17:53:26.003229+0000","last_undegraded":"2023-11-27T17:53:26.003229+0000","last_fullsized":"2023-11-27T17:53:26.003229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:58:40.376602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011549+0000","last_change":"2023-11-27T17:53:24.068179+0000","last_active":"2023-11-27T17:53:25.011549+0000","last_peered":"2023-11-27T17:53:25.011549+0000","last_clean":"2023-11-27T17:53:25.011549+0000","last_became_active":"2023-11-27T17:53:24.067950+0000","last_became_peered":"2023-11-27T17:53:24.067950+0000","last_unstale":"2023-11-27T17:53:25.011549+0000","last_undegraded":"2023-11-27T17:53:25.011549+0000","last_fullsized":"2023-11-27T17:53:25.011549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:08.111590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.015927+0000","last_change":"2023-11-27T17:53:24.039650+0000","last_active":"2023-11-27T17:53:25.015927+0000","last_peered":"2023-11-27T17:53:25.015927+0000","last_clean":"2023-11-27T17:53:25.015927+0000","last_became_active":"2023-11-27T17:53:24.032492+0000","last_became_peered":"2023-11-27T17:53:24.032492+0000","last_unstale":"2023-11-27T17:53:25.015927+0000","last_undegraded":"2023-11-27T17:53:25.015927+0000","last_fullsized":"2023-11-27T17:53:25.015927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016918+0000","last_change":"2023-11-27T17:53:24.044455+0000","last_active":"2023-11-27T17:53:25.016918+0000","last_peered":"2023-11-27T17:53:25.016918+0000","last_clean":"2023-11-27T17:53:25.016918+0000","last_became_active":"2023-11-27T17:53:24.043760+0000","last_became_peered":"2023-11-27T17:53:24.043760+0000","last_unstale":"2023-11-27T17:53:25.016918+0000","last_undegraded":"2023-11-27T17:53:25.016918+0000","last_fullsized":"2023-11-27T17:53:25.016918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:25:13.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508706+0000","last_change":"2023-11-27T17:53:24.061714+0000","last_active":"2023-11-27T17:53:25.508706+0000","last_peered":"2023-11-27T17:53:25.508706+0000","last_clean":"2023-11-27T17:53:25.508706+0000","last_became_active":"2023-11-27T17:53:24.061290+0000","last_became_peered":"2023-11-27T17:53:24.061290+0000","last_unstale":"2023-11-27T17:53:25.508706+0000","last_undegraded":"2023-11-27T17:53:25.508706+0000","last_fullsized":"2023-11-27T17:53:25.508706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:17.690966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395682+0000","last_change":"2023-11-27T17:53:24.060361+0000","last_active":"2023-11-27T17:53:25.395682+0000","last_peered":"2023-11-27T17:53:25.395682+0000","last_clean":"2023-11-27T17:53:25.395682+0000","last_became_active":"2023-11-27T17:53:24.060020+0000","last_became_peered":"2023-11-27T17:53:24.060020+0000","last_unstale":"2023-11-27T17:53:25.395682+0000","last_undegraded":"2023-11-27T17:53:25.395682+0000","last_fullsized":"2023-11-27T17:53:25.395682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:29:14.184726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004387+0000","last_change":"2023-11-27T17:53:24.060993+0000","last_active":"2023-11-27T17:53:26.004387+0000","last_peered":"2023-11-27T17:53:26.004387+0000","last_clean":"2023-11-27T17:53:26.004387+0000","last_became_active":"2023-11-27T17:53:24.060615+0000","last_became_peered":"2023-11-27T17:53:24.060615+0000","last_unstale":"2023-11-27T17:53:26.004387+0000","last_undegraded":"2023-11-27T17:53:26.004387+0000","last_fullsized":"2023-11-27T17:53:26.004387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:12.057622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003656+0000","last_change":"2023-11-27T17:53:24.034287+0000","last_active":"2023-11-27T17:53:26.003656+0000","last_peered":"2023-11-27T17:53:26.003656+0000","last_clean":"2023-11-27T17:53:26.003656+0000","last_became_active":"2023-11-27T17:53:24.033459+0000","last_became_peered":"2023-11-27T17:53:24.033459+0000","last_unstale":"2023-11-27T17:53:26.003656+0000","last_undegraded":"2023-11-27T17:53:26.003656+0000","last_fullsized":"2023-11-27T17:53:26.003656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:09.583099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017119+0000","last_change":"2023-11-27T17:53:24.043218+0000","last_active":"2023-11-27T17:53:25.017119+0000","last_peered":"2023-11-27T17:53:25.017119+0000","last_clean":"2023-11-27T17:53:25.017119+0000","last_became_active":"2023-11-27T17:53:24.042477+0000","last_became_peered":"2023-11-27T17:53:24.042477+0000","last_unstale":"2023-11-27T17:53:25.017119+0000","last_undegraded":"2023-11-27T17:53:25.017119+0000","last_fullsized":"2023-11-27T17:53:25.017119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:45.619458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478541+0000","last_change":"2023-11-27T17:53:24.064722+0000","last_active":"2023-11-27T17:53:25.478541+0000","last_peered":"2023-11-27T17:53:25.478541+0000","last_clean":"2023-11-27T17:53:25.478541+0000","last_became_active":"2023-11-27T17:53:24.064493+0000","last_became_peered":"2023-11-27T17:53:24.064493+0000","last_unstale":"2023-11-27T17:53:25.478541+0000","last_undegraded":"2023-11-27T17:53:25.478541+0000","last_fullsized":"2023-11-27T17:53:25.478541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:08.111590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016133+0000","last_change":"2023-11-27T17:53:24.052119+0000","last_active":"2023-11-27T17:53:25.016133+0000","last_peered":"2023-11-27T17:53:25.016133+0000","last_clean":"2023-11-27T17:53:25.016133+0000","last_became_active":"2023-11-27T17:53:24.051624+0000","last_became_peered":"2023-11-27T17:53:24.051624+0000","last_unstale":"2023-11-27T17:53:25.016133+0000","last_undegraded":"2023-11-27T17:53:25.016133+0000","last_fullsized":"2023-11-27T17:53:25.016133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479148+0000","last_change":"2023-11-27T17:53:24.067043+0000","last_active":"2023-11-27T17:53:25.479148+0000","last_peered":"2023-11-27T17:53:25.479148+0000","last_clean":"2023-11-27T17:53:25.479148+0000","last_became_active":"2023-11-27T17:53:24.066729+0000","last_became_peered":"2023-11-27T17:53:24.066729+0000","last_unstale":"2023-11-27T17:53:25.479148+0000","last_undegraded":"2023-11-27T17:53:25.479148+0000","last_fullsized":"2023-11-27T17:53:25.479148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004884+0000","last_change":"2023-11-27T17:53:24.036465+0000","last_active":"2023-11-27T17:53:26.004884+0000","last_peered":"2023-11-27T17:53:26.004884+0000","last_clean":"2023-11-27T17:53:26.004884+0000","last_became_active":"2023-11-27T17:53:24.035465+0000","last_became_peered":"2023-11-27T17:53:24.035465+0000","last_unstale":"2023-11-27T17:53:26.004884+0000","last_undegraded":"2023-11-27T17:53:26.004884+0000","last_fullsized":"2023-11-27T17:53:26.004884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011960+0000","last_change":"2023-11-27T17:53:24.050153+0000","last_active":"2023-11-27T17:53:25.011960+0000","last_peered":"2023-11-27T17:53:25.011960+0000","last_clean":"2023-11-27T17:53:25.011960+0000","last_became_active":"2023-11-27T17:53:24.049753+0000","last_became_peered":"2023-11-27T17:53:24.049753+0000","last_unstale":"2023-11-27T17:53:25.011960+0000","last_undegraded":"2023-11-27T17:53:25.011960+0000","last_fullsized":"2023-11-27T17:53:25.011960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479449+0000","last_change":"2023-11-27T17:53:24.067038+0000","last_active":"2023-11-27T17:53:25.479449+0000","last_peered":"2023-11-27T17:53:25.479449+0000","last_clean":"2023-11-27T17:53:25.479449+0000","last_became_active":"2023-11-27T17:53:24.066602+0000","last_became_peered":"2023-11-27T17:53:24.066602+0000","last_unstale":"2023-11-27T17:53:25.479449+0000","last_undegraded":"2023-11-27T17:53:25.479449+0000","last_fullsized":"2023-11-27T17:53:25.479449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:00.496330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003728+0000","last_change":"2023-11-27T17:53:24.052124+0000","last_active":"2023-11-27T17:53:26.003728+0000","last_peered":"2023-11-27T17:53:26.003728+0000","last_clean":"2023-11-27T17:53:26.003728+0000","last_became_active":"2023-11-27T17:53:24.051722+0000","last_became_peered":"2023-11-27T17:53:24.051722+0000","last_unstale":"2023-11-27T17:53:26.003728+0000","last_undegraded":"2023-11-27T17:53:26.003728+0000","last_fullsized":"2023-11-27T17:53:26.003728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:08.111590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017236+0000","last_change":"2023-11-27T17:53:24.051693+0000","last_active":"2023-11-27T17:53:25.017236+0000","last_peered":"2023-11-27T17:53:25.017236+0000","last_clean":"2023-11-27T17:53:25.017236+0000","last_became_active":"2023-11-27T17:53:24.051275+0000","last_became_peered":"2023-11-27T17:53:24.051275+0000","last_unstale":"2023-11-27T17:53:25.017236+0000","last_undegraded":"2023-11-27T17:53:25.017236+0000","last_fullsized":"2023-11-27T17:53:25.017236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:54:42.148671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508418+0000","last_change":"2023-11-27T17:53:24.071800+0000","last_active":"2023-11-27T17:53:25.508418+0000","last_peered":"2023-11-27T17:53:25.508418+0000","last_clean":"2023-11-27T17:53:25.508418+0000","last_became_active":"2023-11-27T17:53:24.071429+0000","last_became_peered":"2023-11-27T17:53:24.071429+0000","last_unstale":"2023-11-27T17:53:25.508418+0000","last_undegraded":"2023-11-27T17:53:25.508418+0000","last_fullsized":"2023-11-27T17:53:25.508418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:55.367408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003995+0000","last_change":"2023-11-27T17:53:24.050375+0000","last_active":"2023-11-27T17:53:26.003995+0000","last_peered":"2023-11-27T17:53:26.003995+0000","last_clean":"2023-11-27T17:53:26.003995+0000","last_became_active":"2023-11-27T17:53:24.050027+0000","last_became_peered":"2023-11-27T17:53:24.050027+0000","last_unstale":"2023-11-27T17:53:26.003995+0000","last_undegraded":"2023-11-27T17:53:26.003995+0000","last_fullsized":"2023-11-27T17:53:26.003995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:02:45.456945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017504+0000","last_change":"2023-11-27T17:53:24.053416+0000","last_active":"2023-11-27T17:53:25.017504+0000","last_peered":"2023-11-27T17:53:25.017504+0000","last_clean":"2023-11-27T17:53:25.017504+0000","last_became_active":"2023-11-27T17:53:24.053023+0000","last_became_peered":"2023-11-27T17:53:24.053023+0000","last_unstale":"2023-11-27T17:53:25.017504+0000","last_undegraded":"2023-11-27T17:53:25.017504+0000","last_fullsized":"2023-11-27T17:53:25.017504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:42.233281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479422+0000","last_change":"2023-11-27T17:53:23.058792+0000","last_active":"2023-11-27T17:53:25.479422+0000","last_peered":"2023-11-27T17:53:25.479422+0000","last_clean":"2023-11-27T17:53:25.479422+0000","last_became_active":"2023-11-27T17:53:23.058366+0000","last_became_peered":"2023-11-27T17:53:23.058366+0000","last_unstale":"2023-11-27T17:53:25.479422+0000","last_undegraded":"2023-11-27T17:53:25.479422+0000","last_fullsized":"2023-11-27T17:53:25.479422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:54.418108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004049+0000","last_change":"2023-11-27T17:53:24.038901+0000","last_active":"2023-11-27T17:53:26.004049+0000","last_peered":"2023-11-27T17:53:26.004049+0000","last_clean":"2023-11-27T17:53:26.004049+0000","last_became_active":"2023-11-27T17:53:24.038167+0000","last_became_peered":"2023-11-27T17:53:24.038167+0000","last_unstale":"2023-11-27T17:53:26.004049+0000","last_undegraded":"2023-11-27T17:53:26.004049+0000","last_fullsized":"2023-11-27T17:53:26.004049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:26:08.436975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004374+0000","last_change":"2023-11-27T17:53:23.043861+0000","last_active":"2023-11-27T17:53:26.004374+0000","last_peered":"2023-11-27T17:53:26.004374+0000","last_clean":"2023-11-27T17:53:26.004374+0000","last_became_active":"2023-11-27T17:53:23.043043+0000","last_became_peered":"2023-11-27T17:53:23.043043+0000","last_unstale":"2023-11-27T17:53:26.004374+0000","last_undegraded":"2023-11-27T17:53:26.004374+0000","last_fullsized":"2023-11-27T17:53:26.004374+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:05:18.882272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478806+0000","last_change":"2023-11-27T17:53:23.041971+0000","last_active":"2023-11-27T17:53:25.478806+0000","last_peered":"2023-11-27T17:53:25.478806+0000","last_clean":"2023-11-27T17:53:25.478806+0000","last_became_active":"2023-11-27T17:53:23.041559+0000","last_became_peered":"2023-11-27T17:53:23.041559+0000","last_unstale":"2023-11-27T17:53:25.478806+0000","last_undegraded":"2023-11-27T17:53:25.478806+0000","last_fullsized":"2023-11-27T17:53:25.478806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:00:57.689429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478592+0000","last_change":"2023-11-27T17:53:24.050436+0000","last_active":"2023-11-27T17:53:25.478592+0000","last_peered":"2023-11-27T17:53:25.478592+0000","last_clean":"2023-11-27T17:53:25.478592+0000","last_became_active":"2023-11-27T17:53:24.050061+0000","last_became_peered":"2023-11-27T17:53:24.050061+0000","last_unstale":"2023-11-27T17:53:25.478592+0000","last_undegraded":"2023-11-27T17:53:25.478592+0000","last_fullsized":"2023-11-27T17:53:25.478592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:12.057622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016172+0000","last_change":"2023-11-27T17:53:23.053689+0000","last_active":"2023-11-27T17:53:25.016172+0000","last_peered":"2023-11-27T17:53:25.016172+0000","last_clean":"2023-11-27T17:53:25.016172+0000","last_became_active":"2023-11-27T17:53:23.053057+0000","last_became_peered":"2023-11-27T17:53:23.053057+0000","last_unstale":"2023-11-27T17:53:25.016172+0000","last_undegraded":"2023-11-27T17:53:25.016172+0000","last_fullsized":"2023-11-27T17:53:25.016172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:05:18.882272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011415+0000","last_change":"2023-11-27T17:53:24.054176+0000","last_active":"2023-11-27T17:53:25.011415+0000","last_peered":"2023-11-27T17:53:25.011415+0000","last_clean":"2023-11-27T17:53:25.011415+0000","last_became_active":"2023-11-27T17:53:24.053857+0000","last_became_peered":"2023-11-27T17:53:24.053857+0000","last_unstale":"2023-11-27T17:53:25.011415+0000","last_undegraded":"2023-11-27T17:53:25.011415+0000","last_fullsized":"2023-11-27T17:53:25.011415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:09.583099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004857+0000","last_change":"2023-11-27T17:53:23.056432+0000","last_active":"2023-11-27T17:53:26.004857+0000","last_peered":"2023-11-27T17:53:26.004857+0000","last_clean":"2023-11-27T17:53:26.004857+0000","last_became_active":"2023-11-27T17:53:23.055625+0000","last_became_peered":"2023-11-27T17:53:23.055625+0000","last_unstale":"2023-11-27T17:53:26.004857+0000","last_undegraded":"2023-11-27T17:53:26.004857+0000","last_fullsized":"2023-11-27T17:53:26.004857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:41.221801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016671+0000","last_change":"2023-11-27T17:53:24.043160+0000","last_active":"2023-11-27T17:53:25.016671+0000","last_peered":"2023-11-27T17:53:25.016671+0000","last_clean":"2023-11-27T17:53:25.016671+0000","last_became_active":"2023-11-27T17:53:24.042227+0000","last_became_peered":"2023-11-27T17:53:24.042227+0000","last_unstale":"2023-11-27T17:53:25.016671+0000","last_undegraded":"2023-11-27T17:53:25.016671+0000","last_fullsized":"2023-11-27T17:53:25.016671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:43:50.934311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016683+0000","last_change":"2023-11-27T17:53:23.055506+0000","last_active":"2023-11-27T17:53:25.016683+0000","last_peered":"2023-11-27T17:53:25.016683+0000","last_clean":"2023-11-27T17:53:25.016683+0000","last_became_active":"2023-11-27T17:53:23.054754+0000","last_became_peered":"2023-11-27T17:53:23.054754+0000","last_unstale":"2023-11-27T17:53:25.016683+0000","last_undegraded":"2023-11-27T17:53:25.016683+0000","last_fullsized":"2023-11-27T17:53:25.016683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:07.100110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003813+0000","last_change":"2023-11-27T17:53:24.053672+0000","last_active":"2023-11-27T17:53:26.003813+0000","last_peered":"2023-11-27T17:53:26.003813+0000","last_clean":"2023-11-27T17:53:26.003813+0000","last_became_active":"2023-11-27T17:53:24.053313+0000","last_became_peered":"2023-11-27T17:53:24.053313+0000","last_unstale":"2023-11-27T17:53:26.003813+0000","last_undegraded":"2023-11-27T17:53:26.003813+0000","last_fullsized":"2023-11-27T17:53:26.003813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:05.212482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.012084+0000","last_change":"2023-11-27T17:53:23.054682+0000","last_active":"2023-11-27T17:53:25.012084+0000","last_peered":"2023-11-27T17:53:25.012084+0000","last_clean":"2023-11-27T17:53:25.012084+0000","last_became_active":"2023-11-27T17:53:23.054371+0000","last_became_peered":"2023-11-27T17:53:23.054371+0000","last_unstale":"2023-11-27T17:53:25.012084+0000","last_undegraded":"2023-11-27T17:53:25.012084+0000","last_fullsized":"2023-11-27T17:53:25.012084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:05:18.882272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018654+0000","last_change":"2023-11-27T17:53:24.039799+0000","last_active":"2023-11-27T17:53:25.018654+0000","last_peered":"2023-11-27T17:53:25.018654+0000","last_clean":"2023-11-27T17:53:25.018654+0000","last_became_active":"2023-11-27T17:53:24.038490+0000","last_became_peered":"2023-11-27T17:53:24.038490+0000","last_unstale":"2023-11-27T17:53:25.018654+0000","last_undegraded":"2023-11-27T17:53:25.018654+0000","last_fullsized":"2023-11-27T17:53:25.018654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:17.690966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004368+0000","last_change":"2023-11-27T17:53:23.041778+0000","last_active":"2023-11-27T17:53:26.004368+0000","last_peered":"2023-11-27T17:53:26.004368+0000","last_clean":"2023-11-27T17:53:26.004368+0000","last_became_active":"2023-11-27T17:53:23.040987+0000","last_became_peered":"2023-11-27T17:53:23.040987+0000","last_unstale":"2023-11-27T17:53:26.004368+0000","last_undegraded":"2023-11-27T17:53:26.004368+0000","last_fullsized":"2023-11-27T17:53:26.004368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:54.418108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395177+0000","last_change":"2023-11-27T17:53:24.059693+0000","last_active":"2023-11-27T17:53:25.395177+0000","last_peered":"2023-11-27T17:53:25.395177+0000","last_clean":"2023-11-27T17:53:25.395177+0000","last_became_active":"2023-11-27T17:53:24.059382+0000","last_became_peered":"2023-11-27T17:53:24.059382+0000","last_unstale":"2023-11-27T17:53:25.395177+0000","last_undegraded":"2023-11-27T17:53:25.395177+0000","last_fullsized":"2023-11-27T17:53:25.395177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:25:13.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004024+0000","last_change":"2023-11-27T17:53:23.035915+0000","last_active":"2023-11-27T17:53:26.004024+0000","last_peered":"2023-11-27T17:53:26.004024+0000","last_clean":"2023-11-27T17:53:26.004024+0000","last_became_active":"2023-11-27T17:53:23.035185+0000","last_became_peered":"2023-11-27T17:53:23.035185+0000","last_unstale":"2023-11-27T17:53:26.004024+0000","last_undegraded":"2023-11-27T17:53:26.004024+0000","last_fullsized":"2023-11-27T17:53:26.004024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.633096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003295+0000","last_change":"2023-11-27T17:53:24.042633+0000","last_active":"2023-11-27T17:53:26.003295+0000","last_peered":"2023-11-27T17:53:26.003295+0000","last_clean":"2023-11-27T17:53:26.003295+0000","last_became_active":"2023-11-27T17:53:24.041865+0000","last_became_peered":"2023-11-27T17:53:24.041865+0000","last_unstale":"2023-11-27T17:53:26.003295+0000","last_undegraded":"2023-11-27T17:53:26.003295+0000","last_fullsized":"2023-11-27T17:53:26.003295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:55.429588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017332+0000","last_change":"2023-11-27T17:53:23.050229+0000","last_active":"2023-11-27T17:53:25.017332+0000","last_peered":"2023-11-27T17:53:25.017332+0000","last_clean":"2023-11-27T17:53:25.017332+0000","last_became_active":"2023-11-27T17:53:23.049600+0000","last_became_peered":"2023-11-27T17:53:23.049600+0000","last_unstale":"2023-11-27T17:53:25.017332+0000","last_undegraded":"2023-11-27T17:53:25.017332+0000","last_fullsized":"2023-11-27T17:53:25.017332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:54.355928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395687+0000","last_change":"2023-11-27T17:53:24.069376+0000","last_active":"2023-11-27T17:53:25.395687+0000","last_peered":"2023-11-27T17:53:25.395687+0000","last_clean":"2023-11-27T17:53:25.395687+0000","last_became_active":"2023-11-27T17:53:24.069060+0000","last_became_peered":"2023-11-27T17:53:24.069060+0000","last_unstale":"2023-11-27T17:53:25.395687+0000","last_undegraded":"2023-11-27T17:53:25.395687+0000","last_fullsized":"2023-11-27T17:53:25.395687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:35:18.811780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003937+0000","last_change":"2023-11-27T17:53:23.043670+0000","last_active":"2023-11-27T17:53:26.003937+0000","last_peered":"2023-11-27T17:53:26.003937+0000","last_clean":"2023-11-27T17:53:26.003937+0000","last_became_active":"2023-11-27T17:53:23.042834+0000","last_became_peered":"2023-11-27T17:53:23.042834+0000","last_unstale":"2023-11-27T17:53:26.003937+0000","last_undegraded":"2023-11-27T17:53:26.003937+0000","last_fullsized":"2023-11-27T17:53:26.003937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:00:57.689429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004035+0000","last_change":"2023-11-27T17:53:24.046699+0000","last_active":"2023-11-27T17:53:26.004035+0000","last_peered":"2023-11-27T17:53:26.004035+0000","last_clean":"2023-11-27T17:53:26.004035+0000","last_became_active":"2023-11-27T17:53:24.045787+0000","last_became_peered":"2023-11-27T17:53:24.045787+0000","last_unstale":"2023-11-27T17:53:26.004035+0000","last_undegraded":"2023-11-27T17:53:26.004035+0000","last_fullsized":"2023-11-27T17:53:26.004035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:09.583099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508349+0000","last_change":"2023-11-27T17:53:23.026816+0000","last_active":"2023-11-27T17:53:25.508349+0000","last_peered":"2023-11-27T17:53:25.508349+0000","last_clean":"2023-11-27T17:53:25.508349+0000","last_became_active":"2023-11-27T17:53:23.026389+0000","last_became_peered":"2023-11-27T17:53:23.026389+0000","last_unstale":"2023-11-27T17:53:25.508349+0000","last_undegraded":"2023-11-27T17:53:25.508349+0000","last_fullsized":"2023-11-27T17:53:25.508349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:51:12.666393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395043+0000","last_change":"2023-11-27T17:53:24.069115+0000","last_active":"2023-11-27T17:53:25.395043+0000","last_peered":"2023-11-27T17:53:25.395043+0000","last_clean":"2023-11-27T17:53:25.395043+0000","last_became_active":"2023-11-27T17:53:24.068805+0000","last_became_peered":"2023-11-27T17:53:24.068805+0000","last_unstale":"2023-11-27T17:53:25.395043+0000","last_undegraded":"2023-11-27T17:53:25.395043+0000","last_fullsized":"2023-11-27T17:53:25.395043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:18.581213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.019567+0000","last_change":"2023-11-27T17:53:23.038303+0000","last_active":"2023-11-27T17:53:25.019567+0000","last_peered":"2023-11-27T17:53:25.019567+0000","last_clean":"2023-11-27T17:53:25.019567+0000","last_became_active":"2023-11-27T17:53:23.037075+0000","last_became_peered":"2023-11-27T17:53:23.037075+0000","last_unstale":"2023-11-27T17:53:25.019567+0000","last_undegraded":"2023-11-27T17:53:25.019567+0000","last_fullsized":"2023-11-27T17:53:25.019567+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:23:50.048292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395581+0000","last_change":"2023-11-27T17:53:24.069732+0000","last_active":"2023-11-27T17:53:25.395581+0000","last_peered":"2023-11-27T17:53:25.395581+0000","last_clean":"2023-11-27T17:53:25.395581+0000","last_became_active":"2023-11-27T17:53:24.069433+0000","last_became_peered":"2023-11-27T17:53:24.069433+0000","last_unstale":"2023-11-27T17:53:25.395581+0000","last_undegraded":"2023-11-27T17:53:25.395581+0000","last_fullsized":"2023-11-27T17:53:25.395581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:23.694932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508637+0000","last_change":"2023-11-27T17:53:23.046224+0000","last_active":"2023-11-27T17:53:25.508637+0000","last_peered":"2023-11-27T17:53:25.508637+0000","last_clean":"2023-11-27T17:53:25.508637+0000","last_became_active":"2023-11-27T17:53:23.045684+0000","last_became_peered":"2023-11-27T17:53:23.045684+0000","last_unstale":"2023-11-27T17:53:25.508637+0000","last_undegraded":"2023-11-27T17:53:25.508637+0000","last_fullsized":"2023-11-27T17:53:25.508637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.633096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.396046+0000","last_change":"2023-11-27T17:53:24.069521+0000","last_active":"2023-11-27T17:53:25.396046+0000","last_peered":"2023-11-27T17:53:25.396046+0000","last_clean":"2023-11-27T17:53:25.396046+0000","last_became_active":"2023-11-27T17:53:24.069223+0000","last_became_peered":"2023-11-27T17:53:24.069223+0000","last_unstale":"2023-11-27T17:53:25.396046+0000","last_undegraded":"2023-11-27T17:53:25.396046+0000","last_fullsized":"2023-11-27T17:53:25.396046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:52:03.352536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.012199+0000","last_change":"2023-11-27T17:53:23.032781+0000","last_active":"2023-11-27T17:53:25.012199+0000","last_peered":"2023-11-27T17:53:25.012199+0000","last_clean":"2023-11-27T17:53:25.012199+0000","last_became_active":"2023-11-27T17:53:23.032049+0000","last_became_peered":"2023-11-27T17:53:23.032049+0000","last_unstale":"2023-11-27T17:53:25.012199+0000","last_undegraded":"2023-11-27T17:53:25.012199+0000","last_fullsized":"2023-11-27T17:53:25.012199+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:00:57.689429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016753+0000","last_change":"2023-11-27T17:53:24.050873+0000","last_active":"2023-11-27T17:53:25.016753+0000","last_peered":"2023-11-27T17:53:25.016753+0000","last_clean":"2023-11-27T17:53:25.016753+0000","last_became_active":"2023-11-27T17:53:24.050472+0000","last_became_peered":"2023-11-27T17:53:24.050472+0000","last_unstale":"2023-11-27T17:53:25.016753+0000","last_undegraded":"2023-11-27T17:53:25.016753+0000","last_fullsized":"2023-11-27T17:53:25.016753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:00.496330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508440+0000","last_change":"2023-11-27T17:53:23.052857+0000","last_active":"2023-11-27T17:53:25.508440+0000","last_peered":"2023-11-27T17:53:25.508440+0000","last_clean":"2023-11-27T17:53:25.508440+0000","last_became_active":"2023-11-27T17:53:23.052447+0000","last_became_peered":"2023-11-27T17:53:23.052447+0000","last_unstale":"2023-11-27T17:53:25.508440+0000","last_undegraded":"2023-11-27T17:53:25.508440+0000","last_fullsized":"2023-11-27T17:53:25.508440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:47.750203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395283+0000","last_change":"2023-11-27T17:53:24.073138+0000","last_active":"2023-11-27T17:53:25.395283+0000","last_peered":"2023-11-27T17:53:25.395283+0000","last_clean":"2023-11-27T17:53:25.395283+0000","last_became_active":"2023-11-27T17:53:24.072819+0000","last_became_peered":"2023-11-27T17:53:24.072819+0000","last_unstale":"2023-11-27T17:53:25.395283+0000","last_undegraded":"2023-11-27T17:53:25.395283+0000","last_fullsized":"2023-11-27T17:53:25.395283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:19:45.619458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-27T17:53:24.032108+0000","last_change":"2023-11-27T17:53:12.619175+0000","last_active":"2023-11-27T17:53:24.032108+0000","last_peered":"2023-11-27T17:53:24.032108+0000","last_clean":"2023-11-27T17:53:24.032108+0000","last_became_active":"2023-11-27T17:53:12.617047+0000","last_became_peered":"2023-11-27T17:53:12.617047+0000","last_unstale":"2023-11-27T17:53:24.032108+0000","last_undegraded":"2023-11-27T17:53:24.032108+0000","last_fullsized":"2023-11-27T17:53:24.032108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_clean_scrub_stamp":"2023-11-27T17:53:11.496632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:23:56.619761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.016035+0000","last_change":"2023-11-27T17:53:23.049153+0000","last_active":"2023-11-27T17:53:25.016035+0000","last_peered":"2023-11-27T17:53:25.016035+0000","last_clean":"2023-11-27T17:53:25.016035+0000","last_became_active":"2023-11-27T17:53:23.044808+0000","last_became_peered":"2023-11-27T17:53:23.044808+0000","last_unstale":"2023-11-27T17:53:25.016035+0000","last_undegraded":"2023-11-27T17:53:25.016035+0000","last_fullsized":"2023-11-27T17:53:25.016035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:50:08.571619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478682+0000","last_change":"2023-11-27T17:53:24.071981+0000","last_active":"2023-11-27T17:53:25.478682+0000","last_peered":"2023-11-27T17:53:25.478682+0000","last_clean":"2023-11-27T17:53:25.478682+0000","last_became_active":"2023-11-27T17:53:24.071602+0000","last_became_peered":"2023-11-27T17:53:24.071602+0000","last_unstale":"2023-11-27T17:53:25.478682+0000","last_undegraded":"2023-11-27T17:53:25.478682+0000","last_fullsized":"2023-11-27T17:53:25.478682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:56:05.212482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.394663+0000","last_change":"2023-11-27T17:53:23.056689+0000","last_active":"2023-11-27T17:53:25.394663+0000","last_peered":"2023-11-27T17:53:25.394663+0000","last_clean":"2023-11-27T17:53:25.394663+0000","last_became_active":"2023-11-27T17:53:23.053330+0000","last_became_peered":"2023-11-27T17:53:23.053330+0000","last_unstale":"2023-11-27T17:53:25.394663+0000","last_undegraded":"2023-11-27T17:53:25.394663+0000","last_fullsized":"2023-11-27T17:53:25.394663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:40.633096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.002921+0000","last_change":"2023-11-27T17:53:24.055376+0000","last_active":"2023-11-27T17:53:26.002921+0000","last_peered":"2023-11-27T17:53:26.002921+0000","last_clean":"2023-11-27T17:53:26.002921+0000","last_became_active":"2023-11-27T17:53:24.054564+0000","last_became_peered":"2023-11-27T17:53:24.054564+0000","last_unstale":"2023-11-27T17:53:26.002921+0000","last_undegraded":"2023-11-27T17:53:26.002921+0000","last_fullsized":"2023-11-27T17:53:26.002921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:00:58.700909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.508559+0000","last_change":"2023-11-27T17:53:23.039358+0000","last_active":"2023-11-27T17:53:25.508559+0000","last_peered":"2023-11-27T17:53:25.508559+0000","last_clean":"2023-11-27T17:53:25.508559+0000","last_became_active":"2023-11-27T17:53:23.038886+0000","last_became_peered":"2023-11-27T17:53:23.038886+0000","last_unstale":"2023-11-27T17:53:25.508559+0000","last_undegraded":"2023-11-27T17:53:25.508559+0000","last_fullsized":"2023-11-27T17:53:25.508559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:41.221801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011710+0000","last_change":"2023-11-27T17:53:24.040703+0000","last_active":"2023-11-27T17:53:25.011710+0000","last_peered":"2023-11-27T17:53:25.011710+0000","last_clean":"2023-11-27T17:53:25.011710+0000","last_became_active":"2023-11-27T17:53:24.039927+0000","last_became_peered":"2023-11-27T17:53:24.039927+0000","last_unstale":"2023-11-27T17:53:25.011710+0000","last_undegraded":"2023-11-27T17:53:25.011710+0000","last_fullsized":"2023-11-27T17:53:25.011710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:12.057622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017442+0000","last_change":"2023-11-27T17:53:23.053942+0000","last_active":"2023-11-27T17:53:25.017442+0000","last_peered":"2023-11-27T17:53:25.017442+0000","last_clean":"2023-11-27T17:53:25.017442+0000","last_became_active":"2023-11-27T17:53:23.053210+0000","last_became_peered":"2023-11-27T17:53:23.053210+0000","last_unstale":"2023-11-27T17:53:25.017442+0000","last_undegraded":"2023-11-27T17:53:25.017442+0000","last_fullsized":"2023-11-27T17:53:25.017442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:23:16.679486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018127+0000","last_change":"2023-11-27T17:53:24.037341+0000","last_active":"2023-11-27T17:53:25.018127+0000","last_peered":"2023-11-27T17:53:25.018127+0000","last_clean":"2023-11-27T17:53:25.018127+0000","last_became_active":"2023-11-27T17:53:24.036405+0000","last_became_peered":"2023-11-27T17:53:24.036405+0000","last_unstale":"2023-11-27T17:53:25.018127+0000","last_undegraded":"2023-11-27T17:53:25.018127+0000","last_fullsized":"2023-11-27T17:53:25.018127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:02:36.909088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.012159+0000","last_change":"2023-11-27T17:53:23.026507+0000","last_active":"2023-11-27T17:53:25.012159+0000","last_peered":"2023-11-27T17:53:25.012159+0000","last_clean":"2023-11-27T17:53:25.012159+0000","last_became_active":"2023-11-27T17:53:23.025698+0000","last_became_peered":"2023-11-27T17:53:23.025698+0000","last_unstale":"2023-11-27T17:53:25.012159+0000","last_undegraded":"2023-11-27T17:53:25.012159+0000","last_fullsized":"2023-11-27T17:53:25.012159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:54.355928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018672+0000","last_change":"2023-11-27T17:53:24.051723+0000","last_active":"2023-11-27T17:53:25.018672+0000","last_peered":"2023-11-27T17:53:25.018672+0000","last_clean":"2023-11-27T17:53:25.018672+0000","last_became_active":"2023-11-27T17:53:24.050835+0000","last_became_peered":"2023-11-27T17:53:24.050835+0000","last_unstale":"2023-11-27T17:53:25.018672+0000","last_undegraded":"2023-11-27T17:53:25.018672+0000","last_fullsized":"2023-11-27T17:53:25.018672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:35:18.811780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395790+0000","last_change":"2023-11-27T17:53:23.058458+0000","last_active":"2023-11-27T17:53:25.395790+0000","last_peered":"2023-11-27T17:53:25.395790+0000","last_clean":"2023-11-27T17:53:25.395790+0000","last_became_active":"2023-11-27T17:53:23.057577+0000","last_became_peered":"2023-11-27T17:53:23.057577+0000","last_unstale":"2023-11-27T17:53:25.395790+0000","last_undegraded":"2023-11-27T17:53:25.395790+0000","last_fullsized":"2023-11-27T17:53:25.395790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:07.100110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011937+0000","last_change":"2023-11-27T17:53:24.040681+0000","last_active":"2023-11-27T17:53:25.011937+0000","last_peered":"2023-11-27T17:53:25.011937+0000","last_clean":"2023-11-27T17:53:25.011937+0000","last_became_active":"2023-11-27T17:53:24.039794+0000","last_became_peered":"2023-11-27T17:53:24.039794+0000","last_unstale":"2023-11-27T17:53:25.011937+0000","last_undegraded":"2023-11-27T17:53:25.011937+0000","last_fullsized":"2023-11-27T17:53:25.011937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.241792+0000","last_change":"2023-11-27T17:53:23.033025+0000","last_active":"2023-11-27T17:53:26.241792+0000","last_peered":"2023-11-27T17:53:26.241792+0000","last_clean":"2023-11-27T17:53:26.241792+0000","last_became_active":"2023-11-27T17:53:23.031928+0000","last_became_peered":"2023-11-27T17:53:23.031928+0000","last_unstale":"2023-11-27T17:53:26.241792+0000","last_undegraded":"2023-11-27T17:53:26.241792+0000","last_fullsized":"2023-11-27T17:53:26.241792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:41.221801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479483+0000","last_change":"2023-11-27T17:53:24.045894+0000","last_active":"2023-11-27T17:53:25.479483+0000","last_peered":"2023-11-27T17:53:25.479483+0000","last_clean":"2023-11-27T17:53:25.479483+0000","last_became_active":"2023-11-27T17:53:24.045667+0000","last_became_peered":"2023-11-27T17:53:24.045667+0000","last_unstale":"2023-11-27T17:53:25.479483+0000","last_undegraded":"2023-11-27T17:53:25.479483+0000","last_fullsized":"2023-11-27T17:53:25.479483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:20:18.581213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004831+0000","last_change":"2023-11-27T17:53:23.058762+0000","last_active":"2023-11-27T17:53:26.004831+0000","last_peered":"2023-11-27T17:53:26.004831+0000","last_clean":"2023-11-27T17:53:26.004831+0000","last_became_active":"2023-11-27T17:53:23.058049+0000","last_became_peered":"2023-11-27T17:53:23.058049+0000","last_unstale":"2023-11-27T17:53:26.004831+0000","last_undegraded":"2023-11-27T17:53:26.004831+0000","last_fullsized":"2023-11-27T17:53:26.004831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:54.355928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003837+0000","last_change":"2023-11-27T17:53:24.036018+0000","last_active":"2023-11-27T17:53:26.003837+0000","last_peered":"2023-11-27T17:53:26.003837+0000","last_clean":"2023-11-27T17:53:26.003837+0000","last_became_active":"2023-11-27T17:53:24.035256+0000","last_became_peered":"2023-11-27T17:53:24.035256+0000","last_unstale":"2023-11-27T17:53:26.003837+0000","last_undegraded":"2023-11-27T17:53:26.003837+0000","last_fullsized":"2023-11-27T17:53:26.003837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.394659+0000","last_change":"2023-11-27T17:53:23.052731+0000","last_active":"2023-11-27T17:53:25.394659+0000","last_peered":"2023-11-27T17:53:25.394659+0000","last_clean":"2023-11-27T17:53:25.394659+0000","last_became_active":"2023-11-27T17:53:23.051967+0000","last_became_peered":"2023-11-27T17:53:23.051967+0000","last_unstale":"2023-11-27T17:53:25.394659+0000","last_undegraded":"2023-11-27T17:53:25.394659+0000","last_fullsized":"2023-11-27T17:53:25.394659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:38:41.221801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.017633+0000","last_change":"2023-11-27T17:53:24.052937+0000","last_active":"2023-11-27T17:53:25.017633+0000","last_peered":"2023-11-27T17:53:25.017633+0000","last_clean":"2023-11-27T17:53:25.017633+0000","last_became_active":"2023-11-27T17:53:24.038020+0000","last_became_peered":"2023-11-27T17:53:24.038020+0000","last_unstale":"2023-11-27T17:53:25.017633+0000","last_undegraded":"2023-11-27T17:53:25.017633+0000","last_fullsized":"2023-11-27T17:53:25.017633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:26:41.644575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011631+0000","last_change":"2023-11-27T17:53:23.057464+0000","last_active":"2023-11-27T17:53:25.011631+0000","last_peered":"2023-11-27T17:53:25.011631+0000","last_clean":"2023-11-27T17:53:25.011631+0000","last_became_active":"2023-11-27T17:53:23.057190+0000","last_became_peered":"2023-11-27T17:53:23.057190+0000","last_unstale":"2023-11-27T17:53:25.011631+0000","last_undegraded":"2023-11-27T17:53:25.011631+0000","last_fullsized":"2023-11-27T17:53:25.011631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:39:54.418108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.478786+0000","last_change":"2023-11-27T17:53:24.037009+0000","last_active":"2023-11-27T17:53:25.478786+0000","last_peered":"2023-11-27T17:53:25.478786+0000","last_clean":"2023-11-27T17:53:25.478786+0000","last_became_active":"2023-11-27T17:53:24.036291+0000","last_became_peered":"2023-11-27T17:53:24.036291+0000","last_unstale":"2023-11-27T17:53:25.478786+0000","last_undegraded":"2023-11-27T17:53:25.478786+0000","last_fullsized":"2023-11-27T17:53:25.478786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:32:45.945684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.011932+0000","last_change":"2023-11-27T17:53:23.041287+0000","last_active":"2023-11-27T17:53:25.011932+0000","last_peered":"2023-11-27T17:53:25.011932+0000","last_clean":"2023-11-27T17:53:25.011932+0000","last_became_active":"2023-11-27T17:53:23.040654+0000","last_became_peered":"2023-11-27T17:53:23.040654+0000","last_unstale":"2023-11-27T17:53:25.011932+0000","last_undegraded":"2023-11-27T17:53:25.011932+0000","last_fullsized":"2023-11-27T17:53:25.011932+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:02:44.445465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479554+0000","last_change":"2023-11-27T17:53:24.049816+0000","last_active":"2023-11-27T17:53:25.479554+0000","last_peered":"2023-11-27T17:53:25.479554+0000","last_clean":"2023-11-27T17:53:25.479554+0000","last_became_active":"2023-11-27T17:53:24.049411+0000","last_became_peered":"2023-11-27T17:53:24.049411+0000","last_unstale":"2023-11-27T17:53:25.479554+0000","last_undegraded":"2023-11-27T17:53:25.479554+0000","last_fullsized":"2023-11-27T17:53:25.479554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:25:13.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395686+0000","last_change":"2023-11-27T17:53:23.052664+0000","last_active":"2023-11-27T17:53:25.395686+0000","last_peered":"2023-11-27T17:53:25.395686+0000","last_clean":"2023-11-27T17:53:25.395686+0000","last_became_active":"2023-11-27T17:53:23.052116+0000","last_became_peered":"2023-11-27T17:53:23.052116+0000","last_unstale":"2023-11-27T17:53:25.395686+0000","last_undegraded":"2023-11-27T17:53:25.395686+0000","last_fullsized":"2023-11-27T17:53:25.395686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:11.046142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004154+0000","last_change":"2023-11-27T17:53:24.065880+0000","last_active":"2023-11-27T17:53:26.004154+0000","last_peered":"2023-11-27T17:53:26.004154+0000","last_clean":"2023-11-27T17:53:26.004154+0000","last_became_active":"2023-11-27T17:53:24.065598+0000","last_became_peered":"2023-11-27T17:53:24.065598+0000","last_unstale":"2023-11-27T17:53:26.004154+0000","last_undegraded":"2023-11-27T17:53:26.004154+0000","last_fullsized":"2023-11-27T17:53:26.004154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:45:08.111590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018350+0000","last_change":"2023-11-27T17:53:24.058438+0000","last_active":"2023-11-27T17:53:25.018350+0000","last_peered":"2023-11-27T17:53:25.018350+0000","last_clean":"2023-11-27T17:53:25.018350+0000","last_became_active":"2023-11-27T17:53:24.058100+0000","last_became_peered":"2023-11-27T17:53:24.058100+0000","last_unstale":"2023-11-27T17:53:25.018350+0000","last_undegraded":"2023-11-27T17:53:25.018350+0000","last_fullsized":"2023-11-27T17:53:25.018350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:12:23.694932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395155+0000","last_change":"2023-11-27T17:53:23.057372+0000","last_active":"2023-11-27T17:53:25.395155+0000","last_peered":"2023-11-27T17:53:25.395155+0000","last_clean":"2023-11-27T17:53:25.395155+0000","last_became_active":"2023-11-27T17:53:23.056729+0000","last_became_peered":"2023-11-27T17:53:23.056729+0000","last_unstale":"2023-11-27T17:53:25.395155+0000","last_undegraded":"2023-11-27T17:53:25.395155+0000","last_fullsized":"2023-11-27T17:53:25.395155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:41:54.355928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.018999+0000","last_change":"2023-11-27T17:53:24.042985+0000","last_active":"2023-11-27T17:53:25.018999+0000","last_peered":"2023-11-27T17:53:25.018999+0000","last_clean":"2023-11-27T17:53:25.018999+0000","last_became_active":"2023-11-27T17:53:24.042169+0000","last_became_peered":"2023-11-27T17:53:24.042169+0000","last_unstale":"2023-11-27T17:53:25.018999+0000","last_undegraded":"2023-11-27T17:53:25.018999+0000","last_fullsized":"2023-11-27T17:53:25.018999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:29:14.184726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.395483+0000","last_change":"2023-11-27T17:53:23.060149+0000","last_active":"2023-11-27T17:53:25.395483+0000","last_peered":"2023-11-27T17:53:25.395483+0000","last_clean":"2023-11-27T17:53:25.395483+0000","last_became_active":"2023-11-27T17:53:23.059061+0000","last_became_peered":"2023-11-27T17:53:23.059061+0000","last_unstale":"2023-11-27T17:53:25.395483+0000","last_undegraded":"2023-11-27T17:53:25.395483+0000","last_fullsized":"2023-11-27T17:53:25.395483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:02:44.445465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.003787+0000","last_change":"2023-11-27T17:53:24.072023+0000","last_active":"2023-11-27T17:53:26.003787+0000","last_peered":"2023-11-27T17:53:26.003787+0000","last_clean":"2023-11-27T17:53:26.003787+0000","last_became_active":"2023-11-27T17:53:24.071654+0000","last_became_peered":"2023-11-27T17:53:24.071654+0000","last_unstale":"2023-11-27T17:53:26.003787+0000","last_undegraded":"2023-11-27T17:53:26.003787+0000","last_fullsized":"2023-11-27T17:53:26.003787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:47:12.057622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479498+0000","last_change":"2023-11-27T17:53:23.041663+0000","last_active":"2023-11-27T17:53:25.479498+0000","last_peered":"2023-11-27T17:53:25.479498+0000","last_clean":"2023-11-27T17:53:25.479498+0000","last_became_active":"2023-11-27T17:53:23.039923+0000","last_became_peered":"2023-11-27T17:53:23.039923+0000","last_unstale":"2023-11-27T17:53:25.479498+0000","last_undegraded":"2023-11-27T17:53:25.479498+0000","last_fullsized":"2023-11-27T17:53:25.479498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:58:39.365122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:25.479266+0000","last_change":"2023-11-27T17:53:24.051978+0000","last_active":"2023-11-27T17:53:25.479266+0000","last_peered":"2023-11-27T17:53:25.479266+0000","last_clean":"2023-11-27T17:53:25.479266+0000","last_became_active":"2023-11-27T17:53:24.051656+0000","last_became_peered":"2023-11-27T17:53:24.051656+0000","last_unstale":"2023-11-27T17:53:25.479266+0000","last_undegraded":"2023-11-27T17:53:25.479266+0000","last_fullsized":"2023-11-27T17:53:25.479266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:22.990747+0000","last_clean_scrub_stamp":"2023-11-27T17:53:22.990747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:43:50.934311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-27T17:53:26.004097+0000","last_change":"2023-11-27T17:53:23.057889+0000","last_active":"2023-11-27T17:53:26.004097+0000","last_peered":"2023-11-27T17:53:26.004097+0000","last_clean":"2023-11-27T17:53:26.004097+0000","last_became_active":"2023-11-27T17:53:23.057602+0000","last_became_peered":"2023-11-27T17:53:23.057602+0000","last_unstale":"2023-11-27T17:53:26.004097+0000","last_undegraded":"2023-11-27T17:53:26.004097+0000","last_fullsized":"2023-11-27T17:53:26.004097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:21.979267+0000","last_clean_scrub_stamp":"2023-11-27T17:53:21.979267+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:05:18.882272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.012}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:53:31.595 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-27T17:53:31.595 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-27T17:53:31.595 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-27T17:53:31.596 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-27T17:53:31.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.745+0000 7eff12288640 1 Processor -- start 2023-11-27T17:53:31.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.745+0000 7eff12288640 1 -- start start 2023-11-27T17:53:31.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff12288640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7eff0c1418e0 0x7eff0c0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff12288640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c0b5880 con 0x7eff0c072510 2023-11-27T17:53:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff12288640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c0b6100 con 0x7eff0c141cc0 2023-11-27T17:53:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff12288640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0c0b6ff0 con 0x7eff0c1418e0 2023-11-27T17:53:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff10825640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7eff0c072510 0x7eff0c14ad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46214/0 (socket says 172.21.15.31:46214) 2023-11-27T17:53:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff10825640 1 -- 172.21.15.31:0/341850256 learned_addr learned my addr 172.21.15.31:0/341850256 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0bfff640 1 --2- 172.21.15.31:0/341850256 >> v2:172.21.15.81:3300/0 conn(0x7eff0c1418e0 0x7eff0c0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421453665 0 0) 0x7eff0c0b5880 con 0x7eff0c072510 2023-11-27T17:53:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efef8004640 con 0x7eff0c072510 2023-11-27T17:53:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2024104530 0 0) 0x7efef8004640 con 0x7eff0c072510 2023-11-27T17:53:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 >> v2:172.21.15.81:3300/0 conn(0x7eff0c1418e0 msgr2=0x7eff0c0b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 --2- 172.21.15.31:0/341850256 >> v2:172.21.15.81:3300/0 conn(0x7eff0c1418e0 0x7eff0c0b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.753 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 >> v1:172.21.15.81:6789/0 conn(0x7eff0c141cc0 legacy=0x7eff0c0b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0b6590 con 0x7eff0c072510 2023-11-27T17:53:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7efefc001680 con 0x7eff0c072510 2023-11-27T17:53:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 >> v1:172.21.15.31:6789/0 conn(0x7eff0c072510 legacy=0x7eff0c14ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 --2- 172.21.15.31:0/341850256 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efef8004b00 0x7efef8004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 --2- 172.21.15.31:0/341850256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efef80058e0 0x7efef8005d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 --2- 172.21.15.31:0/341850256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efef80062a0 0x7efef800caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0b6ff0 con 0x7efef80058e0 2023-11-27T17:53:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef800d1b0 con 0x7efef80062a0 2023-11-27T17:53:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef800d370 con 0x7efef8004b00 2023-11-27T17:53:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0b7fe640 1 --2- 172.21.15.31:0/341850256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efef80058e0 0x7efef8005d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0bfff640 1 --2- 172.21.15.31:0/341850256 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efef8004b00 0x7efef8004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.754 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0b7fe640 1 -- 172.21.15.31:0/341850256 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efef8004b00 msgr2=0x7efef8004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:31.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0b7fe640 1 --2- 172.21.15.31:0/341850256 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efef8004b00 0x7efef8004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0b7fe640 1 -- 172.21.15.31:0/341850256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efef80062a0 msgr2=0x7efef800caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:31.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0b7fe640 1 --2- 172.21.15.31:0/341850256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efef80062a0 0x7efef800caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0b7fe640 1 -- 172.21.15.31:0/341850256 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef8004640 con 0x7efef80058e0 2023-11-27T17:53:31.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0bfff640 1 --2- 172.21.15.31:0/341850256 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efef8004b00 0x7efef8004f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:31.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff10825640 1 -- 172.21.15.31:0/341850256 reap_dead start 2023-11-27T17:53:31.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0b7fe640 1 --2- 172.21.15.31:0/341850256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efef80058e0 0x7efef8005d60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efef4001e70 tx=0x7efef401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b00ba874daab606 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:31.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef4003b80 con 0x7efef80058e0 2023-11-27T17:53:31.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef4003ce0 con 0x7efef80058e0 2023-11-27T17:53:31.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.749+0000 7eff0affd640 1 -- 172.21.15.31:0/341850256 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40052c0 con 0x7efef80058e0 2023-11-27T17:53:31.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 -- 172.21.15.31:0/341850256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efef80058e0 msgr2=0x7efef8005d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 --2- 172.21.15.31:0/341850256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efef80058e0 0x7efef8005d60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efef4001e70 tx=0x7efef401c760 comp rx=0 tx=0).stop 2023-11-27T17:53:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 -- 172.21.15.31:0/341850256 shutdown_connections 2023-11-27T17:53:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 --2- 172.21.15.31:0/341850256 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efef80058e0 0x7efef8005d60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 -- 172.21.15.31:0/341850256 >> 172.21.15.31:0/341850256 conn(0x7eff0c06ab60 msgr2=0x7eff0c0bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 -- 172.21.15.31:0/341850256 shutdown_connections 2023-11-27T17:53:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 -- 172.21.15.31:0/341850256 wait complete. 2023-11-27T17:53:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 Processor -- start 2023-11-27T17:53:31.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 -- start start 2023-11-27T17:53:31.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efef80058e0 0x7eff0c1de9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c0baf30 0x7eff0c0bb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c13ed90 0x7eff0c13f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c143f40 con 0x7eff0c13ed90 2023-11-27T17:53:31.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0bab10 con 0x7eff0c0baf30 2023-11-27T17:53:31.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0bb8d0 con 0x7efef80058e0 2023-11-27T17:53:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff10825640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c13ed90 0x7eff0c13f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff10825640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c13ed90 0x7eff0c13f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51376/0 (socket says 172.21.15.31:51376) 2023-11-27T17:53:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff10825640 1 -- 172.21.15.31:0/2681906613 learned_addr learned my addr 172.21.15.31:0/2681906613 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff0b7fe640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c0baf30 0x7eff0c0bb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff0bfff640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efef80058e0 0x7eff0c1de9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff10825640 1 -- 172.21.15.31:0/2681906613 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efef80058e0 msgr2=0x7eff0c1de9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff10825640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efef80058e0 0x7eff0c1de9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff10825640 1 -- 172.21.15.31:0/2681906613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c0baf30 msgr2=0x7eff0c0bb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff10825640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c0baf30 0x7eff0c0bb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff10825640 1 -- 172.21.15.31:0/2681906613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c13f750 con 0x7eff0c13ed90 2023-11-27T17:53:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff10825640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c13ed90 0x7eff0c13f210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efefc001060 tx=0x7efefc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:31.760 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff08ff9640 1 -- 172.21.15.31:0/2681906613 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0074e0 con 0x7eff0c13ed90 2023-11-27T17:53:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff08ff9640 1 -- 172.21.15.31:0/2681906613 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc007660 con 0x7eff0c13ed90 2023-11-27T17:53:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 -- 172.21.15.31:0/2681906613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c0bd1e0 con 0x7eff0c13ed90 2023-11-27T17:53:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff08ff9640 1 -- 172.21.15.31:0/2681906613 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc004a30 con 0x7eff0c13ed90 2023-11-27T17:53:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 -- 172.21.15.31:0/2681906613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c1df5b0 con 0x7eff0c13ed90 2023-11-27T17:53:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.753+0000 7eff12288640 1 -- 172.21.15.31:0/2681906613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c04e850 con 0x7eff0c13ed90 2023-11-27T17:53:31.761 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.757+0000 7eff08ff9640 1 -- 172.21.15.31:0/2681906613 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7efefc004b90 con 0x7eff0c13ed90 2023-11-27T17:53:31.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.757+0000 7eff08ff9640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efeec0667e0 0x7efeec068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:31.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.757+0000 7eff08ff9640 1 -- 172.21.15.31:0/2681906613 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efefc083520 con 0x7eff0c13ed90 2023-11-27T17:53:31.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.757+0000 7eff0bfff640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efeec0667e0 0x7efeec068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:31.762 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.757+0000 7eff0bfff640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efeec0667e0 0x7efeec068ca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff0c06a490 tx=0x7eff04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:31.763 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.761+0000 7eff08ff9640 1 -- 172.21.15.31:0/2681906613 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7efefc0506b0 con 0x7eff0c13ed90 2023-11-27T17:53:31.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.941+0000 7eff12288640 1 -- 172.21.15.31:0/2681906613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7eff0c0b4600 con 0x7eff0c13ed90 2023-11-27T17:53:31.945 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.941+0000 7eff08ff9640 1 -- 172.21.15.31:0/2681906613 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7efefc053cd0 con 0x7eff0c13ed90 2023-11-27T17:53:31.945 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:31.946 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-27T17:53:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.945+0000 7eff12288640 1 -- 172.21.15.31:0/2681906613 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efeec0667e0 msgr2=0x7efeec068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.945+0000 7eff12288640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efeec0667e0 0x7efeec068ca0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff0c06a490 tx=0x7eff04008040 comp rx=0 tx=0).stop 2023-11-27T17:53:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.945+0000 7eff12288640 1 -- 172.21.15.31:0/2681906613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c13ed90 msgr2=0x7eff0c13f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.945+0000 7eff12288640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c13ed90 0x7eff0c13f210 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efefc001060 tx=0x7efefc00c8f0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.945+0000 7eff12288640 1 -- 172.21.15.31:0/2681906613 shutdown_connections 2023-11-27T17:53:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.945+0000 7eff12288640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efeec0667e0 0x7efeec068ca0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.945+0000 7eff12288640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff0c13ed90 0x7eff0c13f210 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.945+0000 7eff12288640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff0c0baf30 0x7eff0c0bb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.945+0000 7eff12288640 1 --2- 172.21.15.31:0/2681906613 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efef80058e0 0x7eff0c1de9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.945+0000 7eff12288640 1 -- 172.21.15.31:0/2681906613 >> 172.21.15.31:0/2681906613 conn(0x7eff0c06ab60 msgr2=0x7eff0c1d3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.945+0000 7eff12288640 1 -- 172.21.15.31:0/2681906613 shutdown_connections 2023-11-27T17:53:31.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:31.945+0000 7eff12288640 1 -- 172.21.15.31:0/2681906613 wait complete. 2023-11-27T17:53:31.963 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-27T17:53:31.964 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:32.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b3eb02640 1 Processor -- start 2023-11-27T17:53:32.084 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b3eb02640 1 -- start start 2023-11-27T17:53:32.086 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b3eb02640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9b380b9a30 0x7f9b38071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b3eb02640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b3814b700 0x7f9b381420b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b3eb02640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3806d5f0 con 0x7f9b3806cd00 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b3eb02640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3806e760 con 0x7f9b380b9a30 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b3eb02640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38072040 con 0x7f9b3814b700 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2ffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9b3806cd00 0x7f9b3806ddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46222/0 (socket says 172.21.15.31:46222) 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2ffff640 1 -- 172.21.15.31:0/2746035351 learned_addr learned my addr 172.21.15.31:0/2746035351 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b3c89e640 1 --2- 172.21.15.31:0/2746035351 >> v2:172.21.15.81:3300/0 conn(0x7f9b380b9a30 0x7f9b38071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b3d09f640 1 --2- 172.21.15.31:0/2746035351 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b3814b700 0x7f9b381420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312365254 0 0) 0x7f9b3806d5f0 con 0x7f9b3806cd00 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b20003530 con 0x7f9b3806cd00 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2572291149 0 0) 0x7f9b20003530 con 0x7f9b3806cd00 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b3814b700 msgr2=0x7f9b381420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:32.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 --2- 172.21.15.31:0/2746035351 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b3814b700 0x7f9b381420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 >> v2:172.21.15.81:3300/0 conn(0x7f9b380b9a30 msgr2=0x7f9b38071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 --2- 172.21.15.31:0/2746035351 >> v2:172.21.15.81:3300/0 conn(0x7f9b380b9a30 0x7f9b38071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b38072320 con 0x7f9b3806cd00 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f9b28001680 con 0x7f9b3806cd00 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 >> v1:172.21.15.31:6789/0 conn(0x7f9b3806cd00 legacy=0x7f9b3806ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 --2- 172.21.15.31:0/2746035351 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b3814b700 0x7f9b200039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 --2- 172.21.15.31:0/2746035351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b20003f70 0x7f9b200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 --2- 172.21.15.31:0/2746035351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b20004d10 0x7f9b20005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3806e760 con 0x7f9b20003f70 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38072040 con 0x7f9b20004d10 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2000ba40 con 0x7f9b3814b700 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2ffff640 1 --2- 172.21.15.31:0/2746035351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b20003f70 0x7f9b200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b3d09f640 1 --2- 172.21.15.31:0/2746035351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b20004d10 0x7f9b20005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.088 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2ffff640 1 -- 172.21.15.31:0/2746035351 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b3814b700 msgr2=0x7f9b200039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2ffff640 1 --2- 172.21.15.31:0/2746035351 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b3814b700 0x7f9b200039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2ffff640 1 -- 172.21.15.31:0/2746035351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b20004d10 msgr2=0x7f9b20005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2ffff640 1 --2- 172.21.15.31:0/2746035351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b20004d10 0x7f9b20005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b2ffff640 1 -- 172.21.15.31:0/2746035351 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b20003530 con 0x7f9b20003f70 2023-11-27T17:53:32.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.081+0000 7f9b3d09f640 1 --2- 172.21.15.31:0/2746035351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b20004d10 0x7f9b20005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b2ffff640 1 --2- 172.21.15.31:0/2746035351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b20003f70 0x7f9b200047d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800c240 tx=0x7f9b2801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e57a4215e53596e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b280a5960 con 0x7f9b20003f70 2023-11-27T17:53:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b280a5ac0 con 0x7f9b20003f70 2023-11-27T17:53:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b2f7fe640 1 -- 172.21.15.31:0/2746035351 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b280058e0 con 0x7f9b20003f70 2023-11-27T17:53:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2746035351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b20003f70 msgr2=0x7f9b200047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b3eb02640 1 --2- 172.21.15.31:0/2746035351 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b20003f70 0x7f9b200047d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800c240 tx=0x7f9b2801cc60 comp rx=0 tx=0).stop 2023-11-27T17:53:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b3d09f640 1 -- 172.21.15.31:0/2746035351 reap_dead start 2023-11-27T17:53:32.090 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2746035351 shutdown_connections 2023-11-27T17:53:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2746035351 >> 172.21.15.31:0/2746035351 conn(0x7f9b380ba8c0 msgr2=0x7f9b380bacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2746035351 shutdown_connections 2023-11-27T17:53:32.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2746035351 wait complete. 2023-11-27T17:53:32.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b3eb02640 1 Processor -- start 2023-11-27T17:53:32.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.085+0000 7f9b3eb02640 1 -- start start 2023-11-27T17:53:32.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3eb02640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b20003f70 0x7f9b38147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3eb02640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b381e4d70 0x7f9b381e0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3eb02640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b38148a10 0x7f9b3813db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3eb02640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38148010 con 0x7f9b38148a10 2023-11-27T17:53:32.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3eb02640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38144df0 con 0x7f9b381e4d70 2023-11-27T17:53:32.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3eb02640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b381e48e0 con 0x7f9b20003f70 2023-11-27T17:53:32.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3d09f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b38148a10 0x7f9b3813db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3d09f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b38148a10 0x7f9b3813db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51388/0 (socket says 172.21.15.31:51388) 2023-11-27T17:53:32.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3d09f640 1 -- 172.21.15.31:0/2274304973 learned_addr learned my addr 172.21.15.31:0/2274304973 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:32.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3c89e640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b20003f70 0x7f9b38147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b2ffff640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b381e4d70 0x7f9b381e0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3d09f640 1 -- 172.21.15.31:0/2274304973 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b20003f70 msgr2=0x7f9b38147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3d09f640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b20003f70 0x7f9b38147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3d09f640 1 -- 172.21.15.31:0/2274304973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b381e4d70 msgr2=0x7f9b381e0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3d09f640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b381e4d70 0x7f9b381e0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3d09f640 1 -- 172.21.15.31:0/2274304973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b380a3fd0 con 0x7f9b38148a10 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b2ffff640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b381e4d70 0x7f9b381e0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3c89e640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b20003f70 0x7f9b38147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3d09f640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b38148a10 0x7f9b3813db20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9b3814bb90 tx=0x7f9b3000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b2d7fa640 1 -- 172.21.15.31:0/2274304973 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000fe60 con 0x7f9b38148a10 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b2d7fa640 1 -- 172.21.15.31:0/2274304973 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b30011040 con 0x7f9b38148a10 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2274304973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b381e1150 con 0x7f9b38148a10 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b2d7fa640 1 -- 172.21.15.31:0/2274304973 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30017620 con 0x7f9b38148a10 2023-11-27T17:53:32.094 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2274304973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b381e4290 con 0x7f9b38148a10 2023-11-27T17:53:32.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2274304973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3804e850 con 0x7f9b38148a10 2023-11-27T17:53:32.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b2d7fa640 1 -- 172.21.15.31:0/2274304973 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9b300203b0 con 0x7f9b38148a10 2023-11-27T17:53:32.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b2d7fa640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9b240667f0 0x7f9b24068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b2d7fa640 1 -- 172.21.15.31:0/2274304973 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b30084400 con 0x7f9b38148a10 2023-11-27T17:53:32.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3c89e640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9b240667f0 0x7f9b24068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.089+0000 7f9b3c89e640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9b240667f0 0x7f9b24068cb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9b340047c0 tx=0x7f9b34008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:32.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.093+0000 7f9b2d7fa640 1 -- 172.21.15.31:0/2274304973 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9b30051590 con 0x7f9b38148a10 2023-11-27T17:53:32.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.245+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2274304973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b381e4a20 con 0x7f9b38148a10 2023-11-27T17:53:32.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.245+0000 7f9b2d7fa640 1 -- 172.21.15.31:0/2274304973 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7f9b30054bb0 con 0x7f9b38148a10 2023-11-27T17:53:32.250 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:32.250 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:32.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.249+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2274304973 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9b240667f0 msgr2=0x7f9b24068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.249+0000 7f9b3eb02640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9b240667f0 0x7f9b24068cb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9b340047c0 tx=0x7f9b34008040 comp rx=0 tx=0).stop 2023-11-27T17:53:32.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.249+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2274304973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b38148a10 msgr2=0x7f9b3813db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.249+0000 7f9b3eb02640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b38148a10 0x7f9b3813db20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9b3814bb90 tx=0x7f9b3000f4a0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.249+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2274304973 shutdown_connections 2023-11-27T17:53:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.249+0000 7f9b3eb02640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9b240667f0 0x7f9b24068cb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.249+0000 7f9b3eb02640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9b38148a10 0x7f9b3813db20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.249+0000 7f9b3eb02640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b381e4d70 0x7f9b381e0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.249+0000 7f9b3eb02640 1 --2- 172.21.15.31:0/2274304973 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9b20003f70 0x7f9b38147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.249+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2274304973 >> 172.21.15.31:0/2274304973 conn(0x7f9b380ba8c0 msgr2=0x7f9b38070560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.249+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2274304973 shutdown_connections 2023-11-27T17:53:32.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.249+0000 7f9b3eb02640 1 -- 172.21.15.31:0/2274304973 wait complete. 2023-11-27T17:53:32.268 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:53:11.177026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:53:21.543531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:53:22.362977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:53:32.268 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:53:32.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.377+0000 7f3b07cdf640 1 Processor -- start 2023-11-27T17:53:32.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.377+0000 7f3b07cdf640 1 -- start start 2023-11-27T17:53:32.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b07cdf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b000b56f0 0x7f3b00157400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b07cdf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000b4d10 con 0x7f3b0014b440 2023-11-27T17:53:32.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b07cdf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000b4aa0 con 0x7f3b0006cda0 2023-11-27T17:53:32.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b07cdf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b000b5eb0 con 0x7f3b000b56f0 2023-11-27T17:53:32.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b0527a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3b0014b440 0x7f3b00153cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46224/0 (socket says 172.21.15.31:46224) 2023-11-27T17:53:32.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b0527a640 1 -- 172.21.15.31:0/27673658 learned_addr learned my addr 172.21.15.31:0/27673658 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:32.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b0627c640 1 --2- 172.21.15.31:0/27673658 >> v2:172.21.15.81:3300/0 conn(0x7f3b000b56f0 0x7f3b00157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031838303 0 0) 0x7f3b000b4d10 con 0x7f3b0014b440 2023-11-27T17:53:32.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aec003530 con 0x7f3b0014b440 2023-11-27T17:53:32.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1021274076 0 0) 0x7f3aec003530 con 0x7f3b0014b440 2023-11-27T17:53:32.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 >> v2:172.21.15.81:3300/0 conn(0x7f3b000b56f0 msgr2=0x7f3b00157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:32.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 --2- 172.21.15.31:0/27673658 >> v2:172.21.15.81:3300/0 conn(0x7f3b000b56f0 0x7f3b00157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 >> v1:172.21.15.81:6789/0 conn(0x7f3b0006cda0 legacy=0x7f3b0014f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000b5bd0 con 0x7f3b0014b440 2023-11-27T17:53:32.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f3af0001680 con 0x7f3b0014b440 2023-11-27T17:53:32.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 >> v1:172.21.15.31:6789/0 conn(0x7f3b0014b440 legacy=0x7f3b00153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 --2- 172.21.15.31:0/27673658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aec0039f0 0x7f3aec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 --2- 172.21.15.31:0/27673658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 0x7f3aec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 --2- 172.21.15.31:0/27673658 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3aec005200 0x7f3aec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000b5eb0 con 0x7f3aec0047d0 2023-11-27T17:53:32.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec00c160 con 0x7f3aec0039f0 2023-11-27T17:53:32.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec00c320 con 0x7f3aec005200 2023-11-27T17:53:32.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b0527a640 1 --2- 172.21.15.31:0/27673658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 0x7f3aec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b0527a640 1 -- 172.21.15.31:0/27673658 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3aec005200 msgr2=0x7f3aec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:32.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b0627c640 1 --2- 172.21.15.31:0/27673658 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3aec005200 0x7f3aec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b05a7b640 1 --2- 172.21.15.31:0/27673658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aec0039f0 0x7f3aec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b0527a640 1 --2- 172.21.15.31:0/27673658 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3aec005200 0x7f3aec00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b0527a640 1 -- 172.21.15.31:0/27673658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aec0039f0 msgr2=0x7f3aec003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:32.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b0527a640 1 --2- 172.21.15.31:0/27673658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aec0039f0 0x7f3aec003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b0527a640 1 -- 172.21.15.31:0/27673658 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec003530 con 0x7f3aec0047d0 2023-11-27T17:53:32.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b0627c640 1 -- 172.21.15.31:0/27673658 reap_dead start 2023-11-27T17:53:32.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b05a7b640 1 --2- 172.21.15.31:0/27673658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3aec0039f0 0x7f3aec003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:32.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b0527a640 1 --2- 172.21.15.31:0/27673658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 0x7f3aec004c50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3b000710b0 tx=0x7f3af001cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9cd6f1d156652b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:32.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0005ae0 con 0x7f3aec0047d0 2023-11-27T17:53:32.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af0005c60 con 0x7f3aec0047d0 2023-11-27T17:53:32.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.381+0000 7f3b04a79640 1 -- 172.21.15.31:0/27673658 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0007070 con 0x7f3aec0047d0 2023-11-27T17:53:32.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 -- 172.21.15.31:0/27673658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 msgr2=0x7f3aec004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 --2- 172.21.15.31:0/27673658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 0x7f3aec004c50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3b000710b0 tx=0x7f3af001cb20 comp rx=0 tx=0).stop 2023-11-27T17:53:32.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 -- 172.21.15.31:0/27673658 shutdown_connections 2023-11-27T17:53:32.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 --2- 172.21.15.31:0/27673658 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 0x7f3aec004c50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 -- 172.21.15.31:0/27673658 >> 172.21.15.31:0/27673658 conn(0x7f3b000bb7d0 msgr2=0x7f3b000bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 -- 172.21.15.31:0/27673658 shutdown_connections 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 -- 172.21.15.31:0/27673658 wait complete. 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 Processor -- start 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 -- start start 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 0x7f3b0014cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b0006f5d0 0x7f3b0006fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0014d810 0x7f3b0014dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0014cff0 con 0x7f3aec0047d0 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b001d7bf0 con 0x7f3b0014d810 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0014d4c0 con 0x7f3b0006f5d0 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b05a7b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 0x7f3b0014cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b05a7b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 0x7f3b0014cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51408/0 (socket says 172.21.15.31:51408) 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b05a7b640 1 -- 172.21.15.31:0/1628210331 learned_addr learned my addr 172.21.15.31:0/1628210331 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:32.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b0527a640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b0006f5d0 0x7f3b0006fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b0627c640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0014d810 0x7f3b0014dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b05a7b640 1 -- 172.21.15.31:0/1628210331 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b0006f5d0 msgr2=0x7f3b0006fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b05a7b640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b0006f5d0 0x7f3b0006fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b05a7b640 1 -- 172.21.15.31:0/1628210331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0014d810 msgr2=0x7f3b0014dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b05a7b640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0014d810 0x7f3b0014dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b05a7b640 1 -- 172.21.15.31:0/1628210331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0014d1e0 con 0x7f3aec0047d0 2023-11-27T17:53:32.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b05a7b640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 0x7f3b0014cab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00d4d0 tx=0x7f3afc00d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:32.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3af67fc640 1 -- 172.21.15.31:0/1628210331 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc005480 con 0x7f3aec0047d0 2023-11-27T17:53:32.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3af67fc640 1 -- 172.21.15.31:0/1628210331 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc007030 con 0x7f3aec0047d0 2023-11-27T17:53:32.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 -- 172.21.15.31:0/1628210331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0006edd0 con 0x7f3aec0047d0 2023-11-27T17:53:32.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3af67fc640 1 -- 172.21.15.31:0/1628210331 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc0073e0 con 0x7f3aec0047d0 2023-11-27T17:53:32.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 -- 172.21.15.31:0/1628210331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0006dfb0 con 0x7f3aec0047d0 2023-11-27T17:53:32.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.385+0000 7f3b07cdf640 1 -- 172.21.15.31:0/1628210331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0004e850 con 0x7f3aec0047d0 2023-11-27T17:53:32.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.389+0000 7f3af67fc640 1 -- 172.21.15.31:0/1628210331 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3afc007540 con 0x7f3aec0047d0 2023-11-27T17:53:32.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.389+0000 7f3af67fc640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3ae40667f0 0x7f3ae4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.389+0000 7f3af67fc640 1 -- 172.21.15.31:0/1628210331 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3afc083ad0 con 0x7f3aec0047d0 2023-11-27T17:53:32.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.389+0000 7f3b0527a640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3ae40667f0 0x7f3ae4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.389+0000 7f3b0527a640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3ae40667f0 0x7f3ae4068cb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3af00ab000 tx=0x7f3af00a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:32.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.393+0000 7f3af67fc640 1 -- 172.21.15.31:0/1628210331 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f3afc050d20 con 0x7f3aec0047d0 2023-11-27T17:53:32.549 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.545+0000 7f3b07cdf640 1 -- 172.21.15.31:0/1628210331 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b000b4750 con 0x7f3aec0047d0 2023-11-27T17:53:32.550 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.545+0000 7f3af67fc640 1 -- 172.21.15.31:0/1628210331 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3afc019020 con 0x7f3aec0047d0 2023-11-27T17:53:32.550 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-11-27T17:53:32.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.549+0000 7f3b07cdf640 1 -- 172.21.15.31:0/1628210331 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3ae40667f0 msgr2=0x7f3ae4068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.549+0000 7f3b07cdf640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3ae40667f0 0x7f3ae4068cb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3af00ab000 tx=0x7f3af00a7070 comp rx=0 tx=0).stop 2023-11-27T17:53:32.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.549+0000 7f3b07cdf640 1 -- 172.21.15.31:0/1628210331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 msgr2=0x7f3b0014cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.549+0000 7f3b07cdf640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 0x7f3b0014cab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00d4d0 tx=0x7f3afc00d990 comp rx=0 tx=0).stop 2023-11-27T17:53:32.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.549+0000 7f3b07cdf640 1 -- 172.21.15.31:0/1628210331 shutdown_connections 2023-11-27T17:53:32.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.549+0000 7f3b07cdf640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3ae40667f0 0x7f3ae4068cb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.552 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.549+0000 7f3b07cdf640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0014d810 0x7f3b0014dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.549+0000 7f3b07cdf640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b0006f5d0 0x7f3b0006fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.549+0000 7f3b07cdf640 1 --2- 172.21.15.31:0/1628210331 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3aec0047d0 0x7f3b0014cab0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.549+0000 7f3b07cdf640 1 -- 172.21.15.31:0/1628210331 >> 172.21.15.31:0/1628210331 conn(0x7f3b000bb7d0 msgr2=0x7f3b001483d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:32.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.549+0000 7f3b07cdf640 1 -- 172.21.15.31:0/1628210331 shutdown_connections 2023-11-27T17:53:32.553 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.549+0000 7f3b07cdf640 1 -- 172.21.15.31:0/1628210331 wait complete. 2023-11-27T17:53:32.568 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:53:32.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bb4d4a640 1 Processor -- start 2023-11-27T17:53:32.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bb4d4a640 1 -- start start 2023-11-27T17:53:32.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bb4d4a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9bb006ab90 0x7f9bb006af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bb4d4a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bb00b6da0 0x7f9bb0155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bb4d4a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb006b4b0 con 0x7f9bb00c0670 2023-11-27T17:53:32.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bb4d4a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb00bfbd0 con 0x7f9bb006ab90 2023-11-27T17:53:32.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bb4d4a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00b7ce0 con 0x7f9bb00b6da0 2023-11-27T17:53:32.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bae59c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9bb006ab90 0x7f9bb006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9badd9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9bb00c0670 0x7f9bb014b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46234/0 (socket says 172.21.15.31:46234) 2023-11-27T17:53:32.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9badd9b640 1 -- 172.21.15.31:0/362600379 learned_addr learned my addr 172.21.15.31:0/362600379 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:32.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9baed9d640 1 --2- 172.21.15.31:0/362600379 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bb00b6da0 0x7f9bb0155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bae59c640 1 -- 172.21.15.31:0/362600379 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bb00b6da0 msgr2=0x7f9bb0155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:32.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bae59c640 1 --2- 172.21.15.31:0/362600379 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bb00b6da0 0x7f9bb0155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bae59c640 1 -- 172.21.15.31:0/362600379 >> v1:172.21.15.31:6789/0 conn(0x7f9bb00c0670 legacy=0x7f9bb014b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bae59c640 1 -- 172.21.15.31:0/362600379 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb00bfe70 con 0x7f9bb006ab90 2023-11-27T17:53:32.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.677+0000 7f9bad59a640 1 -- 172.21.15.31:0/362600379 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182802605 0 0) 0x7f9bb006b4b0 con 0x7f9bb00c0670 2023-11-27T17:53:32.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.681+0000 7f9bae59c640 1 --2- 172.21.15.31:0/362600379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bb006ab90 0x7f9bb006af70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40097c0 tx=0x7f9ba401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81d9d8da03533c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:32.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.681+0000 7f9bad59a640 1 -- 172.21.15.31:0/362600379 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40ab600 con 0x7f9bb006ab90 2023-11-27T17:53:32.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.681+0000 7f9bad59a640 1 -- 172.21.15.31:0/362600379 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba40a7050 con 0x7f9bb006ab90 2023-11-27T17:53:32.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.681+0000 7f9bad59a640 1 -- 172.21.15.31:0/362600379 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40ab980 con 0x7f9bb006ab90 2023-11-27T17:53:32.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.681+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/362600379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bb006ab90 msgr2=0x7f9bb006af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.681+0000 7f9bb4d4a640 1 --2- 172.21.15.31:0/362600379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bb006ab90 0x7f9bb006af70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40097c0 tx=0x7f9ba401c480 comp rx=0 tx=0).stop 2023-11-27T17:53:32.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.681+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/362600379 shutdown_connections 2023-11-27T17:53:32.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.681+0000 7f9bb4d4a640 1 --2- 172.21.15.31:0/362600379 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bb00b6da0 0x7f9bb0155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.681+0000 7f9bb4d4a640 1 --2- 172.21.15.31:0/362600379 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bb006ab90 0x7f9bb006af70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.681+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/362600379 >> 172.21.15.31:0/362600379 conn(0x7f9bb00a28f0 msgr2=0x7f9bb00a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:32.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.681+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/362600379 shutdown_connections 2023-11-27T17:53:32.687 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.681+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/362600379 wait complete. 2023-11-27T17:53:32.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bb4d4a640 1 Processor -- start 2023-11-27T17:53:32.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bb4d4a640 1 -- start start 2023-11-27T17:53:32.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bb4d4a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb006ab90 0x7f9bb01434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bb4d4a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bb00b6da0 0x7f9bb014a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bb4d4a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bb00c0670 0x7f9bb01e3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bb4d4a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb014abf0 con 0x7f9bb00c0670 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bb4d4a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb01e7de0 con 0x7f9bb006ab90 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bb4d4a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb0143be0 con 0x7f9bb00b6da0 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9baed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bb00c0670 0x7f9bb01e3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9baed9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bb00c0670 0x7f9bb01e3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51430/0 (socket says 172.21.15.31:51430) 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9baed9d640 1 -- 172.21.15.31:0/814899122 learned_addr learned my addr 172.21.15.31:0/814899122 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bae59c640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb006ab90 0x7f9bb01434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9badd9b640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bb00b6da0 0x7f9bb014a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9baed9d640 1 -- 172.21.15.31:0/814899122 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bb00b6da0 msgr2=0x7f9bb014a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9baed9d640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bb00b6da0 0x7f9bb014a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9baed9d640 1 -- 172.21.15.31:0/814899122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb006ab90 msgr2=0x7f9bb01434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9baed9d640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb006ab90 0x7f9bb01434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9baed9d640 1 -- 172.21.15.31:0/814899122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba4009420 con 0x7f9bb00c0670 2023-11-27T17:53:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9baed9d640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bb00c0670 0x7f9bb01e3c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800cda0 tx=0x7f9ba800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9b9effd640 1 -- 172.21.15.31:0/814899122 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8003ba0 con 0x7f9bb00c0670 2023-11-27T17:53:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9b9effd640 1 -- 172.21.15.31:0/814899122 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba8003d00 con 0x7f9bb00c0670 2023-11-27T17:53:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/814899122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb01e74b0 con 0x7f9bb00c0670 2023-11-27T17:53:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9b9effd640 1 -- 172.21.15.31:0/814899122 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8004240 con 0x7f9bb00c0670 2023-11-27T17:53:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/814899122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb01e7a70 con 0x7f9bb00c0670 2023-11-27T17:53:32.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/814899122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb00a3490 con 0x7f9bb00c0670 2023-11-27T17:53:32.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9b9effd640 1 -- 172.21.15.31:0/814899122 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9ba80043a0 con 0x7f9bb00c0670 2023-11-27T17:53:32.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9b9effd640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9b900667f0 0x7f9b90068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9b9effd640 1 -- 172.21.15.31:0/814899122 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ba8012070 con 0x7f9bb00c0670 2023-11-27T17:53:32.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.685+0000 7f9bae59c640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9b900667f0 0x7f9b90068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.689+0000 7f9bae59c640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9b900667f0 0x7f9b90068cb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40ad000 tx=0x7f9ba40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:32.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.689+0000 7f9b9effd640 1 -- 172.21.15.31:0/814899122 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9ba8051d80 con 0x7f9bb00c0670 2023-11-27T17:53:32.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.837+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/814899122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9bb004e850 con 0x7f9bb00c0670 2023-11-27T17:53:32.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9b9effd640 1 -- 172.21.15.31:0/814899122 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ba80553a0 con 0x7f9bb00c0670 2023-11-27T17:53:32.844 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-11-27T17:53:32.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/814899122 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9b900667f0 msgr2=0x7f9b90068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9bb4d4a640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9b900667f0 0x7f9b90068cb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40ad000 tx=0x7f9ba40a6000 comp rx=0 tx=0).stop 2023-11-27T17:53:32.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/814899122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bb00c0670 msgr2=0x7f9bb01e3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9bb4d4a640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bb00c0670 0x7f9bb01e3c80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800cda0 tx=0x7f9ba800a660 comp rx=0 tx=0).stop 2023-11-27T17:53:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/814899122 shutdown_connections 2023-11-27T17:53:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9bb4d4a640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9b900667f0 0x7f9b90068cb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9bb4d4a640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9bb00c0670 0x7f9bb01e3c80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9bb4d4a640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9bb00b6da0 0x7f9bb014a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9bb4d4a640 1 --2- 172.21.15.31:0/814899122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9bb006ab90 0x7f9bb01434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/814899122 >> 172.21.15.31:0/814899122 conn(0x7f9bb00a28f0 msgr2=0x7f9bb00a0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/814899122 shutdown_connections 2023-11-27T17:53:32.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.841+0000 7f9bb4d4a640 1 -- 172.21.15.31:0/814899122 wait complete. 2023-11-27T17:53:32.862 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:53:32.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.973+0000 7f303b022640 1 Processor -- start 2023-11-27T17:53:32.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.973+0000 7f303b022640 1 -- start start 2023-11-27T17:53:32.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f303b022640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f30340b6da0 0x7f30340b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f303b022640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30340bfbd0 con 0x7f303406ab90 2023-11-27T17:53:32.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f303b022640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30340b7ce0 con 0x7f30340c0670 2023-11-27T17:53:32.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f303b022640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30340bfe70 con 0x7f30340b6da0 2023-11-27T17:53:32.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f30395bf640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f30340b6da0 0x7f30340b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f3038dbe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f303406ab90 0x7f303406af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46238/0 (socket says 172.21.15.31:46238) 2023-11-27T17:53:32.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f3038dbe640 1 -- 172.21.15.31:0/1622334581 learned_addr learned my addr 172.21.15.31:0/1622334581 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:32.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f30395bf640 1 -- 172.21.15.31:0/1622334581 >> v1:172.21.15.81:6789/0 conn(0x7f30340c0670 legacy=0x7f303414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f30395bf640 1 -- 172.21.15.31:0/1622334581 >> v1:172.21.15.31:6789/0 conn(0x7f303406ab90 legacy=0x7f303406af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f30395bf640 1 -- 172.21.15.31:0/1622334581 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340c0150 con 0x7f30340b6da0 2023-11-27T17:53:32.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f30395bf640 1 --2- 172.21.15.31:0/1622334581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30340b6da0 0x7f30340b7210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f302c009d90 tx=0x7f302c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb96fbdd7c89f423 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:32.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f30337fe640 1 -- 172.21.15.31:0/1622334581 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0a5920 con 0x7f30340b6da0 2023-11-27T17:53:32.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f30337fe640 1 -- 172.21.15.31:0/1622334581 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c0a5a80 con 0x7f30340b6da0 2023-11-27T17:53:32.982 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f30337fe640 1 -- 172.21.15.31:0/1622334581 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0a5e10 con 0x7f30340b6da0 2023-11-27T17:53:32.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f303b022640 1 -- 172.21.15.31:0/1622334581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30340b6da0 msgr2=0x7f30340b7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f303b022640 1 --2- 172.21.15.31:0/1622334581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30340b6da0 0x7f30340b7210 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f302c009d90 tx=0x7f302c01c950 comp rx=0 tx=0).stop 2023-11-27T17:53:32.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f303b022640 1 -- 172.21.15.31:0/1622334581 shutdown_connections 2023-11-27T17:53:32.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f303b022640 1 --2- 172.21.15.31:0/1622334581 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30340b6da0 0x7f30340b7210 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f303b022640 1 -- 172.21.15.31:0/1622334581 >> 172.21.15.31:0/1622334581 conn(0x7f30340a28f0 msgr2=0x7f30340a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:32.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f303b022640 1 -- 172.21.15.31:0/1622334581 shutdown_connections 2023-11-27T17:53:32.983 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.977+0000 7f303b022640 1 -- 172.21.15.31:0/1622334581 wait complete. 2023-11-27T17:53:32.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f303b022640 1 Processor -- start 2023-11-27T17:53:32.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f303b022640 1 -- start start 2023-11-27T17:53:32.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f303b022640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f303406ab90 0x7f303413c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f303b022640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30340b6da0 0x7f30341e3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f303b022640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30340c0670 0x7f30340b9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f303b022640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034136e60 con 0x7f303406ab90 2023-11-27T17:53:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f303b022640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30341e4c80 con 0x7f30340b6da0 2023-11-27T17:53:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f303b022640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303413b2f0 con 0x7f30340c0670 2023-11-27T17:53:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f3038dbe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f303406ab90 0x7f303413c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f3038dbe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f303406ab90 0x7f303413c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51452/0 (socket says 172.21.15.31:51452) 2023-11-27T17:53:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f3038dbe640 1 -- 172.21.15.31:0/1015739779 learned_addr learned my addr 172.21.15.31:0/1015739779 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f30395bf640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30340c0670 0x7f30340b9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f3033fff640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30340b6da0 0x7f30341e3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f3038dbe640 1 -- 172.21.15.31:0/1015739779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30340c0670 msgr2=0x7f30340b9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f3038dbe640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30340c0670 0x7f30340b9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f3038dbe640 1 -- 172.21.15.31:0/1015739779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30340b6da0 msgr2=0x7f30341e3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f3038dbe640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30340b6da0 0x7f30341e3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f3038dbe640 1 -- 172.21.15.31:0/1015739779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c009a70 con 0x7f303406ab90 2023-11-27T17:53:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f3038dbe640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f303406ab90 0x7f303413c6d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f302800c400 tx=0x7f302800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f30317fa640 1 -- 172.21.15.31:0/1015739779 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3028005cf0 con 0x7f303406ab90 2023-11-27T17:53:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f30317fa640 1 -- 172.21.15.31:0/1015739779 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3028005e50 con 0x7f303406ab90 2023-11-27T17:53:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f303b022640 1 -- 172.21.15.31:0/1015739779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30341e46c0 con 0x7f303406ab90 2023-11-27T17:53:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f30317fa640 1 -- 172.21.15.31:0/1015739779 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30280072d0 con 0x7f303406ab90 2023-11-27T17:53:32.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f303b022640 1 -- 172.21.15.31:0/1015739779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303413cc10 con 0x7f303406ab90 2023-11-27T17:53:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f303b022640 1 -- 172.21.15.31:0/1015739779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303413ce30 con 0x7f303406ab90 2023-11-27T17:53:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.981+0000 7f30317fa640 1 -- 172.21.15.31:0/1015739779 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3028007430 con 0x7f303406ab90 2023-11-27T17:53:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.985+0000 7f30317fa640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f30200667f0 0x7f3020068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.985+0000 7f30317fa640 1 -- 172.21.15.31:0/1015739779 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3028083720 con 0x7f303406ab90 2023-11-27T17:53:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.985+0000 7f3033fff640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f30200667f0 0x7f3020068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:32.988 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.985+0000 7f3033fff640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f30200667f0 0x7f3020068cb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f303413c490 tx=0x7f3024009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:32.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:32.989+0000 7f30317fa640 1 -- 172.21.15.31:0/1015739779 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f30280508d0 con 0x7f303406ab90 2023-11-27T17:53:33.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 -- 172.21.15.31:0/1015739779 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f303404e850 con 0x7f303406ab90 2023-11-27T17:53:33.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f30317fa640 1 -- 172.21.15.31:0/1015739779 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3028017020 con 0x7f303406ab90 2023-11-27T17:53:33.148 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-11-27T17:53:33.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 -- 172.21.15.31:0/1015739779 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f30200667f0 msgr2=0x7f3020068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f30200667f0 0x7f3020068cb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f303413c490 tx=0x7f3024009040 comp rx=0 tx=0).stop 2023-11-27T17:53:33.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 -- 172.21.15.31:0/1015739779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f303406ab90 msgr2=0x7f303413c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f303406ab90 0x7f303413c6d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f302800c400 tx=0x7f302800c8c0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 -- 172.21.15.31:0/1015739779 shutdown_connections 2023-11-27T17:53:33.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f30200667f0 0x7f3020068cb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f30340c0670 0x7f30340b9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.150 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30340b6da0 0x7f30341e3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 --2- 172.21.15.31:0/1015739779 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f303406ab90 0x7f303413c6d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 -- 172.21.15.31:0/1015739779 >> 172.21.15.31:0/1015739779 conn(0x7f30340a28f0 msgr2=0x7f30340a0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:33.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 -- 172.21.15.31:0/1015739779 shutdown_connections 2023-11-27T17:53:33.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.145+0000 7f303b022640 1 -- 172.21.15.31:0/1015739779 wait complete. 2023-11-27T17:53:33.166 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:53:33.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.285+0000 7f28b78ae640 1 Processor -- start 2023-11-27T17:53:33.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.285+0000 7f28b78ae640 1 -- start start 2023-11-27T17:53:33.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.285+0000 7f28b78ae640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f28b014e880 0x7f28b00b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.285+0000 7f28b78ae640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b00b8d90 con 0x7f28b00b8440 2023-11-27T17:53:33.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.285+0000 7f28b78ae640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b00c1b70 con 0x7f28b0144dd0 2023-11-27T17:53:33.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.285+0000 7f28b78ae640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b00ba130 con 0x7f28b014e880 2023-11-27T17:53:33.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.285+0000 7f28b564a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f28b00b8440 0x7f28b00bcf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46252/0 (socket says 172.21.15.31:46252) 2023-11-27T17:53:33.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.285+0000 7f28b564a640 1 -- 172.21.15.31:0/1256936177 learned_addr learned my addr 172.21.15.31:0/1256936177 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:33.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.285+0000 7f28b4e49640 1 --2- 172.21.15.31:0/1256936177 >> v2:172.21.15.31:3300/0 conn(0x7f28b014e880 0x7f28b00b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.285+0000 7f28b4e49640 1 -- 172.21.15.31:0/1256936177 >> v1:172.21.15.81:6789/0 conn(0x7f28b0144dd0 legacy=0x7f28b0155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.285+0000 7f28b4e49640 1 -- 172.21.15.31:0/1256936177 >> v1:172.21.15.31:6789/0 conn(0x7f28b00b8440 legacy=0x7f28b00bcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.289 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.285+0000 7f28b4e49640 1 -- 172.21.15.31:0/1256936177 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b006be20 con 0x7f28b014e880 2023-11-27T17:53:33.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b4e49640 1 --2- 172.21.15.31:0/1256936177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b014e880 0x7f28b00b9220 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f28a00097c0 tx=0x7f28a001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1002ebb21f9e564 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:33.291 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28a7fff640 1 -- 172.21.15.31:0/1256936177 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00a8970 con 0x7f28b014e880 2023-11-27T17:53:33.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28a7fff640 1 -- 172.21.15.31:0/1256936177 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a00a8ad0 con 0x7f28b014e880 2023-11-27T17:53:33.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28a7fff640 1 -- 172.21.15.31:0/1256936177 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00a8e60 con 0x7f28b014e880 2023-11-27T17:53:33.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 -- 172.21.15.31:0/1256936177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b014e880 msgr2=0x7f28b00b9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 --2- 172.21.15.31:0/1256936177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b014e880 0x7f28b00b9220 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f28a00097c0 tx=0x7f28a001ec70 comp rx=0 tx=0).stop 2023-11-27T17:53:33.292 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 -- 172.21.15.31:0/1256936177 shutdown_connections 2023-11-27T17:53:33.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 --2- 172.21.15.31:0/1256936177 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b014e880 0x7f28b00b9220 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 -- 172.21.15.31:0/1256936177 >> 172.21.15.31:0/1256936177 conn(0x7f28b00c0ce0 msgr2=0x7f28b00c10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:33.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 -- 172.21.15.31:0/1256936177 shutdown_connections 2023-11-27T17:53:33.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 -- 172.21.15.31:0/1256936177 wait complete. 2023-11-27T17:53:33.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 Processor -- start 2023-11-27T17:53:33.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 -- start start 2023-11-27T17:53:33.295 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f28b00b8440 0x7f28b0145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28b0144dd0 0x7f28b0146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b014e880 0x7f28b0139820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b01e0c70 con 0x7f28b014e880 2023-11-27T17:53:33.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b01481b0 con 0x7f28b0144dd0 2023-11-27T17:53:33.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b78ae640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b0148490 con 0x7f28b00b8440 2023-11-27T17:53:33.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b5e4b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b014e880 0x7f28b0139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b564a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f28b00b8440 0x7f28b0145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b5e4b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b014e880 0x7f28b0139820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51482/0 (socket says 172.21.15.31:51482) 2023-11-27T17:53:33.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b5e4b640 1 -- 172.21.15.31:0/3627142336 learned_addr learned my addr 172.21.15.31:0/3627142336 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:33.296 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b4e49640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28b0144dd0 0x7f28b0146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b5e4b640 1 -- 172.21.15.31:0/3627142336 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f28b00b8440 msgr2=0x7f28b0145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b5e4b640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f28b00b8440 0x7f28b0145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b5e4b640 1 -- 172.21.15.31:0/3627142336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28b0144dd0 msgr2=0x7f28b0146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b5e4b640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28b0144dd0 0x7f28b0146530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.289+0000 7f28b5e4b640 1 -- 172.21.15.31:0/3627142336 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a0009420 con 0x7f28b014e880 2023-11-27T17:53:33.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.293+0000 7f28b5e4b640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b014e880 0x7f28b0139820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f28a800c770 tx=0x7f28a800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:33.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.293+0000 7f28a5ffb640 1 -- 172.21.15.31:0/3627142336 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a8003b80 con 0x7f28b014e880 2023-11-27T17:53:33.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.293+0000 7f28a5ffb640 1 -- 172.21.15.31:0/3627142336 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a8003ce0 con 0x7f28b014e880 2023-11-27T17:53:33.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.293+0000 7f28b78ae640 1 -- 172.21.15.31:0/3627142336 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b0148770 con 0x7f28b014e880 2023-11-27T17:53:33.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.293+0000 7f28a5ffb640 1 -- 172.21.15.31:0/3627142336 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a800aa90 con 0x7f28b014e880 2023-11-27T17:53:33.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.293+0000 7f28b78ae640 1 -- 172.21.15.31:0/3627142336 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b0147550 con 0x7f28b014e880 2023-11-27T17:53:33.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.293+0000 7f28b78ae640 1 -- 172.21.15.31:0/3627142336 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b004e850 con 0x7f28b014e880 2023-11-27T17:53:33.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.293+0000 7f28a5ffb640 1 -- 172.21.15.31:0/3627142336 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f28a800abf0 con 0x7f28b014e880 2023-11-27T17:53:33.298 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.293+0000 7f28a5ffb640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2894066820 0x7f2894068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.293+0000 7f28a5ffb640 1 -- 172.21.15.31:0/3627142336 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28a8083f40 con 0x7f28b014e880 2023-11-27T17:53:33.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.293+0000 7f28b564a640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2894066820 0x7f2894068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.299 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.293+0000 7f28b564a640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2894066820 0x7f2894068ce0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f28ac005890 tx=0x7f28ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:33.301 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.297+0000 7f28a5ffb640 1 -- 172.21.15.31:0/3627142336 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f28a80510f0 con 0x7f28b014e880 2023-11-27T17:53:33.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.481+0000 7f28b78ae640 1 -- 172.21.15.31:0/3627142336 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28b013ae50 con 0x7f28b014e880 2023-11-27T17:53:33.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28a5ffb640 1 -- 172.21.15.31:0/3627142336 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4111 (secure 0 0 0) 0x7f28a8054710 con 0x7f28b014e880 2023-11-27T17:53:33.488 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:33.488 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/1250401972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1250401972},{"type":"v1","addr":"172.21.15.31:6836","nonce":1250401972}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1133939246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1133939246},{"type":"v1","addr":"172.21.15.31:6837","nonce":1133939246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:53:23.383311+0000","modified":"2023-11-27T17:53:25.372630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6833/88283146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":88283146},{"type":"v1","addr":"172.21.15.81:6833","nonce":88283146}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:53:33.488 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2023-11-27T17:53:33.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28b78ae640 1 -- 172.21.15.31:0/3627142336 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2894066820 msgr2=0x7f2894068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28b78ae640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2894066820 0x7f2894068ce0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f28ac005890 tx=0x7f28ac009040 comp rx=0 tx=0).stop 2023-11-27T17:53:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28b78ae640 1 -- 172.21.15.31:0/3627142336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b014e880 msgr2=0x7f28b0139820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28b78ae640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b014e880 0x7f28b0139820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f28a800c770 tx=0x7f28a800cc30 comp rx=0 tx=0).stop 2023-11-27T17:53:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28b78ae640 1 -- 172.21.15.31:0/3627142336 shutdown_connections 2023-11-27T17:53:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28b78ae640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2894066820 0x7f2894068ce0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28b78ae640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f28b014e880 0x7f28b0139820 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28b78ae640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28b0144dd0 0x7f28b0146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28b78ae640 1 --2- 172.21.15.31:0/3627142336 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f28b00b8440 0x7f28b0145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28b78ae640 1 -- 172.21.15.31:0/3627142336 >> 172.21.15.31:0/3627142336 conn(0x7f28b00c0ce0 msgr2=0x7f28b013d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:33.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28b78ae640 1 -- 172.21.15.31:0/3627142336 shutdown_connections 2023-11-27T17:53:33.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.485+0000 7f28b78ae640 1 -- 172.21.15.31:0/3627142336 wait complete. 2023-11-27T17:53:33.505 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:33.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf76d5640 1 Processor -- start 2023-11-27T17:53:33.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf76d5640 1 -- start start 2023-11-27T17:53:33.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf76d5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffaf00bd240 0x7ffaf0149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf76d5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffaf00bd6b0 0x7ffaf01495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf76d5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf00b5d00 con 0x7ffaf01430a0 2023-11-27T17:53:33.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf76d5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf0143750 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf76d5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf0143480 con 0x7ffaf00bd240 2023-11-27T17:53:33.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf5471640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ffaf01430a0 0x7ffaf00b4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46258/0 (socket says 172.21.15.31:46258) 2023-11-27T17:53:33.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf5471640 1 -- 172.21.15.31:0/3314054420 learned_addr learned my addr 172.21.15.31:0/3314054420 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:33.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf5c72640 1 --2- 172.21.15.31:0/3314054420 >> v2:172.21.15.31:3300/0 conn(0x7ffaf00bd6b0 0x7ffaf01495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf4c70640 1 --2- 172.21.15.31:0/3314054420 >> v2:172.21.15.81:3300/0 conn(0x7ffaf00bd240 0x7ffaf0149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffae7fff640 1 -- 172.21.15.31:0/3314054420 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965276116 0 0) 0x7ffaec001120 con 0x7ffaf01430a0 2023-11-27T17:53:33.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffae7fff640 1 -- 172.21.15.31:0/3314054420 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffadc003530 con 0x7ffaf01430a0 2023-11-27T17:53:33.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf5c72640 1 -- 172.21.15.31:0/3314054420 >> v2:172.21.15.81:3300/0 conn(0x7ffaf00bd240 msgr2=0x7ffaf0149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:33.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf5c72640 1 --2- 172.21.15.31:0/3314054420 >> v2:172.21.15.81:3300/0 conn(0x7ffaf00bd240 0x7ffaf0149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf5c72640 1 -- 172.21.15.31:0/3314054420 >> v1:172.21.15.31:6789/0 conn(0x7ffaf01430a0 legacy=0x7ffaf00b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf5c72640 1 -- 172.21.15.31:0/3314054420 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf00b4740 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.625+0000 7ffaf4c70640 1 --2- 172.21.15.31:0/3314054420 >> v2:172.21.15.81:3300/0 conn(0x7ffaf00bd240 0x7ffaf0149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:33.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf5c72640 1 --2- 172.21.15.31:0/3314054420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bd6b0 0x7ffaf01495b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00ba9e0 tx=0x7ffae801f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20db35d1abe8680f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:33.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffae7fff640 1 -- 172.21.15.31:0/3314054420 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80b0440 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffae7fff640 1 -- 172.21.15.31:0/3314054420 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae80b05a0 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffae7fff640 1 -- 172.21.15.31:0/3314054420 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80b0930 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 -- 172.21.15.31:0/3314054420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bd6b0 msgr2=0x7ffaf01495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 --2- 172.21.15.31:0/3314054420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bd6b0 0x7ffaf01495b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00ba9e0 tx=0x7ffae801f0f0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 -- 172.21.15.31:0/3314054420 shutdown_connections 2023-11-27T17:53:33.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 --2- 172.21.15.31:0/3314054420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bd6b0 0x7ffaf01495b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 --2- 172.21.15.31:0/3314054420 >> v2:172.21.15.81:3300/0 conn(0x7ffaf00bd240 0x7ffaf0149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 -- 172.21.15.31:0/3314054420 >> 172.21.15.31:0/3314054420 conn(0x7ffaf006ab60 msgr2=0x7ffaf00bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:33.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 -- 172.21.15.31:0/3314054420 shutdown_connections 2023-11-27T17:53:33.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 -- 172.21.15.31:0/3314054420 wait complete. 2023-11-27T17:53:33.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 Processor -- start 2023-11-27T17:53:33.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 -- start start 2023-11-27T17:53:33.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaf00bd240 0x7ffaf006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bd6b0 0x7ffaf01e4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf01430a0 0x7ffaf01e5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf006f240 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf0144a10 con 0x7ffaf01430a0 2023-11-27T17:53:33.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf76d5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00b3a10 con 0x7ffaf00bd240 2023-11-27T17:53:33.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf4c70640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bd6b0 0x7ffaf01e4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf5471640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaf00bd240 0x7ffaf006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf4c70640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bd6b0 0x7ffaf01e4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51496/0 (socket says 172.21.15.31:51496) 2023-11-27T17:53:33.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf4c70640 1 -- 172.21.15.31:0/1040059460 learned_addr learned my addr 172.21.15.31:0/1040059460 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:33.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf5c72640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf01430a0 0x7ffaf01e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.629+0000 7ffaf4c70640 1 -- 172.21.15.31:0/1040059460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaf00bd240 msgr2=0x7ffaf006fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffaf4c70640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaf00bd240 0x7ffaf006fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffaf4c70640 1 -- 172.21.15.31:0/1040059460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf01430a0 msgr2=0x7ffaf01e5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffaf4c70640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf01430a0 0x7ffaf01e5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffaf4c70640 1 -- 172.21.15.31:0/1040059460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae8009a70 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffaf5c72640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf01430a0 0x7ffaf01e5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:33.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffaf4c70640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bd6b0 0x7ffaf01e4b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffae000c7c0 tx=0x7ffae000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:33.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffae5ffb640 1 -- 172.21.15.31:0/1040059460 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0007a30 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffae5ffb640 1 -- 172.21.15.31:0/1040059460 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae0007b90 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffae5ffb640 1 -- 172.21.15.31:0/1040059460 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae000ce70 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffaf76d5640 1 -- 172.21.15.31:0/1040059460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf0071f60 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffaf76d5640 1 -- 172.21.15.31:0/1040059460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf0070570 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffaf76d5640 1 -- 172.21.15.31:0/1040059460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf004e850 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffae5ffb640 1 -- 172.21.15.31:0/1040059460 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7ffae00193f0 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffae5ffb640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ffad40667f0 0x7ffad4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffae5ffb640 1 -- 172.21.15.31:0/1040059460 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffae0084730 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.638 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffaf5471640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ffad40667f0 0x7ffad4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.633+0000 7ffaf5471640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ffad40667f0 0x7ffad4068cb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffaec001280 tx=0x7ffaec007bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:33.642 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.637+0000 7ffae5ffb640 1 -- 172.21.15.31:0/1040059460 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7ffae0051840 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.789+0000 7ffaf76d5640 1 -- 172.21.15.31:0/1040059460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaf0144b50 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffae5ffb640 1 -- 172.21.15.31:0/1040059460 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7ffae0054e60 con 0x7ffaf00bd6b0 2023-11-27T17:53:33.796 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:33.796 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffaf76d5640 1 -- 172.21.15.31:0/1040059460 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ffad40667f0 msgr2=0x7ffad4068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffaf76d5640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ffad40667f0 0x7ffad4068cb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffaec001280 tx=0x7ffaec007bc0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffaf76d5640 1 -- 172.21.15.31:0/1040059460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bd6b0 msgr2=0x7ffaf01e4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffaf76d5640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bd6b0 0x7ffaf01e4b10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffae000c7c0 tx=0x7ffae000cc80 comp rx=0 tx=0).stop 2023-11-27T17:53:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffaf76d5640 1 -- 172.21.15.31:0/1040059460 shutdown_connections 2023-11-27T17:53:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffaf76d5640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7ffad40667f0 0x7ffad4068cb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffaf76d5640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffaf01430a0 0x7ffaf01e5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffaf76d5640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffaf00bd6b0 0x7ffaf01e4b10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffaf76d5640 1 --2- 172.21.15.31:0/1040059460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7ffaf00bd240 0x7ffaf006fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffaf76d5640 1 -- 172.21.15.31:0/1040059460 >> 172.21.15.31:0/1040059460 conn(0x7ffaf006ab60 msgr2=0x7ffaf00badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:33.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffaf76d5640 1 -- 172.21.15.31:0/1040059460 shutdown_connections 2023-11-27T17:53:33.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.793+0000 7ffaf76d5640 1 -- 172.21.15.31:0/1040059460 wait complete. 2023-11-27T17:53:33.814 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:53:11.177026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:53:21.543531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:53:22.362977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:53:33.814 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:53:33.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2fa201640 1 Processor -- start 2023-11-27T17:53:33.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2fa201640 1 -- start start 2023-11-27T17:53:33.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2fa201640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2f406f1d0 0x7fa2f41494f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2fa201640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f4071260 con 0x7fa2f4149a30 2023-11-27T17:53:33.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2fa201640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f4143940 con 0x7fa2f4143560 2023-11-27T17:53:33.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2fa201640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f4149ec0 con 0x7fa2f406f1d0 2023-11-27T17:53:33.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2f3fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa2f4149a30 0x7fa2f4153a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46270/0 (socket says 172.21.15.31:46270) 2023-11-27T17:53:33.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2f3fff640 1 -- 172.21.15.31:0/3930229584 learned_addr learned my addr 172.21.15.31:0/3930229584 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:33.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2f2ffd640 1 --2- 172.21.15.31:0/3930229584 >> v2:172.21.15.31:3300/0 conn(0x7fa2f406f1d0 0x7fa2f41494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2f27fc640 1 -- 172.21.15.31:0/3930229584 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702731139 0 0) 0x7fa2f4071260 con 0x7fa2f4149a30 2023-11-27T17:53:33.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2f27fc640 1 -- 172.21.15.31:0/3930229584 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2dc003530 con 0x7fa2f4149a30 2023-11-27T17:53:33.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2f2ffd640 1 -- 172.21.15.31:0/3930229584 >> v1:172.21.15.81:6789/0 conn(0x7fa2f4143560 legacy=0x7fa2f40bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2f27fc640 1 -- 172.21.15.31:0/3930229584 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2759828167 0 0) 0x7fa2dc003530 con 0x7fa2f4149a30 2023-11-27T17:53:33.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2f2ffd640 1 -- 172.21.15.31:0/3930229584 >> v1:172.21.15.31:6789/0 conn(0x7fa2f4149a30 legacy=0x7fa2f4153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.925+0000 7fa2f2ffd640 1 -- 172.21.15.31:0/3930229584 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f40bd950 con 0x7fa2f406f1d0 2023-11-27T17:53:33.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2f2ffd640 1 --2- 172.21.15.31:0/3930229584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2f406f1d0 0x7fa2f41494f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80097c0 tx=0x7fa2e801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8660e86c70b54c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:33.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2f27fc640 1 -- 172.21.15.31:0/3930229584 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec001a00 con 0x7fa2f406f1d0 2023-11-27T17:53:33.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2f27fc640 1 -- 172.21.15.31:0/3930229584 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e80a7050 con 0x7fa2f406f1d0 2023-11-27T17:53:33.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2f27fc640 1 -- 172.21.15.31:0/3930229584 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e80ab620 con 0x7fa2f406f1d0 2023-11-27T17:53:33.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 -- 172.21.15.31:0/3930229584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2f406f1d0 msgr2=0x7fa2f41494f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 --2- 172.21.15.31:0/3930229584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2f406f1d0 0x7fa2f41494f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80097c0 tx=0x7fa2e801c370 comp rx=0 tx=0).stop 2023-11-27T17:53:33.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 -- 172.21.15.31:0/3930229584 shutdown_connections 2023-11-27T17:53:33.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 --2- 172.21.15.31:0/3930229584 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2f406f1d0 0x7fa2f41494f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 -- 172.21.15.31:0/3930229584 >> 172.21.15.31:0/3930229584 conn(0x7fa2f406ab60 msgr2=0x7fa2f40bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:33.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 -- 172.21.15.31:0/3930229584 shutdown_connections 2023-11-27T17:53:33.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 -- 172.21.15.31:0/3930229584 wait complete. 2023-11-27T17:53:33.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 Processor -- start 2023-11-27T17:53:33.934 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 -- start start 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2f406f1d0 0x7fa2f41352b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f4143560 0x7fa2f413ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2f4149a30 0x7fa2f41e4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f4148a10 con 0x7fa2f4149a30 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f4141ab0 con 0x7fa2f4143560 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2fa201640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f413efa0 con 0x7fa2f406f1d0 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2f3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2f4149a30 0x7fa2f41e4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2f3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2f4149a30 0x7fa2f41e4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51512/0 (socket says 172.21.15.31:51512) 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2f3fff640 1 -- 172.21.15.31:0/1208428108 learned_addr learned my addr 172.21.15.31:0/1208428108 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2f2ffd640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f4143560 0x7fa2f413ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.929+0000 7fa2f37fe640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2f406f1d0 0x7fa2f41352b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2f3fff640 1 -- 172.21.15.31:0/1208428108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2f406f1d0 msgr2=0x7fa2f41352b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2f3fff640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2f406f1d0 0x7fa2f41352b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2f3fff640 1 -- 172.21.15.31:0/1208428108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f4143560 msgr2=0x7fa2f413ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:33.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2f3fff640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f4143560 0x7fa2f413ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:33.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2f3fff640 1 -- 172.21.15.31:0/1208428108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e8009420 con 0x7fa2f4149a30 2023-11-27T17:53:33.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2f2ffd640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f4143560 0x7fa2f413ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:33.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2f3fff640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2f4149a30 0x7fa2f41e4be0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0018a0 tx=0x7fa2ec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:33.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2dbfff640 1 -- 172.21.15.31:0/1208428108 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec012400 con 0x7fa2f4149a30 2023-11-27T17:53:33.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2dbfff640 1 -- 172.21.15.31:0/1208428108 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec012560 con 0x7fa2f4149a30 2023-11-27T17:53:33.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2fa201640 1 -- 172.21.15.31:0/1208428108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f4135940 con 0x7fa2f4149a30 2023-11-27T17:53:33.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2dbfff640 1 -- 172.21.15.31:0/1208428108 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec012910 con 0x7fa2f4149a30 2023-11-27T17:53:33.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2fa201640 1 -- 172.21.15.31:0/1208428108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f4135c20 con 0x7fa2f4149a30 2023-11-27T17:53:33.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2fa201640 1 -- 172.21.15.31:0/1208428108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f4141c20 con 0x7fa2f4149a30 2023-11-27T17:53:33.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2dbfff640 1 -- 172.21.15.31:0/1208428108 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa2ec012a70 con 0x7fa2f4149a30 2023-11-27T17:53:33.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2dbfff640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa2e00667f0 0x7fa2e0068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:33.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2dbfff640 1 -- 172.21.15.31:0/1208428108 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2ec084b50 con 0x7fa2f4149a30 2023-11-27T17:53:33.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2f37fe640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa2e00667f0 0x7fa2e0068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:33.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.933+0000 7fa2f37fe640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa2e00667f0 0x7fa2e0068cb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4000f70 tx=0x7fa2e4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:33.941 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:33.937+0000 7fa2dbfff640 1 -- 172.21.15.31:0/1208428108 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa2ec051c50 con 0x7fa2f4149a30 2023-11-27T17:53:34.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.089+0000 7fa2fa201640 1 -- 172.21.15.31:0/1208428108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2f404e850 con 0x7fa2f4149a30 2023-11-27T17:53:34.093 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.089+0000 7fa2dbfff640 1 -- 172.21.15.31:0/1208428108 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2ec055270 con 0x7fa2f4149a30 2023-11-27T17:53:34.093 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-11-27T17:53:34.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.093+0000 7fa2fa201640 1 -- 172.21.15.31:0/1208428108 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa2e00667f0 msgr2=0x7fa2e0068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.095 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.093+0000 7fa2fa201640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa2e00667f0 0x7fa2e0068cb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4000f70 tx=0x7fa2e4009040 comp rx=0 tx=0).stop 2023-11-27T17:53:34.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.093+0000 7fa2fa201640 1 -- 172.21.15.31:0/1208428108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2f4149a30 msgr2=0x7fa2f41e4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.093+0000 7fa2fa201640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2f4149a30 0x7fa2f41e4be0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0018a0 tx=0x7fa2ec00a430 comp rx=0 tx=0).stop 2023-11-27T17:53:34.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.093+0000 7fa2fa201640 1 -- 172.21.15.31:0/1208428108 shutdown_connections 2023-11-27T17:53:34.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.093+0000 7fa2fa201640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa2e00667f0 0x7fa2e0068cb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.093+0000 7fa2fa201640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2f4149a30 0x7fa2f41e4be0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.093+0000 7fa2fa201640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2f4143560 0x7fa2f413ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.093+0000 7fa2fa201640 1 --2- 172.21.15.31:0/1208428108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa2f406f1d0 0x7fa2f41352b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.093+0000 7fa2fa201640 1 -- 172.21.15.31:0/1208428108 >> 172.21.15.31:0/1208428108 conn(0x7fa2f406ab60 msgr2=0x7fa2f4071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:34.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.093+0000 7fa2fa201640 1 -- 172.21.15.31:0/1208428108 shutdown_connections 2023-11-27T17:53:34.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.093+0000 7fa2fa201640 1 -- 172.21.15.31:0/1208428108 wait complete. 2023-11-27T17:53:34.110 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:53:34.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa67578e640 1 Processor -- start 2023-11-27T17:53:34.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa67578e640 1 -- start start 2023-11-27T17:53:34.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa67578e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa67014bed0 0x7fa6700b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa67578e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa67014f450 0x7fa6700baa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa67578e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67014b3d0 con 0x7fa67014f010 2023-11-27T17:53:34.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa67578e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6700709d0 con 0x7fa67014bed0 2023-11-27T17:53:34.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa67578e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67014f8e0 con 0x7fa67014f450 2023-11-27T17:53:34.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66e7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa67014f010 0x7fa6700ba2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46284/0 (socket says 172.21.15.31:46284) 2023-11-27T17:53:34.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66e7fc640 1 -- 172.21.15.31:0/918181272 learned_addr learned my addr 172.21.15.31:0/918181272 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:34.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66effd640 1 --2- 172.21.15.31:0/918181272 >> v2:172.21.15.81:3300/0 conn(0x7fa67014bed0 0x7fa6700b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161630636 0 0) 0x7fa67014b3d0 con 0x7fa67014f010 2023-11-27T17:53:34.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa658003530 con 0x7fa67014f010 2023-11-27T17:53:34.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66f7fe640 1 --2- 172.21.15.31:0/918181272 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa67014f450 0x7fa6700baa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2118691914 0 0) 0x7fa658003530 con 0x7fa67014f010 2023-11-27T17:53:34.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa67014f450 msgr2=0x7fa6700baa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:34.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 --2- 172.21.15.31:0/918181272 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa67014f450 0x7fa6700baa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 >> v2:172.21.15.81:3300/0 conn(0x7fa67014bed0 msgr2=0x7fa6700b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:34.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 --2- 172.21.15.31:0/918181272 >> v2:172.21.15.81:3300/0 conn(0x7fa67014bed0 0x7fa6700b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67014eb80 con 0x7fa67014f010 2023-11-27T17:53:34.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7fa660001680 con 0x7fa67014f010 2023-11-27T17:53:34.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 >> v1:172.21.15.31:6789/0 conn(0x7fa67014f010 legacy=0x7fa6700ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 --2- 172.21.15.31:0/918181272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6580039f0 0x7fa658003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 --2- 172.21.15.31:0/918181272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6580047d0 0x7fa658004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 --2- 172.21.15.31:0/918181272 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa67014f450 0x7fa658005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700709d0 con 0x7fa6580039f0 2023-11-27T17:53:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67014f8e0 con 0x7fa6580047d0 2023-11-27T17:53:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65800b9e0 con 0x7fa67014f450 2023-11-27T17:53:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66effd640 1 --2- 172.21.15.31:0/918181272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6580039f0 0x7fa658003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66effd640 1 -- 172.21.15.31:0/918181272 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa67014f450 msgr2=0x7fa658005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:34.226 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66f7fe640 1 --2- 172.21.15.31:0/918181272 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa67014f450 0x7fa658005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66effd640 1 --2- 172.21.15.31:0/918181272 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa67014f450 0x7fa658005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66effd640 1 -- 172.21.15.31:0/918181272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6580047d0 msgr2=0x7fa658004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:34.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66effd640 1 --2- 172.21.15.31:0/918181272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6580047d0 0x7fa658004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.217+0000 7fa66effd640 1 -- 172.21.15.31:0/918181272 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa658003530 con 0x7fa6580039f0 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa66effd640 1 --2- 172.21.15.31:0/918181272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6580039f0 0x7fa658003e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa664009ae0 tx=0x7fa66401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8898f251c03817b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640a55a0 con 0x7fa6580039f0 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6640a5700 con 0x7fa6580039f0 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa66dffb640 1 -- 172.21.15.31:0/918181272 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640a5ab0 con 0x7fa6580039f0 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 -- 172.21.15.31:0/918181272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6580039f0 msgr2=0x7fa658003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 --2- 172.21.15.31:0/918181272 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6580039f0 0x7fa658003e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa664009ae0 tx=0x7fa66401ca90 comp rx=0 tx=0).stop 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa66f7fe640 1 -- 172.21.15.31:0/918181272 reap_dead start 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 -- 172.21.15.31:0/918181272 shutdown_connections 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 -- 172.21.15.31:0/918181272 >> 172.21.15.31:0/918181272 conn(0x7fa67006e8a0 msgr2=0x7fa67006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 -- 172.21.15.31:0/918181272 shutdown_connections 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 -- 172.21.15.31:0/918181272 wait complete. 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 Processor -- start 2023-11-27T17:53:34.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 -- start start 2023-11-27T17:53:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6580039f0 0x7fa67014ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6700aeeb0 0x7fa6700aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6701e0f40 0x7fa6701e13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa670148750 con 0x7fa6700aeeb0 2023-11-27T17:53:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67014b0d0 con 0x7fa6580039f0 2023-11-27T17:53:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa67578e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6701e18e0 con 0x7fa6701e0f40 2023-11-27T17:53:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa66e7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6700aeeb0 0x7fa6700aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa66e7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6700aeeb0 0x7fa6700aca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51524/0 (socket says 172.21.15.31:51524) 2023-11-27T17:53:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa66e7fc640 1 -- 172.21.15.31:0/2854807875 learned_addr learned my addr 172.21.15.31:0/2854807875 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:34.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.221+0000 7fa66effd640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6580039f0 0x7fa67014ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa66f7fe640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6701e0f40 0x7fa6701e13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa66e7fc640 1 -- 172.21.15.31:0/2854807875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6701e0f40 msgr2=0x7fa6701e13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa66e7fc640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6701e0f40 0x7fa6701e13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa66e7fc640 1 -- 172.21.15.31:0/2854807875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6580039f0 msgr2=0x7fa67014ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa66e7fc640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6580039f0 0x7fa67014ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa66e7fc640 1 -- 172.21.15.31:0/2854807875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6700af670 con 0x7fa6700aeeb0 2023-11-27T17:53:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa66f7fe640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6701e0f40 0x7fa6701e13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa66effd640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6580039f0 0x7fa67014ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa66e7fc640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6700aeeb0 0x7fa6700aca00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa66000f400 tx=0x7fa66000f8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa6577fe640 1 -- 172.21.15.31:0/2854807875 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660007d00 con 0x7fa6700aeeb0 2023-11-27T17:53:34.233 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa6577fe640 1 -- 172.21.15.31:0/2854807875 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa660007e80 con 0x7fa6700aeeb0 2023-11-27T17:53:34.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa67578e640 1 -- 172.21.15.31:0/2854807875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6700addf0 con 0x7fa6700aeeb0 2023-11-27T17:53:34.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa6577fe640 1 -- 172.21.15.31:0/2854807875 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66000a310 con 0x7fa6700aeeb0 2023-11-27T17:53:34.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa67578e640 1 -- 172.21.15.31:0/2854807875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6700ae3b0 con 0x7fa6700aeeb0 2023-11-27T17:53:34.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa67578e640 1 -- 172.21.15.31:0/2854807875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67004e850 con 0x7fa6700aeeb0 2023-11-27T17:53:34.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa6577fe640 1 -- 172.21.15.31:0/2854807875 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa66000a470 con 0x7fa6700aeeb0 2023-11-27T17:53:34.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa6577fe640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa65c066820 0x7fa65c068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa6577fe640 1 -- 172.21.15.31:0/2854807875 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6600874b0 con 0x7fa6700aeeb0 2023-11-27T17:53:34.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa66effd640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa65c066820 0x7fa65c068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.234 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.225+0000 7fa66effd640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa65c066820 0x7fa65c068ce0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa6640af000 tx=0x7fa6640046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:34.235 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.229+0000 7fa6577fe640 1 -- 172.21.15.31:0/2854807875 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa660054720 con 0x7fa6700aeeb0 2023-11-27T17:53:34.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.377+0000 7fa67578e640 1 -- 172.21.15.31:0/2854807875 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa67014d9e0 con 0x7fa6700aeeb0 2023-11-27T17:53:34.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.377+0000 7fa6577fe640 1 -- 172.21.15.31:0/2854807875 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa660057d40 con 0x7fa6700aeeb0 2023-11-27T17:53:34.382 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-11-27T17:53:34.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.381+0000 7fa67578e640 1 -- 172.21.15.31:0/2854807875 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa65c066820 msgr2=0x7fa65c068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.381+0000 7fa67578e640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa65c066820 0x7fa65c068ce0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa6640af000 tx=0x7fa6640046d0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.381+0000 7fa67578e640 1 -- 172.21.15.31:0/2854807875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6700aeeb0 msgr2=0x7fa6700aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.381+0000 7fa67578e640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6700aeeb0 0x7fa6700aca00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa66000f400 tx=0x7fa66000f8c0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.381+0000 7fa67578e640 1 -- 172.21.15.31:0/2854807875 shutdown_connections 2023-11-27T17:53:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.381+0000 7fa67578e640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa65c066820 0x7fa65c068ce0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.381+0000 7fa67578e640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6701e0f40 0x7fa6701e13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.381+0000 7fa67578e640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6700aeeb0 0x7fa6700aca00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.381+0000 7fa67578e640 1 --2- 172.21.15.31:0/2854807875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6580039f0 0x7fa67014ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.381+0000 7fa67578e640 1 -- 172.21.15.31:0/2854807875 >> 172.21.15.31:0/2854807875 conn(0x7fa67006e8a0 msgr2=0x7fa6700ba2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.381+0000 7fa67578e640 1 -- 172.21.15.31:0/2854807875 shutdown_connections 2023-11-27T17:53:34.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.381+0000 7fa67578e640 1 -- 172.21.15.31:0/2854807875 wait complete. 2023-11-27T17:53:34.399 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:53:34.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdca6328640 1 Processor -- start 2023-11-27T17:53:34.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdca6328640 1 -- start start 2023-11-27T17:53:34.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdca6328640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdca0149c00 0x7fdca0154a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdca6328640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca0071260 con 0x7fdca006f1d0 2023-11-27T17:53:34.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdca6328640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca0143940 con 0x7fdca0143560 2023-11-27T17:53:34.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdca6328640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca00bd950 con 0x7fdca0149c00 2023-11-27T17:53:34.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdca48c5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdca0149c00 0x7fdca0154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdc97fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdca006f1d0 0x7fdca01494f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46298/0 (socket says 172.21.15.31:46298) 2023-11-27T17:53:34.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdc97fff640 1 -- 172.21.15.31:0/2682616644 learned_addr learned my addr 172.21.15.31:0/2682616644 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:34.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdca48c5640 1 -- 172.21.15.31:0/2682616644 >> v1:172.21.15.81:6789/0 conn(0x7fdca0143560 legacy=0x7fdca00bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:34.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdca48c5640 1 -- 172.21.15.31:0/2682616644 >> v1:172.21.15.31:6789/0 conn(0x7fdca006f1d0 legacy=0x7fdca01494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdca48c5640 1 -- 172.21.15.31:0/2682616644 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca006f800 con 0x7fdca0149c00 2023-11-27T17:53:34.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdc9f7fe640 1 -- 172.21.15.31:0/2682616644 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401477276 0 0) 0x7fdca0071260 con 0x7fdca006f1d0 2023-11-27T17:53:34.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.521+0000 7fdca48c5640 1 --2- 172.21.15.31:0/2682616644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdca0149c00 0x7fdca0154a50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009d90 tx=0x7fdc9801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebd5e39c9f54bf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:34.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc9f7fe640 1 -- 172.21.15.31:0/2682616644 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980a59a0 con 0x7fdca0149c00 2023-11-27T17:53:34.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc9f7fe640 1 -- 172.21.15.31:0/2682616644 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc980a5b00 con 0x7fdca0149c00 2023-11-27T17:53:34.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc9f7fe640 1 -- 172.21.15.31:0/2682616644 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980a5e90 con 0x7fdca0149c00 2023-11-27T17:53:34.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 -- 172.21.15.31:0/2682616644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdca0149c00 msgr2=0x7fdca0154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 --2- 172.21.15.31:0/2682616644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdca0149c00 0x7fdca0154a50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009d90 tx=0x7fdc9801c8e0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 -- 172.21.15.31:0/2682616644 shutdown_connections 2023-11-27T17:53:34.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 --2- 172.21.15.31:0/2682616644 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdca0149c00 0x7fdca0154a50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 -- 172.21.15.31:0/2682616644 >> 172.21.15.31:0/2682616644 conn(0x7fdca006ab60 msgr2=0x7fdca00bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:34.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 -- 172.21.15.31:0/2682616644 shutdown_connections 2023-11-27T17:53:34.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 -- 172.21.15.31:0/2682616644 wait complete. 2023-11-27T17:53:34.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 Processor -- start 2023-11-27T17:53:34.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 -- start start 2023-11-27T17:53:34.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdca006f1d0 0x7fdca01351d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdca0143560 0x7fdca00ba9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca0149c00 0x7fdca01e4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca0135710 con 0x7fdca0143560 2023-11-27T17:53:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca0141300 con 0x7fdca0149c00 2023-11-27T17:53:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00bc6e0 con 0x7fdca006f1d0 2023-11-27T17:53:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc97fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdca0143560 0x7fdca00ba9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc97fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdca0143560 0x7fdca00ba9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:51540/0 (socket says 172.21.15.31:51540) 2023-11-27T17:53:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc97fff640 1 -- 172.21.15.31:0/2274884261 learned_addr learned my addr 172.21.15.31:0/2274884261 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc9ffff640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdca006f1d0 0x7fdca01351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca48c5640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca0149c00 0x7fdca01e4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc97fff640 1 -- 172.21.15.31:0/2274884261 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdca006f1d0 msgr2=0x7fdca01351d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc97fff640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdca006f1d0 0x7fdca01351d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc97fff640 1 -- 172.21.15.31:0/2274884261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca0149c00 msgr2=0x7fdca01e4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc97fff640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca0149c00 0x7fdca01e4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc97fff640 1 -- 172.21.15.31:0/2274884261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc98009a70 con 0x7fdca0143560 2023-11-27T17:53:34.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc97fff640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdca0143560 0x7fdca00ba9e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc880011f0 tx=0x7fdc8800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:34.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc9d7fa640 1 -- 172.21.15.31:0/2274884261 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc880074e0 con 0x7fdca0143560 2023-11-27T17:53:34.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc9d7fa640 1 -- 172.21.15.31:0/2274884261 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc88007640 con 0x7fdca0143560 2023-11-27T17:53:34.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 -- 172.21.15.31:0/2274884261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca0141530 con 0x7fdca0143560 2023-11-27T17:53:34.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdc9d7fa640 1 -- 172.21.15.31:0/2274884261 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88004a10 con 0x7fdca0143560 2023-11-27T17:53:34.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 -- 172.21.15.31:0/2274884261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca0141af0 con 0x7fdca0143560 2023-11-27T17:53:34.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.525+0000 7fdca6328640 1 -- 172.21.15.31:0/2274884261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca0148f10 con 0x7fdca0143560 2023-11-27T17:53:34.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.529+0000 7fdc9d7fa640 1 -- 172.21.15.31:0/2274884261 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fdc88004b70 con 0x7fdca0143560 2023-11-27T17:53:34.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.529+0000 7fdc9d7fa640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdc800667f0 0x7fdc80068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.529+0000 7fdc9d7fa640 1 -- 172.21.15.31:0/2274884261 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc88083590 con 0x7fdca0143560 2023-11-27T17:53:34.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.529+0000 7fdc9ffff640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdc800667f0 0x7fdc80068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.529+0000 7fdc9ffff640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdc800667f0 0x7fdc80068cb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdc90003d60 tx=0x7fdc90009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:34.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.533+0000 7fdc9d7fa640 1 -- 172.21.15.31:0/2274884261 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fdca0148f10 con 0x7fdca0143560 2023-11-27T17:53:34.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.685+0000 7fdca6328640 1 -- 172.21.15.31:0/2274884261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdca0148f10 con 0x7fdca0143560 2023-11-27T17:53:34.692 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdc9d7fa640 1 -- 172.21.15.31:0/2274884261 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdca0148f10 con 0x7fdca0143560 2023-11-27T17:53:34.692 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-11-27T17:53:34.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdca6328640 1 -- 172.21.15.31:0/2274884261 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdc800667f0 msgr2=0x7fdc80068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdca6328640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdc800667f0 0x7fdc80068cb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdc90003d60 tx=0x7fdc90009040 comp rx=0 tx=0).stop 2023-11-27T17:53:34.694 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdca6328640 1 -- 172.21.15.31:0/2274884261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdca0143560 msgr2=0x7fdca00ba9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdca6328640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdca0143560 0x7fdca00ba9e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdc880011f0 tx=0x7fdc8800c9b0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdca6328640 1 -- 172.21.15.31:0/2274884261 shutdown_connections 2023-11-27T17:53:34.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdca6328640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdc800667f0 0x7fdc80068cb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdca6328640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdca0149c00 0x7fdca01e4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdca6328640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdca0143560 0x7fdca00ba9e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdca6328640 1 --2- 172.21.15.31:0/2274884261 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdca006f1d0 0x7fdca01351d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdca6328640 1 -- 172.21.15.31:0/2274884261 >> 172.21.15.31:0/2274884261 conn(0x7fdca006ab60 msgr2=0x7fdca013e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:34.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdca6328640 1 -- 172.21.15.31:0/2274884261 shutdown_connections 2023-11-27T17:53:34.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.689+0000 7fdca6328640 1 -- 172.21.15.31:0/2274884261 wait complete. 2023-11-27T17:53:34.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:53:34.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3b05a65640 1 Processor -- start 2023-11-27T17:53:34.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3b05a65640 1 -- start start 2023-11-27T17:53:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3b05a65640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b000b46a0 0x7f3b00153970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3b05a65640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b00148930 con 0x7f3b000b3a60 2023-11-27T17:53:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3b05a65640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b000b3490 con 0x7f3b000b30b0 2023-11-27T17:53:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3b05a65640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b000b52c0 con 0x7f3b000b46a0 2023-11-27T17:53:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afeffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3b000b3a60 0x7f3b000bd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42210/0 (socket says 172.21.15.31:42210) 2023-11-27T17:53:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afeffd640 1 -- 172.21.15.31:0/837419733 learned_addr learned my addr 172.21.15.31:0/837419733 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afffff640 1 --2- 172.21.15.31:0/837419733 >> v2:172.21.15.81:3300/0 conn(0x7f3b000b46a0 0x7f3b00153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665598897 0 0) 0x7f3b00148930 con 0x7f3b000b3a60 2023-11-27T17:53:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ae8003530 con 0x7f3b000b3a60 2023-11-27T17:53:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110421387 0 0) 0x7f3b000b3490 con 0x7f3b000b30b0 2023-11-27T17:53:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b00148930 con 0x7f3b000b30b0 2023-11-27T17:53:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1547300385 0 0) 0x7f3ae8003530 con 0x7f3b000b3a60 2023-11-27T17:53:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 >> v2:172.21.15.81:3300/0 conn(0x7f3b000b46a0 msgr2=0x7f3b00153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 --2- 172.21.15.31:0/837419733 >> v2:172.21.15.81:3300/0 conn(0x7f3b000b46a0 0x7f3b00153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 >> v1:172.21.15.81:6789/0 conn(0x7f3b000b30b0 legacy=0x7f3b0014b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000bd950 con 0x7f3b000b3a60 2023-11-27T17:53:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f3af4001680 con 0x7f3b000b3a60 2023-11-27T17:53:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 >> v1:172.21.15.31:6789/0 conn(0x7f3b000b3a60 legacy=0x7f3b000bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 --2- 172.21.15.31:0/837419733 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ae8003bd0 0x7f3ae8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 --2- 172.21.15.31:0/837419733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ae80047d0 0x7f3ae8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 --2- 172.21.15.31:0/837419733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae8005190 0x7f3ae800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000b52c0 con 0x7f3ae8005190 2023-11-27T17:53:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae800e340 con 0x7f3ae80047d0 2023-11-27T17:53:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae800e500 con 0x7f3ae8003bd0 2023-11-27T17:53:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afffff640 1 --2- 172.21.15.31:0/837419733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae8005190 0x7f3ae800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3aff7fe640 1 --2- 172.21.15.31:0/837419733 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ae8003bd0 0x7f3ae8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afeffd640 1 --2- 172.21.15.31:0/837419733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ae80047d0 0x7f3ae8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afffff640 1 -- 172.21.15.31:0/837419733 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ae8003bd0 msgr2=0x7f3ae8003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:34.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afffff640 1 --2- 172.21.15.31:0/837419733 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ae8003bd0 0x7f3ae8003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afffff640 1 -- 172.21.15.31:0/837419733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ae80047d0 msgr2=0x7f3ae8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:34.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afffff640 1 --2- 172.21.15.31:0/837419733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ae80047d0 0x7f3ae8004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3afffff640 1 -- 172.21.15.31:0/837419733 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae8003530 con 0x7f3ae8005190 2023-11-27T17:53:34.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.833+0000 7f3aff7fe640 1 --2- 172.21.15.31:0/837419733 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3ae8003bd0 0x7f3ae8003fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afffff640 1 -- 172.21.15.31:0/837419733 reap_dead start 2023-11-27T17:53:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afffff640 1 --2- 172.21.15.31:0/837419733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae8005190 0x7f3ae800dba0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009fc0 tx=0x7f3af801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4dfca4fed3ac58f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80a5cb0 con 0x7f3ae8005190 2023-11-27T17:53:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af800f040 con 0x7f3ae8005190 2023-11-27T17:53:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afe7fc640 1 -- 172.21.15.31:0/837419733 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8003be0 con 0x7f3ae8005190 2023-11-27T17:53:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 -- 172.21.15.31:0/837419733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae8005190 msgr2=0x7f3ae800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 --2- 172.21.15.31:0/837419733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae8005190 0x7f3ae800dba0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009fc0 tx=0x7f3af801cca0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 -- 172.21.15.31:0/837419733 shutdown_connections 2023-11-27T17:53:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 --2- 172.21.15.31:0/837419733 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3ae8005190 0x7f3ae800dba0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.844 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 -- 172.21.15.31:0/837419733 >> 172.21.15.31:0/837419733 conn(0x7f3b0006ab60 msgr2=0x7f3b000bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 -- 172.21.15.31:0/837419733 shutdown_connections 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 -- 172.21.15.31:0/837419733 wait complete. 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 Processor -- start 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 -- start start 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ae8005190 0x7f3b0006f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b000bcea0 0x7f3b0006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b00070530 0x7f3b0013ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b000b4ad0 con 0x7f3b00070530 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b001e1670 con 0x7f3ae8005190 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3b05a65640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0006f9e0 con 0x7f3b000bcea0 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b00070530 0x7f3b0013ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b00070530 0x7f3b0013ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38674/0 (socket says 172.21.15.31:38674) 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afffff640 1 -- 172.21.15.31:0/3982047059 learned_addr learned my addr 172.21.15.31:0/3982047059 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3aff7fe640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ae8005190 0x7f3b0006f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afeffd640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b000bcea0 0x7f3b0006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afffff640 1 -- 172.21.15.31:0/3982047059 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b000bcea0 msgr2=0x7f3b0006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afffff640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b000bcea0 0x7f3b0006fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afffff640 1 -- 172.21.15.31:0/3982047059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ae8005190 msgr2=0x7f3b0006f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afffff640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ae8005190 0x7f3b0006f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afffff640 1 -- 172.21.15.31:0/3982047059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000709e0 con 0x7f3b00070530 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3aff7fe640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ae8005190 0x7f3b0006f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.837+0000 7f3afffff640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b00070530 0x7f3b0013ed00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3af801c710 tx=0x7f3af8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.841+0000 7f3ae7fff640 1 -- 172.21.15.31:0/3982047059 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af8003db0 con 0x7f3b00070530 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.841+0000 7f3ae7fff640 1 -- 172.21.15.31:0/3982047059 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af8004030 con 0x7f3b00070530 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.841+0000 7f3b05a65640 1 -- 172.21.15.31:0/3982047059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b001e0d10 con 0x7f3b00070530 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.841+0000 7f3ae7fff640 1 -- 172.21.15.31:0/3982047059 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80043a0 con 0x7f3b00070530 2023-11-27T17:53:34.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.841+0000 7f3b05a65640 1 -- 172.21.15.31:0/3982047059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b001e1290 con 0x7f3b00070530 2023-11-27T17:53:34.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.841+0000 7f3b05a65640 1 -- 172.21.15.31:0/3982047059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0006fd10 con 0x7f3b00070530 2023-11-27T17:53:34.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.841+0000 7f3ae7fff640 1 -- 172.21.15.31:0/3982047059 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3af8004500 con 0x7f3b00070530 2023-11-27T17:53:34.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.841+0000 7f3ae7fff640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3aec066820 0x7f3aec068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:34.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.841+0000 7f3ae7fff640 1 -- 172.21.15.31:0/3982047059 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3af811ed20 con 0x7f3b00070530 2023-11-27T17:53:34.847 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.841+0000 7f3aff7fe640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3aec066820 0x7f3aec068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:34.848 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.841+0000 7f3aff7fe640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3aec066820 0x7f3aec068ce0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3af0007fd0 tx=0x7f3af0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:34.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:34.845+0000 7f3ae7fff640 1 -- 172.21.15.31:0/3982047059 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f3b0006fd10 con 0x7f3b00070530 2023-11-27T17:53:35.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 -- 172.21.15.31:0/3982047059 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b0006fd10 con 0x7f3b00070530 2023-11-27T17:53:35.028 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3ae7fff640 1 -- 172.21.15.31:0/3982047059 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4111 (secure 0 0 0) 0x7f3b0006fd10 con 0x7f3b00070530 2023-11-27T17:53:35.029 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:35.029 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/1250401972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1250401972},{"type":"v1","addr":"172.21.15.31:6836","nonce":1250401972}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1133939246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1133939246},{"type":"v1","addr":"172.21.15.31:6837","nonce":1133939246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:53:23.383311+0000","modified":"2023-11-27T17:53:25.372630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6833/88283146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":88283146},{"type":"v1","addr":"172.21.15.81:6833","nonce":88283146}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:53:35.029 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2023-11-27T17:53:35.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 -- 172.21.15.31:0/3982047059 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3aec066820 msgr2=0x7f3aec068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3aec066820 0x7f3aec068ce0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3af0007fd0 tx=0x7f3af0009040 comp rx=0 tx=0).stop 2023-11-27T17:53:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 -- 172.21.15.31:0/3982047059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b00070530 msgr2=0x7f3b0013ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b00070530 0x7f3b0013ed00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3af801c710 tx=0x7f3af8009750 comp rx=0 tx=0).stop 2023-11-27T17:53:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 -- 172.21.15.31:0/3982047059 shutdown_connections 2023-11-27T17:53:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3aec066820 0x7f3aec068ce0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3b00070530 0x7f3b0013ed00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3b000bcea0 0x7f3b0006fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 --2- 172.21.15.31:0/3982047059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ae8005190 0x7f3b0006f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 -- 172.21.15.31:0/3982047059 >> 172.21.15.31:0/3982047059 conn(0x7f3b0006ab60 msgr2=0x7f3b000b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 -- 172.21.15.31:0/3982047059 shutdown_connections 2023-11-27T17:53:35.031 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.025+0000 7f3b05a65640 1 -- 172.21.15.31:0/3982047059 wait complete. 2023-11-27T17:53:35.046 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:35.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.153+0000 7f9beed77640 1 Processor -- start 2023-11-27T17:53:35.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.153+0000 7f9beed77640 1 -- start start 2023-11-27T17:53:35.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9be80b8440 0x7f9be814e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9be80b9220 0x7f9be80bcf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be80b8d90 con 0x7f9be8144dd0 2023-11-27T17:53:35.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be80ba130 con 0x7f9be80b9220 2023-11-27T17:53:35.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be806bc10 con 0x7f9be80b8440 2023-11-27T17:53:35.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9be7fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9be80b9220 0x7f9be80bcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:35.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9be7fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9be80b9220 0x7f9be80bcf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38684/0 (socket says 172.21.15.31:38684) 2023-11-27T17:53:35.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9be7fff640 1 -- 172.21.15.31:0/2540302498 learned_addr learned my addr 172.21.15.31:0/2540302498 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:35.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9becb13640 1 --2- 172.21.15.31:0/2540302498 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9be80b8440 0x7f9be814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:35.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9be7fff640 1 -- 172.21.15.31:0/2540302498 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9be80b8440 msgr2=0x7f9be814e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:35.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9be7fff640 1 --2- 172.21.15.31:0/2540302498 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9be80b8440 0x7f9be814e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9be7fff640 1 -- 172.21.15.31:0/2540302498 >> v1:172.21.15.81:6789/0 conn(0x7f9be8144dd0 legacy=0x7f9be80bb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:35.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9be7fff640 1 -- 172.21.15.31:0/2540302498 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be80b9680 con 0x7f9be80b9220 2023-11-27T17:53:35.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9be7fff640 1 --2- 172.21.15.31:0/2540302498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be80b9220 0x7f9be80bcf60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009870 tx=0x7f9bdc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fa712d9a50bccf server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:35.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9be77fe640 1 -- 172.21.15.31:0/2540302498 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0a89b0 con 0x7f9be80b9220 2023-11-27T17:53:35.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9be77fe640 1 -- 172.21.15.31:0/2540302498 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc0a8b10 con 0x7f9be80b9220 2023-11-27T17:53:35.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9be77fe640 1 -- 172.21.15.31:0/2540302498 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0a8ea0 con 0x7f9be80b9220 2023-11-27T17:53:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 -- 172.21.15.31:0/2540302498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be80b9220 msgr2=0x7f9be80bcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 --2- 172.21.15.31:0/2540302498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be80b9220 0x7f9be80bcf60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009870 tx=0x7f9bdc01ecf0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 -- 172.21.15.31:0/2540302498 shutdown_connections 2023-11-27T17:53:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 --2- 172.21.15.31:0/2540302498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be80b9220 0x7f9be80bcf60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 --2- 172.21.15.31:0/2540302498 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9be80b8440 0x7f9be814e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 -- 172.21.15.31:0/2540302498 >> 172.21.15.31:0/2540302498 conn(0x7f9be80c0ce0 msgr2=0x7f9be80c10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 -- 172.21.15.31:0/2540302498 shutdown_connections 2023-11-27T17:53:35.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.157+0000 7f9beed77640 1 -- 172.21.15.31:0/2540302498 wait complete. 2023-11-27T17:53:35.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9beed77640 1 Processor -- start 2023-11-27T17:53:35.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9beed77640 1 -- start start 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9beed77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be80b8440 0x7f9be8143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9beed77640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9be80b9220 0x7f9be81e46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9beed77640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be8144dd0 0x7f9be81354d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9beed77640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be8143f60 con 0x7f9be8144dd0 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9beed77640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be81d6ec0 con 0x7f9be80b8440 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9beed77640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be81d67c0 con 0x7f9be80b9220 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9bed314640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be8144dd0 0x7f9be81354d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9bed314640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be8144dd0 0x7f9be81354d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38686/0 (socket says 172.21.15.31:38686) 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9bed314640 1 -- 172.21.15.31:0/2837517108 learned_addr learned my addr 172.21.15.31:0/2837517108 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9bed314640 1 -- 172.21.15.31:0/2837517108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9be80b9220 msgr2=0x7f9be81e46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9bed314640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9be80b9220 0x7f9be81e46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9bed314640 1 -- 172.21.15.31:0/2837517108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be80b8440 msgr2=0x7f9be8143a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:35.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9becb13640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be80b8440 0x7f9be8143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9bed314640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be80b8440 0x7f9be8143a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9bed314640 1 -- 172.21.15.31:0/2837517108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc0094d0 con 0x7f9be8144dd0 2023-11-27T17:53:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9bed314640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be8144dd0 0x7f9be81354d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9be000b970 tx=0x7f9be000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9be57fa640 1 -- 172.21.15.31:0/2837517108 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be000cb40 con 0x7f9be8144dd0 2023-11-27T17:53:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9be57fa640 1 -- 172.21.15.31:0/2837517108 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be000cca0 con 0x7f9be8144dd0 2023-11-27T17:53:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9be57fa640 1 -- 172.21.15.31:0/2837517108 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be0014680 con 0x7f9be8144dd0 2023-11-27T17:53:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9beed77640 1 -- 172.21.15.31:0/2837517108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be81d6aa0 con 0x7f9be8144dd0 2023-11-27T17:53:35.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9beed77640 1 -- 172.21.15.31:0/2837517108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be81d7420 con 0x7f9be8144dd0 2023-11-27T17:53:35.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9beed77640 1 -- 172.21.15.31:0/2837517108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be804e850 con 0x7f9be8144dd0 2023-11-27T17:53:35.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.161+0000 7f9be57fa640 1 -- 172.21.15.31:0/2837517108 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9be0003980 con 0x7f9be8144dd0 2023-11-27T17:53:35.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.165+0000 7f9be57fa640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9bd4066820 0x7f9bd4068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.165+0000 7f9be57fa640 1 -- 172.21.15.31:0/2837517108 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9be00841b0 con 0x7f9be8144dd0 2023-11-27T17:53:35.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.165+0000 7f9becb13640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9bd4066820 0x7f9bd4068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:35.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.165+0000 7f9becb13640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9bd4066820 0x7f9bd4068ce0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009790 tx=0x7f9bd8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:35.171 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.165+0000 7f9be57fa640 1 -- 172.21.15.31:0/2837517108 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9be0051420 con 0x7f9be8144dd0 2023-11-27T17:53:35.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.313+0000 7f9beed77640 1 -- 172.21.15.31:0/2837517108 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9be80b88b0 con 0x7f9be8144dd0 2023-11-27T17:53:35.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9be57fa640 1 -- 172.21.15.31:0/2837517108 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7f9be0054a40 con 0x7f9be8144dd0 2023-11-27T17:53:35.321 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:35.321 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9beed77640 1 -- 172.21.15.31:0/2837517108 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9bd4066820 msgr2=0x7f9bd4068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9beed77640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9bd4066820 0x7f9bd4068ce0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009790 tx=0x7f9bd8008040 comp rx=0 tx=0).stop 2023-11-27T17:53:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9beed77640 1 -- 172.21.15.31:0/2837517108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be8144dd0 msgr2=0x7f9be81354d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9beed77640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be8144dd0 0x7f9be81354d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9be000b970 tx=0x7f9be000be30 comp rx=0 tx=0).stop 2023-11-27T17:53:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9beed77640 1 -- 172.21.15.31:0/2837517108 shutdown_connections 2023-11-27T17:53:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9beed77640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9bd4066820 0x7f9bd4068ce0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9beed77640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9be8144dd0 0x7f9be81354d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9beed77640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9be80b9220 0x7f9be81e46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9beed77640 1 --2- 172.21.15.31:0/2837517108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9be80b8440 0x7f9be8143a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9beed77640 1 -- 172.21.15.31:0/2837517108 >> 172.21.15.31:0/2837517108 conn(0x7f9be80c0ce0 msgr2=0x7f9be813daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:35.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9beed77640 1 -- 172.21.15.31:0/2837517108 shutdown_connections 2023-11-27T17:53:35.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.317+0000 7f9beed77640 1 -- 172.21.15.31:0/2837517108 wait complete. 2023-11-27T17:53:35.339 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:53:35.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f1739545640 1 Processor -- start 2023-11-27T17:53:35.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f1739545640 1 -- start start 2023-11-27T17:53:35.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f1739545640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17341430a0 0x7f17340b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f1739545640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f17340bd240 0x7f1734149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f1739545640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f17340bd680 0x7f17341495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f1739545640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17340b5d00 con 0x7f17340bd240 2023-11-27T17:53:35.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f1739545640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1734143750 con 0x7f17340bd680 2023-11-27T17:53:35.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f1739545640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1734143480 con 0x7f17341430a0 2023-11-27T17:53:35.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f17327fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f17340bd240 0x7f1734149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:35.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f17327fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f17340bd240 0x7f1734149070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38690/0 (socket says 172.21.15.31:38690) 2023-11-27T17:53:35.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f17327fc640 1 -- 172.21.15.31:0/789378807 learned_addr learned my addr 172.21.15.31:0/789378807 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:35.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f17337fe640 1 --2- 172.21.15.31:0/789378807 >> v2:172.21.15.81:3300/0 conn(0x7f17340bd680 0x7f17341495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:35.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f1732ffd640 1 --2- 172.21.15.31:0/789378807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17341430a0 0x7f17340b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:35.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f17327fc640 1 -- 172.21.15.31:0/789378807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17341430a0 msgr2=0x7f17340b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:35.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f17327fc640 1 --2- 172.21.15.31:0/789378807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17341430a0 0x7f17340b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f17327fc640 1 -- 172.21.15.31:0/789378807 >> v2:172.21.15.81:3300/0 conn(0x7f17340bd680 msgr2=0x7f17341495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:35.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f17327fc640 1 --2- 172.21.15.31:0/789378807 >> v2:172.21.15.81:3300/0 conn(0x7f17340bd680 0x7f17341495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f17327fc640 1 -- 172.21.15.31:0/789378807 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17340b4f40 con 0x7f17340bd240 2023-11-27T17:53:35.450 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f17327fc640 1 --2- 172.21.15.31:0/789378807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17340bd240 0x7f1734149070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f17340745d0 tx=0x7f172801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f3d9e6cb004619 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:35.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f1731ffb640 1 -- 172.21.15.31:0/789378807 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17280a89b0 con 0x7f17340bd240 2023-11-27T17:53:35.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f1731ffb640 1 -- 172.21.15.31:0/789378807 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17280a8b10 con 0x7f17340bd240 2023-11-27T17:53:35.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.445+0000 7f1731ffb640 1 -- 172.21.15.31:0/789378807 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17280a8ea0 con 0x7f17340bd240 2023-11-27T17:53:35.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 -- 172.21.15.31:0/789378807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17340bd240 msgr2=0x7f1734149070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:35.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 --2- 172.21.15.31:0/789378807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17340bd240 0x7f1734149070 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f17340745d0 tx=0x7f172801ecf0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 -- 172.21.15.31:0/789378807 shutdown_connections 2023-11-27T17:53:35.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 --2- 172.21.15.31:0/789378807 >> v2:172.21.15.81:3300/0 conn(0x7f17340bd680 0x7f17341495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 --2- 172.21.15.31:0/789378807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17340bd240 0x7f1734149070 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 --2- 172.21.15.31:0/789378807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17341430a0 0x7f17340b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 -- 172.21.15.31:0/789378807 >> 172.21.15.31:0/789378807 conn(0x7f173406ab60 msgr2=0x7f17340bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:35.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 -- 172.21.15.31:0/789378807 shutdown_connections 2023-11-27T17:53:35.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 -- 172.21.15.31:0/789378807 wait complete. 2023-11-27T17:53:35.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 Processor -- start 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 -- start start 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17340bd240 0x7f17341defb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17340bd680 0x7f173414c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17341430a0 0x7f17341e1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17341de7f0 con 0x7f17340bd680 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17341d30c0 con 0x7f17341430a0 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173414ce80 con 0x7f17340bd240 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f17327fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17340bd680 0x7f173414c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f17327fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17340bd680 0x7f173414c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38692/0 (socket says 172.21.15.31:38692) 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f17327fc640 1 -- 172.21.15.31:0/4186372353 learned_addr learned my addr 172.21.15.31:0/4186372353 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f17337fe640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17341430a0 0x7f17341e1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1732ffd640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17340bd240 0x7f17341defb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:35.455 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f17327fc640 1 -- 172.21.15.31:0/4186372353 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17340bd240 msgr2=0x7f17341defb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:35.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f17327fc640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17340bd240 0x7f17341defb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f17327fc640 1 -- 172.21.15.31:0/4186372353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17341430a0 msgr2=0x7f17341e1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:35.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f17327fc640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17341430a0 0x7f17341e1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f17327fc640 1 -- 172.21.15.31:0/4186372353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280094d0 con 0x7f17340bd680 2023-11-27T17:53:35.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f17337fe640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17341430a0 0x7f17341e1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:35.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f17327fc640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17340bd680 0x7f173414c410 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f172801d3a0 tx=0x7f172801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:35.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f171b7fe640 1 -- 172.21.15.31:0/4186372353 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17280ba600 con 0x7f17340bd680 2023-11-27T17:53:35.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f171b7fe640 1 -- 172.21.15.31:0/4186372353 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17280ba760 con 0x7f17340bd680 2023-11-27T17:53:35.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f171b7fe640 1 -- 172.21.15.31:0/4186372353 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17280bab10 con 0x7f17340bd680 2023-11-27T17:53:35.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 -- 172.21.15.31:0/4186372353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17341dea90 con 0x7f17340bd680 2023-11-27T17:53:35.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.449+0000 7f1739545640 1 -- 172.21.15.31:0/4186372353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173414d160 con 0x7f17340bd680 2023-11-27T17:53:35.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.453+0000 7f1739545640 1 -- 172.21.15.31:0/4186372353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173404e850 con 0x7f17340bd680 2023-11-27T17:53:35.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.453+0000 7f171b7fe640 1 -- 172.21.15.31:0/4186372353 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f17280bac70 con 0x7f17340bd680 2023-11-27T17:53:35.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.453+0000 7f171b7fe640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17200667f0 0x7f1720068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:35.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.453+0000 7f171b7fe640 1 -- 172.21.15.31:0/4186372353 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17281227a0 con 0x7f17340bd680 2023-11-27T17:53:35.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.453+0000 7f1732ffd640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17200667f0 0x7f1720068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:35.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.453+0000 7f1732ffd640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17200667f0 0x7f1720068cb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1724009710 tx=0x7f1724008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:35.460 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.457+0000 7f171b7fe640 1 -- 172.21.15.31:0/4186372353 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f17280ef930 con 0x7f17340bd680 2023-11-27T17:53:35.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.641+0000 7f1739545640 1 -- 172.21.15.31:0/4186372353 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1734142790 con 0x7f17340bd680 2023-11-27T17:53:35.647 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f171b7fe640 1 -- 172.21.15.31:0/4186372353 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4111 (secure 0 0 0) 0x7f17280f2f50 con 0x7f17340bd680 2023-11-27T17:53:35.647 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:35.648 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/1250401972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1250401972},{"type":"v1","addr":"172.21.15.31:6836","nonce":1250401972}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1133939246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1133939246},{"type":"v1","addr":"172.21.15.31:6837","nonce":1133939246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:53:23.383311+0000","modified":"2023-11-27T17:53:25.372630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6833/88283146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":88283146},{"type":"v1","addr":"172.21.15.81:6833","nonce":88283146}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:53:35.648 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2023-11-27T17:53:35.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f1739545640 1 -- 172.21.15.31:0/4186372353 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17200667f0 msgr2=0x7f1720068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:35.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f1739545640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17200667f0 0x7f1720068cb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1724009710 tx=0x7f1724008040 comp rx=0 tx=0).stop 2023-11-27T17:53:35.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f1739545640 1 -- 172.21.15.31:0/4186372353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17340bd680 msgr2=0x7f173414c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:35.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f1739545640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17340bd680 0x7f173414c410 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f172801d3a0 tx=0x7f172801ba90 comp rx=0 tx=0).stop 2023-11-27T17:53:35.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f1739545640 1 -- 172.21.15.31:0/4186372353 shutdown_connections 2023-11-27T17:53:35.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f1739545640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17200667f0 0x7f1720068cb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f1739545640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17341430a0 0x7f17341e1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f1739545640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f17340bd680 0x7f173414c410 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f1739545640 1 --2- 172.21.15.31:0/4186372353 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17340bd240 0x7f17341defb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:35.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f1739545640 1 -- 172.21.15.31:0/4186372353 >> 172.21.15.31:0/4186372353 conn(0x7f173406ab60 msgr2=0x7f17340b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:35.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f1739545640 1 -- 172.21.15.31:0/4186372353 shutdown_connections 2023-11-27T17:53:35.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:35.645+0000 7f1739545640 1 -- 172.21.15.31:0/4186372353 wait complete. 2023-11-27T17:53:35.967 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T17:53:23.383311+0000', 'modified': '2023-11-27T17:53:25.372630+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6833/88283146', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 88283146}, {'type': 'v1', 'addr': '172.21.15.81:6833', 'nonce': 88283146}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-27T17:53:35.967 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T17:53:35.967 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-27T17:53:36.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cffdc3640 1 Processor -- start 2023-11-27T17:53:36.097 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cffdc3640 1 -- start start 2023-11-27T17:53:36.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cffdc3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6cf81425e0 0x7f6cf80bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cffdc3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6cf80b5d90 0x7f6cf80b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cffdc3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cf81486b0 0x7f6cf8148b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cffdc3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf81429c0 con 0x7f6cf80b5d90 2023-11-27T17:53:36.098 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cffdc3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf806f7c0 con 0x7f6cf81425e0 2023-11-27T17:53:36.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cffdc3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf80b6730 con 0x7f6cf81486b0 2023-11-27T17:53:36.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cfd35e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6cf80b5d90 0x7f6cf80b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cfd35e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6cf80b5d90 0x7f6cf80b61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38700/0 (socket says 172.21.15.31:38700) 2023-11-27T17:53:36.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cfd35e640 1 -- 172.21.15.31:0/4143974145 learned_addr learned my addr 172.21.15.31:0/4143974145 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:36.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/4143974145 >> v2:172.21.15.81:3300/0 conn(0x7f6cf81425e0 0x7f6cf80bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cfe360640 1 --2- 172.21.15.31:0/4143974145 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cf81486b0 0x7f6cf8148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cfd35e640 1 -- 172.21.15.31:0/4143974145 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cf81486b0 msgr2=0x7f6cf8148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/4143974145 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cf81486b0 0x7f6cf8148b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cfd35e640 1 -- 172.21.15.31:0/4143974145 >> v2:172.21.15.81:3300/0 conn(0x7f6cf81425e0 msgr2=0x7f6cf80bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/4143974145 >> v2:172.21.15.81:3300/0 conn(0x7f6cf81425e0 0x7f6cf80bd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.099 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.093+0000 7f6cfd35e640 1 -- 172.21.15.31:0/4143974145 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8149080 con 0x7f6cf80b5d90 2023-11-27T17:53:36.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/4143974145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cf80b5d90 0x7f6cf80b61d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80bdb30 tx=0x7f6ce801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4e700fbc0504c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:36.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cfcb5d640 1 -- 172.21.15.31:0/4143974145 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80a89b0 con 0x7f6cf80b5d90 2023-11-27T17:53:36.100 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cfcb5d640 1 -- 172.21.15.31:0/4143974145 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce80a8b10 con 0x7f6cf80b5d90 2023-11-27T17:53:36.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cfcb5d640 1 -- 172.21.15.31:0/4143974145 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80a8ea0 con 0x7f6cf80b5d90 2023-11-27T17:53:36.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 -- 172.21.15.31:0/4143974145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cf80b5d90 msgr2=0x7f6cf80b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 --2- 172.21.15.31:0/4143974145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cf80b5d90 0x7f6cf80b61d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80bdb30 tx=0x7f6ce801ecf0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 -- 172.21.15.31:0/4143974145 shutdown_connections 2023-11-27T17:53:36.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 --2- 172.21.15.31:0/4143974145 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cf81486b0 0x7f6cf8148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 --2- 172.21.15.31:0/4143974145 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cf80b5d90 0x7f6cf80b61d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 --2- 172.21.15.31:0/4143974145 >> v2:172.21.15.81:3300/0 conn(0x7f6cf81425e0 0x7f6cf80bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 -- 172.21.15.31:0/4143974145 >> 172.21.15.31:0/4143974145 conn(0x7f6cf806ab60 msgr2=0x7f6cf80bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:36.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 -- 172.21.15.31:0/4143974145 shutdown_connections 2023-11-27T17:53:36.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 -- 172.21.15.31:0/4143974145 wait complete. 2023-11-27T17:53:36.102 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 Processor -- start 2023-11-27T17:53:36.103 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 -- start start 2023-11-27T17:53:36.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cf80b5d90 0x7f6cf81e4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.097+0000 7f6cffdc3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cf81425e0 0x7f6cf81360e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.104 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cffdc3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cf81486b0 0x7f6cf8139010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cffdc3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf81e3e80 con 0x7f6cf81486b0 2023-11-27T17:53:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cffdc3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf8137c40 con 0x7f6cf80b5d90 2023-11-27T17:53:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cffdc3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf8139550 con 0x7f6cf81425e0 2023-11-27T17:53:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfe360640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cf81486b0 0x7f6cf8139010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfe360640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cf81486b0 0x7f6cf8139010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38712/0 (socket says 172.21.15.31:38712) 2023-11-27T17:53:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfe360640 1 -- 172.21.15.31:0/2745915080 learned_addr learned my addr 172.21.15.31:0/2745915080 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cf81425e0 0x7f6cf81360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cf80b5d90 0x7f6cf81e4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfe360640 1 -- 172.21.15.31:0/2745915080 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cf81425e0 msgr2=0x7f6cf81360e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfe360640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cf81425e0 0x7f6cf81360e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfe360640 1 -- 172.21.15.31:0/2745915080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cf80b5d90 msgr2=0x7f6cf81e4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.105 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfe360640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cf80b5d90 0x7f6cf81e4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfe360640 1 -- 172.21.15.31:0/2745915080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80094d0 con 0x7f6cf81486b0 2023-11-27T17:53:36.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cf80b5d90 0x7f6cf81e4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:36.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfe360640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cf81486b0 0x7f6cf8139010 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000cc30 tx=0x7f6cf000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:36.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cee7fc640 1 -- 172.21.15.31:0/2745915080 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf000ce40 con 0x7f6cf81486b0 2023-11-27T17:53:36.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cee7fc640 1 -- 172.21.15.31:0/2745915080 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf00039a0 con 0x7f6cf81486b0 2023-11-27T17:53:36.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cffdc3640 1 -- 172.21.15.31:0/2745915080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf81e4120 con 0x7f6cf81486b0 2023-11-27T17:53:36.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cee7fc640 1 -- 172.21.15.31:0/2745915080 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0003d30 con 0x7f6cf81486b0 2023-11-27T17:53:36.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cffdc3640 1 -- 172.21.15.31:0/2745915080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf8139820 con 0x7f6cf81486b0 2023-11-27T17:53:36.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cee7fc640 1 -- 172.21.15.31:0/2745915080 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f6cf0003e90 con 0x7f6cf81486b0 2023-11-27T17:53:36.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cee7fc640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6cdc0667f0 0x7f6cdc068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6cdc0667f0 0x7f6cdc068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cee7fc640 1 -- 172.21.15.31:0/2745915080 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cf00845c0 con 0x7f6cf81486b0 2023-11-27T17:53:36.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6cdc0667f0 0x7f6cdc068cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40097c0 tx=0x7f6cf4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:36.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6d02ef3000 1 Processor -- start 2023-11-27T17:53:36.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.101+0000 7f6d02ef3000 1 -- start start 2023-11-27T17:53:36.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76973350 0x55bc76973730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973c70 0x55bc7696e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc7696ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc767a4130 con 0x55bc7696e630 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc767919a0 con 0x55bc76973350 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc7678eed0 con 0x55bc76973c70 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfe360640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc7696ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfe360640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc7696ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38720/0 (socket says 172.21.15.31:38720) 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfe360640 1 -- 172.21.15.31:0/839990821 learned_addr learned my addr 172.21.15.31:0/839990821 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/839990821 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973c70 0x55bc7696e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/839990821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76973350 0x55bc76973730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfe360640 1 -- 172.21.15.31:0/839990821 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973c70 msgr2=0x55bc7696e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfe360640 1 --2- 172.21.15.31:0/839990821 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973c70 0x55bc7696e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfe360640 1 -- 172.21.15.31:0/839990821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76973350 msgr2=0x55bc76973730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfe360640 1 --2- 172.21.15.31:0/839990821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76973350 0x55bc76973730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfe360640 1 -- 172.21.15.31:0/839990821 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc76482890 con 0x55bc7696e630 2023-11-27T17:53:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/839990821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76973350 0x55bc76973730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfe360640 1 --2- 172.21.15.31:0/839990821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc7696ea10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6cf005d1e0 tx=0x7f6cf0055080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5db3d1101db307 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cdb7fe640 1 -- 172.21.15.31:0/839990821 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf005d710 con 0x55bc7696e630 2023-11-27T17:53:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cdb7fe640 1 -- 172.21.15.31:0/839990821 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf00537b0 con 0x55bc7696e630 2023-11-27T17:53:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cdb7fe640 1 -- 172.21.15.31:0/839990821 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00591b0 con 0x55bc7696e630 2023-11-27T17:53:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- 172.21.15.31:0/839990821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 msgr2=0x55bc7696ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/839990821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc7696ea10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6cf005d1e0 tx=0x7f6cf0055080 comp rx=0 tx=0).stop 2023-11-27T17:53:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- 172.21.15.31:0/839990821 shutdown_connections 2023-11-27T17:53:36.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/839990821 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc7696ea10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/839990821 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973c70 0x55bc7696e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/839990821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76973350 0x55bc76973730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- 172.21.15.31:0/839990821 >> 172.21.15.31:0/839990821 conn(0x55bc76969ea0 msgr2=0x55bc7696c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- 172.21.15.31:0/839990821 shutdown_connections 2023-11-27T17:53:36.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- 172.21.15.31:0/839990821 wait complete. 2023-11-27T17:53:36.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- start start 2023-11-27T17:53:36.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 Processor -- start 2023-11-27T17:53:36.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc7696e630 0x55bc76968c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc76973350 0x55bc76969190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76973c70 0x55bc76974050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7678a7c0 con 0x55bc76973350 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc76742bf0 con 0x55bc76973c70 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc76748a90 con 0x55bc7696e630 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 10 client.0 _ll_register_callbacks cb 0x55bc769253c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfd35e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc76973350 0x55bc76969190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfd35e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc76973350 0x55bc76969190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38730/0 (socket says 172.21.15.31:38730) 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfd35e640 1 -- 172.21.15.31:0/915642531 learned_addr learned my addr 172.21.15.31:0/915642531 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc7696e630 0x55bc76968c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfe360640 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76973c70 0x55bc76974050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfd35e640 1 -- 172.21.15.31:0/915642531 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc7696e630 msgr2=0x55bc76968c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc7696e630 0x55bc76968c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfd35e640 1 -- 172.21.15.31:0/915642531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76973c70 msgr2=0x55bc76974050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76973c70 0x55bc76974050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfd35e640 1 -- 172.21.15.31:0/915642531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf8139820 con 0x55bc76973350 2023-11-27T17:53:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc76973350 0x55bc76969190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6ce801d3a0 tx=0x7f6ce801d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29042f83ff86f587 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-11-27T17:53:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cd8ff9640 1 -- 172.21.15.31:0/915642531 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80b0a70 con 0x55bc76973350 2023-11-27T17:53:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6cd8ff9640 1 -- 172.21.15.31:0/915642531 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ce80b0bd0 con 0x55bc76973350 2023-11-27T17:53:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.105+0000 7f6d02ef3000 1 -- 172.21.15.31:0/915642531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc7674c470 con 0x55bc76973350 2023-11-27T17:53:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6cd8ff9640 1 -- 172.21.15.31:0/915642531 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ce80b0d90 con 0x55bc76973350 2023-11-27T17:53:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 10 client.4662 fetch_fsmap learned FSMap version 6 2023-11-27T17:53:36.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 -- 172.21.15.31:0/915642531 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55bc7674b190 con 0x55bc76973350 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6cd8ff9640 1 -- 172.21.15.31:0/915642531 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc7674c470 con 0x55bc76973350 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6cd8ff9640 1 -- 172.21.15.31:0/915642531 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 6) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f6ce80b8360 con 0x55bc76973350 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 10 client.4662 fetch_fsmap finished waiting for FSMap version 6 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 10 client.4662 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 20 client.4662 populate_metadata read hostname 'smithi031' 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.81:6832/88283146,v1:172.21.15.81:6833/88283146] conn(0x55bc76974df0 0x55bc769751d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 4 client.4662 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 -- 172.21.15.31:0/915642531 --> [v2:172.21.15.81:6832/88283146,v1:172.21.15.81:6833/88283146] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc7674fb50 con 0x55bc76974df0 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.81:6832/88283146,v1:172.21.15.81:6833/88283146] conn(0x55bc76974df0 0x55bc769751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.81:6832/88283146,v1:172.21.15.81:6833/88283146] conn(0x55bc76974df0 0x55bc769751d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f059bc2f655897e server_cookie=6602dc38738642b7 in_seq=0 out_seq=0 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6cd8ff9640 10 client.4662 ms_handle_connect on v2:172.21.15.81:6832/88283146 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6cd8ff9640 1 -- 172.21.15.31:0/915642531 <== mds.0 v2:172.21.15.81:6832/88283146 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bc7674fb50 con 0x55bc76974df0 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6cd8ff9640 10 client.4662 handle_command_reply: tid=0 2023-11-27T17:53:36.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 client.4662 shutdown 2023-11-27T17:53:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 -- 172.21.15.31:0/915642531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc76973350 msgr2=0x55bc76969190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc76973350 0x55bc76969190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6ce801d3a0 tx=0x7f6ce801d530 comp rx=0 tx=0).stop 2023-11-27T17:53:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 -- 172.21.15.31:0/915642531 shutdown_connections 2023-11-27T17:53:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.81:6832/88283146,v1:172.21.15.81:6833/88283146] conn(0x55bc76974df0 0x55bc769751d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76973c70 0x55bc76974050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc76973350 0x55bc76969190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6cd8ff9640 0 client.4662 ms_handle_reset on v2:172.21.15.81:6832/88283146 2023-11-27T17:53:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/915642531 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc7696e630 0x55bc76968c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 -- 172.21.15.31:0/915642531 >> 172.21.15.31:0/915642531 conn(0x55bc76969ea0 msgr2=0x55bc7696c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 -- 172.21.15.31:0/915642531 shutdown_connections 2023-11-27T17:53:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 1 -- 172.21.15.31:0/915642531 wait complete. 2023-11-27T17:53:36.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.109+0000 7f6d02ef3000 20 client.4662 trim_cache size 0 max 16384 2023-11-27T17:53:36.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6d02ef3000 1 Processor -- start 2023-11-27T17:53:36.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6d02ef3000 1 -- start start 2023-11-27T17:53:36.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6d02ef3000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76969ea0 0x55bc769c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6d02ef3000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc769ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6d02ef3000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973350 0x55bc769cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6d02ef3000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc76443940 con 0x55bc7696e630 2023-11-27T17:53:36.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6d02ef3000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7678e7c0 con 0x55bc76969ea0 2023-11-27T17:53:36.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6d02ef3000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc76787fd0 con 0x55bc76973350 2023-11-27T17:53:36.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfd35e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc769ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfd35e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc769ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38746/0 (socket says 172.21.15.31:38746) 2023-11-27T17:53:36.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfd35e640 1 -- 172.21.15.31:0/2401098824 learned_addr learned my addr 172.21.15.31:0/2401098824 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:36.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/2401098824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76969ea0 0x55bc769c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfe360640 1 --2- 172.21.15.31:0/2401098824 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973350 0x55bc769cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfd35e640 1 -- 172.21.15.31:0/2401098824 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973350 msgr2=0x55bc769cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/2401098824 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973350 0x55bc769cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfd35e640 1 -- 172.21.15.31:0/2401098824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76969ea0 msgr2=0x55bc769c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/2401098824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76969ea0 0x55bc769c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfd35e640 1 -- 172.21.15.31:0/2401098824 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc76731490 con 0x55bc7696e630 2023-11-27T17:53:36.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfe360640 1 --2- 172.21.15.31:0/2401098824 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973350 0x55bc769cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:36.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/2401098824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76969ea0 0x55bc769c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:36.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/2401098824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc769ca6c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ce801d570 tx=0x7f6ce80b9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd57e983f7fb65f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:36.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cdbfff640 1 -- 172.21.15.31:0/2401098824 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80a8870 con 0x55bc7696e630 2023-11-27T17:53:36.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cdbfff640 1 -- 172.21.15.31:0/2401098824 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce80b8360 con 0x55bc7696e630 2023-11-27T17:53:36.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.125+0000 7f6cdbfff640 1 -- 172.21.15.31:0/2401098824 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80b8dc0 con 0x55bc7696e630 2023-11-27T17:53:36.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 -- 172.21.15.31:0/2401098824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 msgr2=0x55bc769ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/2401098824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc769ca6c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ce801d570 tx=0x7f6ce80b9000 comp rx=0 tx=0).stop 2023-11-27T17:53:36.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 -- 172.21.15.31:0/2401098824 shutdown_connections 2023-11-27T17:53:36.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/2401098824 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973350 0x55bc769cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/2401098824 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc769ca6c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/2401098824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76969ea0 0x55bc769c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 -- 172.21.15.31:0/2401098824 >> 172.21.15.31:0/2401098824 conn(0x55bc7697fd60 msgr2=0x55bc769c8480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:36.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 -- 172.21.15.31:0/2401098824 shutdown_connections 2023-11-27T17:53:36.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 -- 172.21.15.31:0/2401098824 wait complete. 2023-11-27T17:53:36.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 -- start start 2023-11-27T17:53:36.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 Processor -- start 2023-11-27T17:53:36.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76969ea0 0x55bc769d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc769d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973350 0x55bc76986a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc7673f760 con 0x55bc7696e630 2023-11-27T17:53:36.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc767cc140 con 0x55bc76969ea0 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc76789650 con 0x55bc76973350 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 10 client.0 _ll_register_callbacks cb 0x55bc7670e6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfd35e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc769d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfd35e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc769d3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38760/0 (socket says 172.21.15.31:38760) 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfd35e640 1 -- 172.21.15.31:0/3192701866 learned_addr learned my addr 172.21.15.31:0/3192701866 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76969ea0 0x55bc769d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfe360640 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973350 0x55bc76986a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfd35e640 1 -- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973350 msgr2=0x55bc76986a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973350 0x55bc76986a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfd35e640 1 -- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76969ea0 msgr2=0x55bc769d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76969ea0 0x55bc769d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfd35e640 1 -- 172.21.15.31:0/3192701866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc7674b190 con 0x55bc7696e630 2023-11-27T17:53:36.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfe360640 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973350 0x55bc76986a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfd35e640 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc769d3e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6ce801e760 tx=0x7f6ce80aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd40eb056d0b9600 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cd8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cd8ff9640 1 -- 172.21.15.31:0/3192701866 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80b8af0 con 0x55bc7696e630 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cd8ff9640 1 -- 172.21.15.31:0/3192701866 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ce80b84d0 con 0x55bc7696e630 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 -- 172.21.15.31:0/3192701866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc76789110 con 0x55bc7696e630 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cd8ff9640 1 -- 172.21.15.31:0/3192701866 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ce80b8c50 con 0x55bc7696e630 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 10 client.4668 fetch_fsmap learned FSMap version 6 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 -- 172.21.15.31:0/3192701866 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55bc76482cc0 con 0x55bc7696e630 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cd8ff9640 1 -- 172.21.15.31:0/3192701866 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc76789110 con 0x55bc7696e630 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cd8ff9640 1 -- 172.21.15.31:0/3192701866 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 6) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f6ce80b07e0 con 0x55bc7696e630 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 10 client.4668 fetch_fsmap finished waiting for FSMap version 6 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 10 client.4668 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 20 client.4668 populate_metadata read hostname 'smithi031' 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:6832/88283146,v1:172.21.15.81:6833/88283146] conn(0x55bc76973c70 0x55bc76987400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 4 client.4668 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6d02ef3000 1 -- 172.21.15.31:0/3192701866 --> [v2:172.21.15.81:6832/88283146,v1:172.21.15.81:6833/88283146] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bc767b89a0 con 0x55bc76973c70 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:6832/88283146,v1:172.21.15.81:6833/88283146] conn(0x55bc76973c70 0x55bc76987400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cfdb5f640 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:6832/88283146,v1:172.21.15.81:6833/88283146] conn(0x55bc76973c70 0x55bc76987400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bf80d61048eec91 server_cookie=3fa5d905c3ff9252 in_seq=0 out_seq=0 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.129+0000 7f6cd8ff9640 10 client.4668 ms_handle_connect on v2:172.21.15.81:6832/88283146 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cd8ff9640 1 -- 172.21.15.31:0/3192701866 <== mds.0 v2:172.21.15.81:6832/88283146 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55bc767b89a0 con 0x55bc76973c70 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cd8ff9640 10 client.4668 handle_command_reply: tid=0 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6d02ef3000 1 client.4668 shutdown 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6d02ef3000 1 -- 172.21.15.31:0/3192701866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 msgr2=0x55bc769d3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc769d3e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6ce801e760 tx=0x7f6ce80aa000 comp rx=0 tx=0).stop 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6d02ef3000 1 -- 172.21.15.31:0/3192701866 shutdown_connections 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55bc76973350 0x55bc76986a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55bc7696e630 0x55bc769d3e50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:6832/88283146,v1:172.21.15.81:6833/88283146] conn(0x55bc76973c70 0x55bc76987400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6d02ef3000 1 --2- 172.21.15.31:0/3192701866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc76969ea0 0x55bc769d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cd8ff9640 0 client.4668 ms_handle_reset on v2:172.21.15.81:6832/88283146 2023-11-27T17:53:36.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6d02ef3000 1 -- 172.21.15.31:0/3192701866 >> 172.21.15.31:0/3192701866 conn(0x55bc7697fd60 msgr2=0x55bc769c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:36.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6d02ef3000 1 -- 172.21.15.31:0/3192701866 shutdown_connections 2023-11-27T17:53:36.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6d02ef3000 1 -- 172.21.15.31:0/3192701866 wait complete. 2023-11-27T17:53:36.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6d02ef3000 20 client.4668 trim_cache size 0 max 16384 2023-11-27T17:53:36.141 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-11-27T17:53:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "d7e0ec54-b878-4521-a03f-3b848cceedea", 2023-11-27T17:53:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-11-27T17:53:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4276, 2023-11-27T17:53:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-11-27T17:53:36.141 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-11-27T17:53:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-11-27T17:53:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 12.086952561, 2023-11-27T17:53:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 6, 2023-11-27T17:53:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 20, 2023-11-27T17:53:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 20, 2023-11-27T17:53:36.142 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 19.171305173 2023-11-27T17:53:36.142 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-11-27T17:53:36.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cffdc3640 1 -- 172.21.15.31:0/2745915080 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6cdc0667f0 msgr2=0x7f6cdc068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cffdc3640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6cdc0667f0 0x7f6cdc068cb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40097c0 tx=0x7f6cf4008040 comp rx=0 tx=0).stop 2023-11-27T17:53:36.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cffdc3640 1 -- 172.21.15.31:0/2745915080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cf81486b0 msgr2=0x7f6cf8139010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cffdc3640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cf81486b0 0x7f6cf8139010 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000cc30 tx=0x7f6cf000a5c0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cffdc3640 1 -- 172.21.15.31:0/2745915080 shutdown_connections 2023-11-27T17:53:36.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cffdc3640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6cdc0667f0 0x7f6cdc068cb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cffdc3640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6cf81486b0 0x7f6cf8139010 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cffdc3640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6cf81425e0 0x7f6cf81360e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cffdc3640 1 --2- 172.21.15.31:0/2745915080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cf80b5d90 0x7f6cf81e4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cffdc3640 1 -- 172.21.15.31:0/2745915080 >> 172.21.15.31:0/2745915080 conn(0x7f6cf806ab60 msgr2=0x7f6cf8133d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:36.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cffdc3640 1 -- 172.21.15.31:0/2745915080 shutdown_connections 2023-11-27T17:53:36.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.133+0000 7f6cffdc3640 1 -- 172.21.15.31:0/2745915080 wait complete. 2023-11-27T17:53:36.151 INFO:teuthology.run_tasks:Running task kclient... 2023-11-27T17:53:36.174 INFO:tasks.kclient:Mounting kernel clients... 2023-11-27T17:53:36.174 INFO:tasks.kclient:config is {'client.0': {}} 2023-11-27T17:53:36.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:36.175 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-27T17:53:36.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:36.185 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2023-11-27T17:53:36.254 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2023-11-27T17:53:36.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-27T17:53:36.256 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-27T17:53:36.256 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-27T17:53:36.256 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T17:53:36.257 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T17:53:36.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.373+0000 7f525b065640 1 Processor -- start 2023-11-27T17:53:36.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.373+0000 7f525b065640 1 -- start start 2023-11-27T17:53:36.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f525b065640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f52540bd240 0x7f5254149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f525b065640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52540b5d00 con 0x7f52541430a0 2023-11-27T17:53:36.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f525b065640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5254143750 con 0x7f52540bd6b0 2023-11-27T17:53:36.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f525b065640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5254143480 con 0x7f52540bd240 2023-11-27T17:53:36.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f5258e01640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f52541430a0 0x7f52540b4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42222/0 (socket says 172.21.15.31:42222) 2023-11-27T17:53:36.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f5258e01640 1 -- 172.21.15.31:0/3660980163 learned_addr learned my addr 172.21.15.31:0/3660980163 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:36.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f5253fff640 1 --2- 172.21.15.31:0/3660980163 >> v2:172.21.15.81:3300/0 conn(0x7f52540bd240 0x7f5254149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283522512 0 0) 0x7f5244001120 con 0x7f52541430a0 2023-11-27T17:53:36.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f523c003530 con 0x7f52541430a0 2023-11-27T17:53:36.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4075442709 0 0) 0x7f523c003530 con 0x7f52541430a0 2023-11-27T17:53:36.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 >> v2:172.21.15.81:3300/0 conn(0x7f52540bd240 msgr2=0x7f5254149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 --2- 172.21.15.31:0/3660980163 >> v2:172.21.15.81:3300/0 conn(0x7f52540bd240 0x7f5254149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 >> v1:172.21.15.81:6789/0 conn(0x7f52540bd6b0 legacy=0x7f5254153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52540b4740 con 0x7f52541430a0 2023-11-27T17:53:36.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f5244001810 con 0x7f52541430a0 2023-11-27T17:53:36.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 >> v1:172.21.15.31:6789/0 conn(0x7f52541430a0 legacy=0x7f52540b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 --2- 172.21.15.31:0/3660980163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0039f0 0x7f523c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 --2- 172.21.15.31:0/3660980163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f523c0047d0 0x7f523c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 --2- 172.21.15.31:0/3660980163 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f523c005190 0x7f523c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5254143480 con 0x7f523c0047d0 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c00c0a0 con 0x7f523c0039f0 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c00c260 con 0x7f523c005190 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f5253fff640 1 --2- 172.21.15.31:0/3660980163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f523c0047d0 0x7f523c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f5258e01640 1 --2- 172.21.15.31:0/3660980163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0039f0 0x7f523c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f5259602640 1 --2- 172.21.15.31:0/3660980163 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f523c005190 0x7f523c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f5253fff640 1 -- 172.21.15.31:0/3660980163 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f523c005190 msgr2=0x7f523c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f5253fff640 1 --2- 172.21.15.31:0/3660980163 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f523c005190 0x7f523c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f5253fff640 1 -- 172.21.15.31:0/3660980163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0039f0 msgr2=0x7f523c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:36.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f5253fff640 1 --2- 172.21.15.31:0/3660980163 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f523c0039f0 0x7f523c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f5253fff640 1 -- 172.21.15.31:0/3660980163 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c003530 con 0x7f523c0047d0 2023-11-27T17:53:36.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.377+0000 7f5259602640 1 -- 172.21.15.31:0/3660980163 reap_dead start 2023-11-27T17:53:36.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5253fff640 1 --2- 172.21.15.31:0/3660980163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f523c0047d0 0x7f523c004c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5248009ae0 tx=0x7f524801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75876419415dbcac server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:36.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480a5640 con 0x7f523c0047d0 2023-11-27T17:53:36.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52480a57a0 con 0x7f523c0047d0 2023-11-27T17:53:36.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f52537fe640 1 -- 172.21.15.31:0/3660980163 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52480a5b50 con 0x7f523c0047d0 2023-11-27T17:53:36.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 -- 172.21.15.31:0/3660980163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f523c0047d0 msgr2=0x7f523c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 --2- 172.21.15.31:0/3660980163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f523c0047d0 0x7f523c004c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5248009ae0 tx=0x7f524801ca50 comp rx=0 tx=0).stop 2023-11-27T17:53:36.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 -- 172.21.15.31:0/3660980163 shutdown_connections 2023-11-27T17:53:36.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 --2- 172.21.15.31:0/3660980163 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f523c0047d0 0x7f523c004c50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 -- 172.21.15.31:0/3660980163 >> 172.21.15.31:0/3660980163 conn(0x7f525406ab60 msgr2=0x7f52540bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:36.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 -- 172.21.15.31:0/3660980163 shutdown_connections 2023-11-27T17:53:36.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 -- 172.21.15.31:0/3660980163 wait complete. 2023-11-27T17:53:36.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 Processor -- start 2023-11-27T17:53:36.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 -- start start 2023-11-27T17:53:36.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f523c0047d0 0x7f52540707b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525406f240 0x7f52541d5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525406f6a0 0x7f52541d5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5254070cf0 con 0x7f525406f240 2023-11-27T17:53:36.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52541dffe0 con 0x7f525406f6a0 2023-11-27T17:53:36.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52541df220 con 0x7f523c0047d0 2023-11-27T17:53:36.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5253fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525406f240 0x7f52541d5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5253fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525406f240 0x7f52541d5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38774/0 (socket says 172.21.15.31:38774) 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5253fff640 1 -- 172.21.15.31:0/2443808847 learned_addr learned my addr 172.21.15.31:0/2443808847 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5258e01640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f523c0047d0 0x7f52540707b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5259602640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525406f6a0 0x7f52541d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5253fff640 1 -- 172.21.15.31:0/2443808847 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f523c0047d0 msgr2=0x7f52540707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5253fff640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f523c0047d0 0x7f52540707b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5253fff640 1 -- 172.21.15.31:0/2443808847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525406f6a0 msgr2=0x7f52541d5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5253fff640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525406f6a0 0x7f52541d5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5253fff640 1 -- 172.21.15.31:0/2443808847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52541df500 con 0x7f525406f240 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5259602640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525406f6a0 0x7f52541d5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f5253fff640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525406f240 0x7f52541d5700 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f524801c880 tx=0x7f52480197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f52517fa640 1 -- 172.21.15.31:0/2443808847 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248004020 con 0x7f525406f240 2023-11-27T17:53:36.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f52517fa640 1 -- 172.21.15.31:0/2443808847 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52480041a0 con 0x7f525406f240 2023-11-27T17:53:36.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f52517fa640 1 -- 172.21.15.31:0/2443808847 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248003620 con 0x7f525406f240 2023-11-27T17:53:36.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 -- 172.21.15.31:0/2443808847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52541df7e0 con 0x7f525406f240 2023-11-27T17:53:36.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.381+0000 7f525b065640 1 -- 172.21.15.31:0/2443808847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5254071320 con 0x7f525406f240 2023-11-27T17:53:36.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.385+0000 7f525b065640 1 -- 172.21.15.31:0/2443808847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525404e850 con 0x7f525406f240 2023-11-27T17:53:36.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.385+0000 7f52517fa640 1 -- 172.21.15.31:0/2443808847 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f52480b4070 con 0x7f525406f240 2023-11-27T17:53:36.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.385+0000 7f52517fa640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f52400667e0 0x7f5240068ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:36.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.385+0000 7f52517fa640 1 -- 172.21.15.31:0/2443808847 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f524811eb10 con 0x7f525406f240 2023-11-27T17:53:36.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.385+0000 7f5258e01640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f52400667e0 0x7f5240068ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:36.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.385+0000 7f5258e01640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f52400667e0 0x7f5240068ca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5244000c10 tx=0x7f5244009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:36.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.389+0000 7f52517fa640 1 -- 172.21.15.31:0/2443808847 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f52480ebca0 con 0x7f525406f240 2023-11-27T17:53:36.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 -- 172.21.15.31:0/2443808847 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f52540b6d00 con 0x7f525406f240 2023-11-27T17:53:36.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f52517fa640 1 -- 172.21.15.31:0/2443808847 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f52480bc070 con 0x7f525406f240 2023-11-27T17:53:36.577 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T17:53:36.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 -- 172.21.15.31:0/2443808847 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f52400667e0 msgr2=0x7f5240068ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f52400667e0 0x7f5240068ca0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5244000c10 tx=0x7f5244009040 comp rx=0 tx=0).stop 2023-11-27T17:53:36.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 -- 172.21.15.31:0/2443808847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525406f240 msgr2=0x7f52541d5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:36.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525406f240 0x7f52541d5700 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f524801c880 tx=0x7f52480197f0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 -- 172.21.15.31:0/2443808847 shutdown_connections 2023-11-27T17:53:36.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f52400667e0 0x7f5240068ca0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525406f6a0 0x7f52541d5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f525406f240 0x7f52541d5700 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 --2- 172.21.15.31:0/2443808847 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f523c0047d0 0x7f52540707b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:36.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 -- 172.21.15.31:0/2443808847 >> 172.21.15.31:0/2443808847 conn(0x7f525406ab60 msgr2=0x7f52540bc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:36.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 -- 172.21.15.31:0/2443808847 shutdown_connections 2023-11-27T17:53:36.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:36.573+0000 7f525b065640 1 -- 172.21.15.31:0/2443808847 wait complete. 2023-11-27T17:53:36.594 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-27T17:53:36.594 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T17:53:36.594 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2023-11-27T17:53:36.594 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-27T17:53:36.594 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T17:53:36.594 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-27T17:53:36.594 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-27T17:53:36.594 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T17:53:36.594 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T17:53:36.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:36.595 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2023-11-27T17:53:36.604 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T17:53:36.604 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T17:53:36.604 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T17:53:36.605 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:53:36.605 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2023-11-27T17:53:36.605 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:53:36.605 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-27T17:53:36.605 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:53:36.605 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2023-11-27T17:53:36.605 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-27T17:53:36.605 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:53:36.605 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2023-11-27T17:53:36.605 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-27T17:53:36.605 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:53:36.606 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T17:53:36.606 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:53:36.606 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-27T17:53:36.606 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 41876sec preferred_lft 41876sec 2023-11-27T17:53:36.606 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link 2023-11-27T17:53:36.606 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:53:36.606 INFO:teuthology.orchestra.run.smithi176.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-27T17:53:36.606 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 02:42:b5:18:27:01 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:53:36.606 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-27T17:53:36.606 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:53:36.607 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-27T17:53:36.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:36.608 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-27T17:53:36.608 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-27T17:53:36.608 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add name ceph-brx type bridge 2023-11-27T17:53:36.608 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr flush dev ceph-brx 2023-11-27T17:53:36.608 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set ceph-brx up 2023-11-27T17:53:36.608 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-27T17:53:36.608 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-27T17:53:36.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:36.725 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T17:53:36.745 INFO:teuthology.orchestra.run.smithi176.stdout:1 2023-11-27T17:53:36.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:36.748 DEBUG:teuthology.orchestra.run.smithi176:> route 2023-11-27T17:53:36.824 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2023-11-27T17:53:36.824 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T17:53:36.824 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-27T17:53:36.824 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T17:53:36.824 INFO:teuthology.orchestra.run.smithi176.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-27T17:53:36.824 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T17:53:36.824 INFO:teuthology.orchestra.run.smithi176.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-27T17:53:36.825 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-27T17:53:36.825 INFO:teuthology.orchestra.run.smithi176.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-27T17:53:36.825 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T17:53:36.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:36.825 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-27T17:53:36.825 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-27T17:53:36.826 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T17:53:36.826 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T17:53:36.826 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T17:53:36.826 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-27T17:53:36.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:36.917 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-27T17:53:36.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:36.927 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2023-11-27T17:53:36.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:36.981 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-27T17:53:36.981 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-27T17:53:36.981 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T17:53:36.981 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-27T17:53:36.982 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-27T17:53:37.069 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-27T17:53:37.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:37.069 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-27T17:53:37.069 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-27T17:53:37.069 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-27T17:53:37.069 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-27T17:53:37.069 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-27T17:53:37.069 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-27T17:53:37.069 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-27T17:53:37.069 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-27T17:53:37.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:37.234 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-27T17:53:37.234 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-27T17:53:37.234 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2023-11-27T17:53:37.234 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.0 master ceph-brx 2023-11-27T17:53:37.235 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-27T17:53:37.275 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:53:37.276 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T17:53:37.329 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T17:53:37.329 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:53:37.329 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T17:53:37.384 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T17:53:37.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:37.384 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T17:53:37.484 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T17:53:37.484 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T17:53:37.484 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-27T17:53:37.592 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T17:53:37.592 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T17:53:37.592 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-27T17:53:37.592 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.81:3300,172.21.15.81:3301" 2023-11-27T17:53:37.592 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:53:37.607 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T17:53:37.607 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T17:53:37.608 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-27T17:53:37.608 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.81:3300,172.21.15.81:3301" 2023-11-27T17:53:37.608 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:53:37.608 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.81:6789,172.21.15.81:6790" 2023-11-27T17:53:37.608 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.81:6789,172.21.15.81:6790:/ 2023-11-27T17:53:37.608 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=d7e0ec54-b878-4521-a03f-3b848cceedea" will pass to kernel 2023-11-27T17:53:37.612 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T17:53:37.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:37.612 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T17:53:37.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:37.634 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:53:37.718 INFO:teuthology.orchestra.run.smithi176.stdout:client4582 2023-11-27T17:53:37.719 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:53:37.719 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:53:37.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:37.770 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:53:37.846 INFO:teuthology.orchestra.run.smithi176.stdout:client4582 2023-11-27T17:53:37.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:37.846 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:53:37.920 INFO:teuthology.orchestra.run.smithi176.stdout:client4582 2023-11-27T17:53:37.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:37.921 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d7e0ec54-b878-4521-a03f-3b848cceedea.client4582/status') 2023-11-27T17:53:37.996 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4582 (3)172.21.15.176:0/3877136139 2023-11-27T17:53:37.996 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2023-11-27T17:53:37.996 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2023-11-27T17:53:37.996 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2023-11-27T17:53:37.997 INFO:teuthology.orchestra.run.smithi176.stderr:71 bytes copied, 7.0418e-05 s, 1.0 MB/s 2023-11-27T17:53:37.998 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-27T17:53:38.021 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:38.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b6cd0640 1 Processor -- start 2023-11-27T17:53:38.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b6cd0640 1 -- start start 2023-11-27T17:53:38.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b6cd0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b014e8d0 0x7f16b00710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:38.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b6cd0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f16b006cd00 0x7f16b0155c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:38.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b6cd0640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b006ed30 con 0x7f16b0145500 2023-11-27T17:53:38.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b6cd0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b014ed10 con 0x7f16b006cd00 2023-11-27T17:53:38.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b6cd0640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b006e2b0 con 0x7f16b014e8d0 2023-11-27T17:53:38.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b4a6c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f16b0145500 0x7f16b00b97d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42224/0 (socket says 172.21.15.31:42224) 2023-11-27T17:53:38.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b4a6c640 1 -- 172.21.15.31:0/4138568960 learned_addr learned my addr 172.21.15.31:0/4138568960 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:38.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16affff640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b014e8d0 0x7f16b00710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576687553 0 0) 0x7f16b006ed30 con 0x7f16b0145500 2023-11-27T17:53:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b526d640 1 --2- 172.21.15.31:0/4138568960 >> v2:172.21.15.81:3300/0 conn(0x7f16b006cd00 0x7f16b0155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1698003530 con 0x7f16b0145500 2023-11-27T17:53:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3449744416 0 0) 0x7f1698003530 con 0x7f16b0145500 2023-11-27T17:53:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b014e8d0 msgr2=0x7f16b00710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b014e8d0 0x7f16b00710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 >> v2:172.21.15.81:3300/0 conn(0x7f16b006cd00 msgr2=0x7f16b0155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 --2- 172.21.15.31:0/4138568960 >> v2:172.21.15.81:3300/0 conn(0x7f16b006cd00 0x7f16b0155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b0070c50 con 0x7f16b0145500 2023-11-27T17:53:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f16a8001680 con 0x7f16b0145500 2023-11-27T17:53:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 >> v1:172.21.15.31:6789/0 conn(0x7f16b0145500 legacy=0x7f16b00b97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:38.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16980039f0 0x7f1698003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b014e8d0 0x7f16980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1698004d10 0x7f1698005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b014ed10 con 0x7f16980039f0 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b006e2b0 con 0x7f1698004d10 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169800ba40 con 0x7f16b014e8d0 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b4a6c640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16980039f0 0x7f1698003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16affff640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b014e8d0 0x7f16980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b4a6c640 1 -- 172.21.15.31:0/4138568960 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b014e8d0 msgr2=0x7f16980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b4a6c640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b014e8d0 0x7f16980047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b4a6c640 1 -- 172.21.15.31:0/4138568960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1698004d10 msgr2=0x7f1698005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b526d640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1698004d10 0x7f1698005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b4a6c640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1698004d10 0x7f1698005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b4a6c640 1 -- 172.21.15.31:0/4138568960 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1698003530 con 0x7f16980039f0 2023-11-27T17:53:38.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.153+0000 7f16b526d640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1698004d10 0x7f1698005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b4a6c640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16980039f0 0x7f1698003e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f16a800c160 tx=0x7f16a801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64807b75cc527fcc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a80058e0 con 0x7f16980039f0 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a8005a60 con 0x7f16980039f0 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16af7fe640 1 -- 172.21.15.31:0/4138568960 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8005e10 con 0x7f16980039f0 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 -- 172.21.15.31:0/4138568960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16980039f0 msgr2=0x7f1698003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 --2- 172.21.15.31:0/4138568960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16980039f0 0x7f1698003e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f16a800c160 tx=0x7f16a801cbe0 comp rx=0 tx=0).stop 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b526d640 1 -- 172.21.15.31:0/4138568960 reap_dead start 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 -- 172.21.15.31:0/4138568960 shutdown_connections 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 -- 172.21.15.31:0/4138568960 >> 172.21.15.31:0/4138568960 conn(0x7f16b00ba8c0 msgr2=0x7f16b00bacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 -- 172.21.15.31:0/4138568960 shutdown_connections 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 -- 172.21.15.31:0/4138568960 wait complete. 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 Processor -- start 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 -- start start 2023-11-27T17:53:38.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16980039f0 0x7f16b01e4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b00b32a0 0x7f16b01e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16b013fec0 0x7f16b013dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b00b4710 con 0x7f16980039f0 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b01e7570 con 0x7f16b013fec0 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b6cd0640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b013e7b0 con 0x7f16b00b32a0 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b4a6c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16980039f0 0x7f16b01e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b4a6c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16980039f0 0x7f16b01e4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38794/0 (socket says 172.21.15.31:38794) 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.157+0000 7f16b4a6c640 1 -- 172.21.15.31:0/339144214 learned_addr learned my addr 172.21.15.31:0/339144214 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16affff640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b00b32a0 0x7f16b01e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16b526d640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16b013fec0 0x7f16b013dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16b4a6c640 1 -- 172.21.15.31:0/339144214 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b00b32a0 msgr2=0x7f16b01e7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16b4a6c640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b00b32a0 0x7f16b01e7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16b4a6c640 1 -- 172.21.15.31:0/339144214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16b013fec0 msgr2=0x7f16b013dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16b4a6c640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16b013fec0 0x7f16b013dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:38.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16b4a6c640 1 -- 172.21.15.31:0/339144214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b01e77c0 con 0x7f16980039f0 2023-11-27T17:53:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16affff640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b00b32a0 0x7f16b01e7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16b4a6c640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16980039f0 0x7f16b01e4020 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f16a8007040 tx=0x7f1698005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16ad7fa640 1 -- 172.21.15.31:0/339144214 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a80047f0 con 0x7f16980039f0 2023-11-27T17:53:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16ad7fa640 1 -- 172.21.15.31:0/339144214 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a8004950 con 0x7f16980039f0 2023-11-27T17:53:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16b6cd0640 1 -- 172.21.15.31:0/339144214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b01e7aa0 con 0x7f16980039f0 2023-11-27T17:53:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16ad7fa640 1 -- 172.21.15.31:0/339144214 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8004ce0 con 0x7f16980039f0 2023-11-27T17:53:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16b6cd0640 1 -- 172.21.15.31:0/339144214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b0140a40 con 0x7f16980039f0 2023-11-27T17:53:38.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16b6cd0640 1 -- 172.21.15.31:0/339144214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b004e850 con 0x7f16980039f0 2023-11-27T17:53:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16ad7fa640 1 -- 172.21.15.31:0/339144214 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f16a8007070 con 0x7f16980039f0 2023-11-27T17:53:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16ad7fa640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f169c0667f0 0x7f169c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16affff640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f169c0667f0 0x7f169c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16ad7fa640 1 -- 172.21.15.31:0/339144214 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16a811da40 con 0x7f16980039f0 2023-11-27T17:53:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.161+0000 7f16affff640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f169c0667f0 0x7f169c068cb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f16b0154530 tx=0x7f16a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:38.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.165+0000 7f16ad7fa640 1 -- 172.21.15.31:0/339144214 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f16a80eab30 con 0x7f16980039f0 2023-11-27T17:53:38.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.321+0000 7f16b6cd0640 1 -- 172.21.15.31:0/339144214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16b006def0 con 0x7f16980039f0 2023-11-27T17:53:44.942 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.321+0000 7f16ad7fa640 1 -- 172.21.15.31:0/339144214 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7f16a80ee150 con 0x7f16980039f0 2023-11-27T17:53:44.942 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:44.942 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:44.943 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.325+0000 7f16b6cd0640 1 -- 172.21.15.31:0/339144214 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f169c0667f0 msgr2=0x7f169c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:44.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.325+0000 7f16b6cd0640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f169c0667f0 0x7f169c068cb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f16b0154530 tx=0x7f16a4008040 comp rx=0 tx=0).stop 2023-11-27T17:53:44.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.325+0000 7f16b6cd0640 1 -- 172.21.15.31:0/339144214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16980039f0 msgr2=0x7f16b01e4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:44.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.325+0000 7f16b6cd0640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16980039f0 0x7f16b01e4020 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f16a8007040 tx=0x7f1698005800 comp rx=0 tx=0).stop 2023-11-27T17:53:44.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.325+0000 7f16b6cd0640 1 -- 172.21.15.31:0/339144214 shutdown_connections 2023-11-27T17:53:44.944 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.325+0000 7f16b6cd0640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f169c0667f0 0x7f169c068cb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:44.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.325+0000 7f16b6cd0640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16b013fec0 0x7f16b013dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:44.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.325+0000 7f16b6cd0640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f16b00b32a0 0x7f16b01e7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:44.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.325+0000 7f16b6cd0640 1 --2- 172.21.15.31:0/339144214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f16980039f0 0x7f16b01e4020 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:44.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.325+0000 7f16b6cd0640 1 -- 172.21.15.31:0/339144214 >> 172.21.15.31:0/339144214 conn(0x7f16b00ba8c0 msgr2=0x7f16b006acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:44.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.325+0000 7f16b6cd0640 1 -- 172.21.15.31:0/339144214 shutdown_connections 2023-11-27T17:53:44.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:38.325+0000 7f16b6cd0640 1 -- 172.21.15.31:0/339144214 wait complete. 2023-11-27T17:53:44.973 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:53:11.177026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:53:21.543531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:53:22.362977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:53:44.973 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:53:45.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b40ccf640 1 Processor -- start 2023-11-27T17:53:45.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b40ccf640 1 -- start start 2023-11-27T17:53:45.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b40ccf640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b3c0bd4a0 0x7f1b3c0b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b40ccf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0b5fe0 con 0x7f1b3c145240 2023-11-27T17:53:45.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b40ccf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0b56b0 con 0x7f1b3c14f270 2023-11-27T17:53:45.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b40ccf640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b6420 con 0x7f1b3c0bd4a0 2023-11-27T17:53:45.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b39d9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1b3c145240 0x7f1b3c14eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44754/0 (socket says 172.21.15.31:44754) 2023-11-27T17:53:45.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b39d9b640 1 -- 172.21.15.31:0/1258306885 learned_addr learned my addr 172.21.15.31:0/1258306885 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:45.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3a59c640 1 --2- 172.21.15.31:0/1258306885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b3c0bd4a0 0x7f1b3c0b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240589946 0 0) 0x7f1b3c0b5fe0 con 0x7f1b3c145240 2023-11-27T17:53:45.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b24003530 con 0x7f1b3c145240 2023-11-27T17:53:45.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 831572248 0 0) 0x7f1b24003530 con 0x7f1b3c145240 2023-11-27T17:53:45.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b3c0bd4a0 msgr2=0x7f1b3c0b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:45.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 --2- 172.21.15.31:0/1258306885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b3c0bd4a0 0x7f1b3c0b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 >> v1:172.21.15.81:6789/0 conn(0x7f1b3c14f270 legacy=0x7f1b3c155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0b5990 con 0x7f1b3c145240 2023-11-27T17:53:45.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f1b30001680 con 0x7f1b3c145240 2023-11-27T17:53:45.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 >> v1:172.21.15.31:6789/0 conn(0x7f1b3c145240 legacy=0x7f1b3c14eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 --2- 172.21.15.31:0/1258306885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b3c0bd4a0 0x7f1b24003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.123 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 --2- 172.21.15.31:0/1258306885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b24003fa0 0x7f1b240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 --2- 172.21.15.31:0/1258306885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b24004d10 0x7f1b24005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b6420 con 0x7f1b24003fa0 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2400bb80 con 0x7f1b24004d10 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2400bd40 con 0x7f1b3c0bd4a0 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b39d9b640 1 --2- 172.21.15.31:0/1258306885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b24003fa0 0x7f1b240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b3ad9d640 1 --2- 172.21.15.31:0/1258306885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b24004d10 0x7f1b24005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b39d9b640 1 -- 172.21.15.31:0/1258306885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b3c0bd4a0 msgr2=0x7f1b24003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b39d9b640 1 --2- 172.21.15.31:0/1258306885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b3c0bd4a0 0x7f1b24003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b39d9b640 1 -- 172.21.15.31:0/1258306885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b24004d10 msgr2=0x7f1b24005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b39d9b640 1 --2- 172.21.15.31:0/1258306885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b24004d10 0x7f1b24005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.113+0000 7f1b39d9b640 1 -- 172.21.15.31:0/1258306885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b24003530 con 0x7f1b24003fa0 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b39d9b640 1 --2- 172.21.15.31:0/1258306885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b24003fa0 0x7f1b240047d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000c240 tx=0x7f1b3001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2960451cb9323d7a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30005ae0 con 0x7f1b24003fa0 2023-11-27T17:53:45.124 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30005c60 con 0x7f1b24003fa0 2023-11-27T17:53:45.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b3959a640 1 -- 172.21.15.31:0/1258306885 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b300a58d0 con 0x7f1b24003fa0 2023-11-27T17:53:45.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b40ccf640 1 -- 172.21.15.31:0/1258306885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b24003fa0 msgr2=0x7f1b240047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b40ccf640 1 --2- 172.21.15.31:0/1258306885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b24003fa0 0x7f1b240047d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000c240 tx=0x7f1b3001cc10 comp rx=0 tx=0).stop 2023-11-27T17:53:45.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b3ad9d640 1 -- 172.21.15.31:0/1258306885 reap_dead start 2023-11-27T17:53:45.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b40ccf640 1 -- 172.21.15.31:0/1258306885 shutdown_connections 2023-11-27T17:53:45.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b40ccf640 1 -- 172.21.15.31:0/1258306885 >> 172.21.15.31:0/1258306885 conn(0x7f1b3c06ab60 msgr2=0x7f1b3c0bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:45.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b40ccf640 1 -- 172.21.15.31:0/1258306885 shutdown_connections 2023-11-27T17:53:45.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b40ccf640 1 -- 172.21.15.31:0/1258306885 wait complete. 2023-11-27T17:53:45.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b40ccf640 1 Processor -- start 2023-11-27T17:53:45.125 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.117+0000 7f1b40ccf640 1 -- start start 2023-11-27T17:53:45.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b40ccf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b24003fa0 0x7f1b3c14b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b40ccf640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b3c149180 0x7f1b3c14a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b40ccf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b3c14ab10 0x7f1b3c13e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b40ccf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c145dc0 con 0x7f1b3c14ab10 2023-11-27T17:53:45.127 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b40ccf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c14a140 con 0x7f1b24003fa0 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b40ccf640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c146aa0 con 0x7f1b3c149180 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b3ad9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b3c14ab10 0x7f1b3c13e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b3ad9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b3c14ab10 0x7f1b3c13e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42610/0 (socket says 172.21.15.31:42610) 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b3ad9d640 1 -- 172.21.15.31:0/4185435066 learned_addr learned my addr 172.21.15.31:0/4185435066 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b3a59c640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b24003fa0 0x7f1b3c14b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b39d9b640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b3c149180 0x7f1b3c14a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b3ad9d640 1 -- 172.21.15.31:0/4185435066 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b3c149180 msgr2=0x7f1b3c14a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b3ad9d640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b3c149180 0x7f1b3c14a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b3ad9d640 1 -- 172.21.15.31:0/4185435066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b24003fa0 msgr2=0x7f1b3c14b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b3ad9d640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b24003fa0 0x7f1b3c14b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b3ad9d640 1 -- 172.21.15.31:0/4185435066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c14bcd0 con 0x7f1b3c14ab10 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b3ad9d640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b3c14ab10 0x7f1b3c13e240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c06b8b0 tx=0x7f1b3400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b2affd640 1 -- 172.21.15.31:0/4185435066 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34017070 con 0x7f1b3c14ab10 2023-11-27T17:53:45.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b2affd640 1 -- 172.21.15.31:0/4185435066 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b34006b60 con 0x7f1b3c14ab10 2023-11-27T17:53:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b40ccf640 1 -- 172.21.15.31:0/4185435066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c149dd0 con 0x7f1b3c14ab10 2023-11-27T17:53:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b2affd640 1 -- 172.21.15.31:0/4185435066 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34006cf0 con 0x7f1b3c14ab10 2023-11-27T17:53:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b40ccf640 1 -- 172.21.15.31:0/4185435066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c0b3ad0 con 0x7f1b3c14ab10 2023-11-27T17:53:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b40ccf640 1 -- 172.21.15.31:0/4185435066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c14a2b0 con 0x7f1b3c14ab10 2023-11-27T17:53:45.129 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b2affd640 1 -- 172.21.15.31:0/4185435066 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1b34003980 con 0x7f1b3c14ab10 2023-11-27T17:53:45.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b2affd640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1b1c0667f0 0x7f1b1c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b3a59c640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1b1c0667f0 0x7f1b1c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b2affd640 1 -- 172.21.15.31:0/4185435066 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b34083a50 con 0x7f1b3c14ab10 2023-11-27T17:53:45.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.121+0000 7f1b3a59c640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1b1c0667f0 0x7f1b1c068cb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0047c0 tx=0x7f1b2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:45.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.125+0000 7f1b2affd640 1 -- 172.21.15.31:0/4185435066 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1b34050ac0 con 0x7f1b3c14ab10 2023-11-27T17:53:45.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.285+0000 7f1b40ccf640 1 -- 172.21.15.31:0/4185435066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b3c14a2b0 con 0x7f1b3c14ab10 2023-11-27T17:53:45.290 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.285+0000 7f1b2affd640 1 -- 172.21.15.31:0/4185435066 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b340540e0 con 0x7f1b3c14ab10 2023-11-27T17:53:45.290 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-11-27T17:53:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.289+0000 7f1b40ccf640 1 -- 172.21.15.31:0/4185435066 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1b1c0667f0 msgr2=0x7f1b1c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.289+0000 7f1b40ccf640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1b1c0667f0 0x7f1b1c068cb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0047c0 tx=0x7f1b2c008040 comp rx=0 tx=0).stop 2023-11-27T17:53:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.289+0000 7f1b40ccf640 1 -- 172.21.15.31:0/4185435066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b3c14ab10 msgr2=0x7f1b3c13e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.289+0000 7f1b40ccf640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b3c14ab10 0x7f1b3c13e240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c06b8b0 tx=0x7f1b3400ec10 comp rx=0 tx=0).stop 2023-11-27T17:53:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.289+0000 7f1b40ccf640 1 -- 172.21.15.31:0/4185435066 shutdown_connections 2023-11-27T17:53:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.289+0000 7f1b40ccf640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1b1c0667f0 0x7f1b1c068cb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.293 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.289+0000 7f1b40ccf640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1b3c14ab10 0x7f1b3c13e240 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.289+0000 7f1b40ccf640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1b3c149180 0x7f1b3c14a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.289+0000 7f1b40ccf640 1 --2- 172.21.15.31:0/4185435066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b24003fa0 0x7f1b3c14b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.289+0000 7f1b40ccf640 1 -- 172.21.15.31:0/4185435066 >> 172.21.15.31:0/4185435066 conn(0x7f1b3c06ab60 msgr2=0x7f1b3c0bbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:45.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.289+0000 7f1b40ccf640 1 -- 172.21.15.31:0/4185435066 shutdown_connections 2023-11-27T17:53:45.294 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.289+0000 7f1b40ccf640 1 -- 172.21.15.31:0/4185435066 wait complete. 2023-11-27T17:53:45.310 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:53:45.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.433+0000 7f975ed49640 1 Processor -- start 2023-11-27T17:53:45.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.433+0000 7f975ed49640 1 -- start start 2023-11-27T17:53:45.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975ed49640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f97580b5f30 0x7f9758147c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975ed49640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97580b6310 0x7f97580b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975ed49640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97581486d0 con 0x7f97580b3900 2023-11-27T17:53:45.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975ed49640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9758148180 con 0x7f97580b5f30 2023-11-27T17:53:45.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975ed49640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97580b6940 con 0x7f97580b6310 2023-11-27T17:53:45.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975cae5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f97580b5f30 0x7f9758147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f9757fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f97580b3900 0x7f97580724e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44756/0 (socket says 172.21.15.31:44756) 2023-11-27T17:53:45.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f9757fff640 1 -- 172.21.15.31:0/1232022228 learned_addr learned my addr 172.21.15.31:0/1232022228 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:45.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975d2e6640 1 --2- 172.21.15.31:0/1232022228 >> v2:172.21.15.81:3300/0 conn(0x7f97580b6310 0x7f97580b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975cae5640 1 -- 172.21.15.31:0/1232022228 >> v2:172.21.15.81:3300/0 conn(0x7f97580b6310 msgr2=0x7f97580b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:45.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975cae5640 1 --2- 172.21.15.31:0/1232022228 >> v2:172.21.15.81:3300/0 conn(0x7f97580b6310 0x7f97580b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975cae5640 1 -- 172.21.15.31:0/1232022228 >> v1:172.21.15.31:6789/0 conn(0x7f97580b3900 legacy=0x7f97580724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975cae5640 1 -- 172.21.15.31:0/1232022228 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9758072bf0 con 0x7f97580b5f30 2023-11-27T17:53:45.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f97577fe640 1 -- 172.21.15.31:0/1232022228 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540423889 0 0) 0x7f97581486d0 con 0x7f97580b3900 2023-11-27T17:53:45.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975d2e6640 1 --2- 172.21.15.31:0/1232022228 >> v2:172.21.15.81:3300/0 conn(0x7f97580b6310 0x7f97580b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:45.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f975cae5640 1 --2- 172.21.15.31:0/1232022228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97580b5f30 0x7f9758147c40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f97580b3ee0 tx=0x7f974801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db5d080a040a86b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:45.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f97577fe640 1 -- 172.21.15.31:0/1232022228 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97480a59a0 con 0x7f97580b5f30 2023-11-27T17:53:45.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f97577fe640 1 -- 172.21.15.31:0/1232022228 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97480a5b00 con 0x7f97580b5f30 2023-11-27T17:53:45.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.437+0000 7f97577fe640 1 -- 172.21.15.31:0/1232022228 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97480a5e90 con 0x7f97580b5f30 2023-11-27T17:53:45.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 -- 172.21.15.31:0/1232022228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97580b5f30 msgr2=0x7f9758147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 --2- 172.21.15.31:0/1232022228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97580b5f30 0x7f9758147c40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f97580b3ee0 tx=0x7f974801c8e0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 -- 172.21.15.31:0/1232022228 shutdown_connections 2023-11-27T17:53:45.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 --2- 172.21.15.31:0/1232022228 >> v2:172.21.15.81:3300/0 conn(0x7f97580b6310 0x7f97580b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 --2- 172.21.15.31:0/1232022228 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97580b5f30 0x7f9758147c40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 -- 172.21.15.31:0/1232022228 >> 172.21.15.31:0/1232022228 conn(0x7f975806ab60 msgr2=0x7f97580bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:45.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 -- 172.21.15.31:0/1232022228 shutdown_connections 2023-11-27T17:53:45.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 -- 172.21.15.31:0/1232022228 wait complete. 2023-11-27T17:53:45.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 Processor -- start 2023-11-27T17:53:45.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 -- start start 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97580b3900 0x7f97580b7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97580b5f30 0x7f975814ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97580b6310 0x7f975814b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97580b7bd0 con 0x7f97580b3900 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975814a470 con 0x7f97580b5f30 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9758149b80 con 0x7f97580b6310 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975cae5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97580b3900 0x7f97580b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975cae5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97580b3900 0x7f97580b7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42628/0 (socket says 172.21.15.31:42628) 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975cae5640 1 -- 172.21.15.31:0/12349659 learned_addr learned my addr 172.21.15.31:0/12349659 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975d2e6640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97580b6310 0x7f975814b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f9757fff640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97580b5f30 0x7f975814ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975cae5640 1 -- 172.21.15.31:0/12349659 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97580b6310 msgr2=0x7f975814b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975cae5640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97580b6310 0x7f975814b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975cae5640 1 -- 172.21.15.31:0/12349659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97580b5f30 msgr2=0x7f975814ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975cae5640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97580b5f30 0x7f975814ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975cae5640 1 -- 172.21.15.31:0/12349659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748009a70 con 0x7f97580b3900 2023-11-27T17:53:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975cae5640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97580b3900 0x7f97580b7690 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f97480194f0 tx=0x7f9748019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f97557fa640 1 -- 172.21.15.31:0/12349659 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97480a59a0 con 0x7f97580b3900 2023-11-27T17:53:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f97557fa640 1 -- 172.21.15.31:0/12349659 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97480b9450 con 0x7f97580b3900 2023-11-27T17:53:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 -- 172.21.15.31:0/12349659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97580bb970 con 0x7f97580b3900 2023-11-27T17:53:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f97557fa640 1 -- 172.21.15.31:0/12349659 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97480b9800 con 0x7f97580b3900 2023-11-27T17:53:45.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.441+0000 7f975ed49640 1 -- 172.21.15.31:0/12349659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975814a100 con 0x7f97580b3900 2023-11-27T17:53:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.445+0000 7f975ed49640 1 -- 172.21.15.31:0/12349659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975804e850 con 0x7f97580b3900 2023-11-27T17:53:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.445+0000 7f97557fa640 1 -- 172.21.15.31:0/12349659 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f97480b9960 con 0x7f97580b3900 2023-11-27T17:53:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.445+0000 7f97557fa640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f97380667f0 0x7f9738068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.445+0000 7f97557fa640 1 -- 172.21.15.31:0/12349659 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f974811fc30 con 0x7f97580b3900 2023-11-27T17:53:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.445+0000 7f9757fff640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f97380667f0 0x7f9738068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.445+0000 7f9757fff640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f97380667f0 0x7f9738068cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f975813b970 tx=0x7f9740007b60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:45.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.449+0000 7f97557fa640 1 -- 172.21.15.31:0/12349659 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f97480ece80 con 0x7f97580b3900 2023-11-27T17:53:45.604 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.601+0000 7f975ed49640 1 -- 172.21.15.31:0/12349659 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97581450e0 con 0x7f97580b3900 2023-11-27T17:53:45.605 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.601+0000 7f97557fa640 1 -- 172.21.15.31:0/12349659 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97480f04a0 con 0x7f97580b3900 2023-11-27T17:53:45.605 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-11-27T17:53:45.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.601+0000 7f975ed49640 1 -- 172.21.15.31:0/12349659 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f97380667f0 msgr2=0x7f9738068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.601+0000 7f975ed49640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f97380667f0 0x7f9738068cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f975813b970 tx=0x7f9740007b60 comp rx=0 tx=0).stop 2023-11-27T17:53:45.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.601+0000 7f975ed49640 1 -- 172.21.15.31:0/12349659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97580b3900 msgr2=0x7f97580b7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.601+0000 7f975ed49640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97580b3900 0x7f97580b7690 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f97480194f0 tx=0x7f9748019680 comp rx=0 tx=0).stop 2023-11-27T17:53:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.601+0000 7f975ed49640 1 -- 172.21.15.31:0/12349659 shutdown_connections 2023-11-27T17:53:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.601+0000 7f975ed49640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f97380667f0 0x7f9738068cb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.601+0000 7f975ed49640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f97580b6310 0x7f975814b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.601+0000 7f975ed49640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97580b5f30 0x7f975814ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.601+0000 7f975ed49640 1 --2- 172.21.15.31:0/12349659 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f97580b3900 0x7f97580b7690 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.601+0000 7f975ed49640 1 -- 172.21.15.31:0/12349659 >> 172.21.15.31:0/12349659 conn(0x7f975806ab60 msgr2=0x7f97581461d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.605+0000 7f975ed49640 1 -- 172.21.15.31:0/12349659 shutdown_connections 2023-11-27T17:53:45.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.605+0000 7f975ed49640 1 -- 172.21.15.31:0/12349659 wait complete. 2023-11-27T17:53:45.623 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:53:45.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.733+0000 7f18d678b640 1 Processor -- start 2023-11-27T17:53:45.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.733+0000 7f18d678b640 1 -- start start 2023-11-27T17:53:45.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18d678b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f18d0143560 0x7f18d00bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18d678b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d0071260 con 0x7f18d0149c00 2023-11-27T17:53:45.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18d678b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d0143940 con 0x7f18d006f1d0 2023-11-27T17:53:45.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18d678b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d006f800 con 0x7f18d0143560 2023-11-27T17:53:45.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18d4d28640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f18d0149c00 0x7f18d0153a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44764/0 (socket says 172.21.15.31:44764) 2023-11-27T17:53:45.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18d4d28640 1 -- 172.21.15.31:0/846325566 learned_addr learned my addr 172.21.15.31:0/846325566 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:45.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18cffff640 1 --2- 172.21.15.31:0/846325566 >> v2:172.21.15.81:3300/0 conn(0x7f18d0143560 0x7f18d00bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780028564 0 0) 0x7f18d0071260 con 0x7f18d0149c00 2023-11-27T17:53:45.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18b0003530 con 0x7f18d0149c00 2023-11-27T17:53:45.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2510111275 0 0) 0x7f18b0003530 con 0x7f18d0149c00 2023-11-27T17:53:45.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 >> v2:172.21.15.81:3300/0 conn(0x7f18d0143560 msgr2=0x7f18d00bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:45.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 --2- 172.21.15.31:0/846325566 >> v2:172.21.15.81:3300/0 conn(0x7f18d0143560 0x7f18d00bd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 >> v1:172.21.15.81:6789/0 conn(0x7f18d006f1d0 legacy=0x7f18d01494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d006fae0 con 0x7f18d0149c00 2023-11-27T17:53:45.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f18b8001680 con 0x7f18d0149c00 2023-11-27T17:53:45.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 >> v1:172.21.15.31:6789/0 conn(0x7f18d0149c00 legacy=0x7f18d0153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 --2- 172.21.15.31:0/846325566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18b00039f0 0x7f18b0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 --2- 172.21.15.31:0/846325566 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18b00047d0 0x7f18b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 --2- 172.21.15.31:0/846325566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b0005190 0x7f18b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d006f800 con 0x7f18b00039f0 2023-11-27T17:53:45.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b000c0c0 con 0x7f18b0005190 2023-11-27T17:53:45.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b000c280 con 0x7f18b00047d0 2023-11-27T17:53:45.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18cffff640 1 --2- 172.21.15.31:0/846325566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18b00039f0 0x7f18b0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18cf7fe640 1 --2- 172.21.15.31:0/846325566 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18b00047d0 0x7f18b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18cffff640 1 -- 172.21.15.31:0/846325566 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18b00047d0 msgr2=0x7f18b0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:45.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18cffff640 1 --2- 172.21.15.31:0/846325566 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18b00047d0 0x7f18b0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18cffff640 1 -- 172.21.15.31:0/846325566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b0005190 msgr2=0x7f18b000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:45.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18cffff640 1 --2- 172.21.15.31:0/846325566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b0005190 0x7f18b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18cffff640 1 -- 172.21.15.31:0/846325566 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b0003530 con 0x7f18b00039f0 2023-11-27T17:53:45.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18d4d28640 1 -- 172.21.15.31:0/846325566 reap_dead start 2023-11-27T17:53:45.744 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18cf7fe640 1 --2- 172.21.15.31:0/846325566 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18b00047d0 0x7f18b0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:45.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18cffff640 1 --2- 172.21.15.31:0/846325566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18b00039f0 0x7f18b0003e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009ae0 tx=0x7f18c001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e22afe3b60946f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:45.747 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c00a5570 con 0x7f18b00039f0 2023-11-27T17:53:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c00a56d0 con 0x7f18b00039f0 2023-11-27T17:53:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.737+0000 7f18ceffd640 1 -- 172.21.15.31:0/846325566 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c00a5a80 con 0x7f18b00039f0 2023-11-27T17:53:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 -- 172.21.15.31:0/846325566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18b00039f0 msgr2=0x7f18b0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 --2- 172.21.15.31:0/846325566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18b00039f0 0x7f18b0003e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009ae0 tx=0x7f18c001ca40 comp rx=0 tx=0).stop 2023-11-27T17:53:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 -- 172.21.15.31:0/846325566 shutdown_connections 2023-11-27T17:53:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 --2- 172.21.15.31:0/846325566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18b00039f0 0x7f18b0003e10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 -- 172.21.15.31:0/846325566 >> 172.21.15.31:0/846325566 conn(0x7f18d006ab60 msgr2=0x7f18d00bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 -- 172.21.15.31:0/846325566 shutdown_connections 2023-11-27T17:53:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 -- 172.21.15.31:0/846325566 wait complete. 2023-11-27T17:53:45.748 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 Processor -- start 2023-11-27T17:53:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 -- start start 2023-11-27T17:53:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b00039f0 0x7f18d014bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18d01d9b20 0x7f18d01e3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d01e4520 0x7f18d0139d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d0141280 con 0x7f18d01d9b20 2023-11-27T17:53:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d01e7eb0 con 0x7f18b00039f0 2023-11-27T17:53:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d01e8340 con 0x7f18d01e4520 2023-11-27T17:53:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18cf7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18d01d9b20 0x7f18d01e3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18cf7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18d01d9b20 0x7f18d01e3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42648/0 (socket says 172.21.15.31:42648) 2023-11-27T17:53:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18cf7fe640 1 -- 172.21.15.31:0/957116123 learned_addr learned my addr 172.21.15.31:0/957116123 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:45.749 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18cffff640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b00039f0 0x7f18d014bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d4d28640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d01e4520 0x7f18d0139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18cf7fe640 1 -- 172.21.15.31:0/957116123 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d01e4520 msgr2=0x7f18d0139d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18cf7fe640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d01e4520 0x7f18d0139d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18cf7fe640 1 -- 172.21.15.31:0/957116123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b00039f0 msgr2=0x7f18d014bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18cf7fe640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b00039f0 0x7f18d014bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18cf7fe640 1 -- 172.21.15.31:0/957116123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d01e7580 con 0x7f18d01d9b20 2023-11-27T17:53:45.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18cf7fe640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18d01d9b20 0x7f18d01e3fe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f18c800d810 tx=0x7f18c800dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:45.750 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18ccff9640 1 -- 172.21.15.31:0/957116123 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8003db0 con 0x7f18d01d9b20 2023-11-27T17:53:45.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18ccff9640 1 -- 172.21.15.31:0/957116123 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c800b6b0 con 0x7f18d01d9b20 2023-11-27T17:53:45.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 -- 172.21.15.31:0/957116123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d01e7860 con 0x7f18d01d9b20 2023-11-27T17:53:45.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18ccff9640 1 -- 172.21.15.31:0/957116123 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800ba80 con 0x7f18d01d9b20 2023-11-27T17:53:45.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.741+0000 7f18d678b640 1 -- 172.21.15.31:0/957116123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d0141480 con 0x7f18d01d9b20 2023-11-27T17:53:45.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.745+0000 7f18d678b640 1 -- 172.21.15.31:0/957116123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d004e850 con 0x7f18d01d9b20 2023-11-27T17:53:45.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.745+0000 7f18ccff9640 1 -- 172.21.15.31:0/957116123 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f18c800bbe0 con 0x7f18d01d9b20 2023-11-27T17:53:45.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.745+0000 7f18ccff9640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f18b40667f0 0x7f18b4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:45.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.745+0000 7f18ccff9640 1 -- 172.21.15.31:0/957116123 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18c8084430 con 0x7f18d01d9b20 2023-11-27T17:53:45.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.745+0000 7f18cffff640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f18b40667f0 0x7f18b4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:45.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.745+0000 7f18cffff640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f18b40667f0 0x7f18b4068cb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18c00af000 tx=0x7f18c00046d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:45.752 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.749+0000 7f18ccff9640 1 -- 172.21.15.31:0/957116123 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f18c80515c0 con 0x7f18d01d9b20 2023-11-27T17:53:45.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.901+0000 7f18d678b640 1 -- 172.21.15.31:0/957116123 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18d00b6e00 con 0x7f18d01d9b20 2023-11-27T17:53:45.907 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18ccff9640 1 -- 172.21.15.31:0/957116123 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18c8054be0 con 0x7f18d01d9b20 2023-11-27T17:53:45.908 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-11-27T17:53:45.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18d678b640 1 -- 172.21.15.31:0/957116123 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f18b40667f0 msgr2=0x7f18b4068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18d678b640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f18b40667f0 0x7f18b4068cb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f18c00af000 tx=0x7f18c00046d0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18d678b640 1 -- 172.21.15.31:0/957116123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18d01d9b20 msgr2=0x7f18d01e3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:45.910 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18d678b640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18d01d9b20 0x7f18d01e3fe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f18c800d810 tx=0x7f18c800dcd0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18d678b640 1 -- 172.21.15.31:0/957116123 shutdown_connections 2023-11-27T17:53:45.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18d678b640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f18b40667f0 0x7f18b4068cb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18d678b640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f18d01e4520 0x7f18d0139d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18d678b640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18d01d9b20 0x7f18d01e3fe0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18d678b640 1 --2- 172.21.15.31:0/957116123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18b00039f0 0x7f18d014bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:45.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18d678b640 1 -- 172.21.15.31:0/957116123 >> 172.21.15.31:0/957116123 conn(0x7f18d006ab60 msgr2=0x7f18d0072270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:45.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18d678b640 1 -- 172.21.15.31:0/957116123 shutdown_connections 2023-11-27T17:53:45.911 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:45.905+0000 7f18d678b640 1 -- 172.21.15.31:0/957116123 wait complete. 2023-11-27T17:53:45.927 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:46.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d9f1d640 1 Processor -- start 2023-11-27T17:53:46.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d9f1d640 1 -- start start 2023-11-27T17:53:46.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d9f1d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa3d40b46a0 0x7fa3d4153970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d9f1d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d4148930 con 0x7fa3d40b30b0 2023-11-27T17:53:46.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d9f1d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d40b3490 con 0x7fa3d40b3a60 2023-11-27T17:53:46.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d9f1d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d40b52c0 con 0x7fa3d40b46a0 2023-11-27T17:53:46.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d37fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa3d40b30b0 0x7fa3d414b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44772/0 (socket says 172.21.15.31:44772) 2023-11-27T17:53:46.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d37fe640 1 -- 172.21.15.31:0/1305065957 learned_addr learned my addr 172.21.15.31:0/1305065957 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:46.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d3fff640 1 --2- 172.21.15.31:0/1305065957 >> v2:172.21.15.31:3300/0 conn(0x7fa3d40b46a0 0x7fa3d4153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d2ffd640 1 -- 172.21.15.31:0/1305065957 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961374005 0 0) 0x7fa3d4148930 con 0x7fa3d40b30b0 2023-11-27T17:53:46.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d2ffd640 1 -- 172.21.15.31:0/1305065957 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c0003530 con 0x7fa3d40b30b0 2023-11-27T17:53:46.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d3fff640 1 -- 172.21.15.31:0/1305065957 >> v1:172.21.15.81:6789/0 conn(0x7fa3d40b3a60 legacy=0x7fa3d40bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:46.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d3fff640 1 -- 172.21.15.31:0/1305065957 >> v1:172.21.15.31:6789/0 conn(0x7fa3d40b30b0 legacy=0x7fa3d414b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.056 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.049+0000 7fa3d3fff640 1 -- 172.21.15.31:0/1305065957 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d40bd950 con 0x7fa3d40b46a0 2023-11-27T17:53:46.061 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d3fff640 1 --2- 172.21.15.31:0/1305065957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3d40b46a0 0x7fa3d4153970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009d90 tx=0x7fa3cc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d858aa83e98dfb server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:46.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d2ffd640 1 -- 172.21.15.31:0/1305065957 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0a5810 con 0x7fa3d40b46a0 2023-11-27T17:53:46.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d2ffd640 1 -- 172.21.15.31:0/1305065957 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc0a5970 con 0x7fa3d40b46a0 2023-11-27T17:53:46.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d2ffd640 1 -- 172.21.15.31:0/1305065957 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0a5d00 con 0x7fa3d40b46a0 2023-11-27T17:53:46.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/1305065957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3d40b46a0 msgr2=0x7fa3d4153970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 --2- 172.21.15.31:0/1305065957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3d40b46a0 0x7fa3d4153970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009d90 tx=0x7fa3cc01c950 comp rx=0 tx=0).stop 2023-11-27T17:53:46.062 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/1305065957 shutdown_connections 2023-11-27T17:53:46.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 --2- 172.21.15.31:0/1305065957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3d40b46a0 0x7fa3d4153970 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/1305065957 >> 172.21.15.31:0/1305065957 conn(0x7fa3d406ab60 msgr2=0x7fa3d40bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:46.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/1305065957 shutdown_connections 2023-11-27T17:53:46.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/1305065957 wait complete. 2023-11-27T17:53:46.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 Processor -- start 2023-11-27T17:53:46.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 -- start start 2023-11-27T17:53:46.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40b30b0 0x7fa3d41323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa3d40b3a60 0x7fa3d41333c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3d40b46a0 0x7fa3d41316a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d40b4ad0 con 0x7fa3d40b46a0 2023-11-27T17:53:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d413c800 con 0x7fa3d40b30b0 2023-11-27T17:53:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d9f1d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d4132ec0 con 0x7fa3d40b3a60 2023-11-27T17:53:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3d40b46a0 0x7fa3d41316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d3fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3d40b46a0 0x7fa3d41316a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42666/0 (socket says 172.21.15.31:42666) 2023-11-27T17:53:46.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d3fff640 1 -- 172.21.15.31:0/2462579144 learned_addr learned my addr 172.21.15.31:0/2462579144 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:46.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d37fe640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40b30b0 0x7fa3d41323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3caffd640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa3d40b3a60 0x7fa3d41333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d3fff640 1 -- 172.21.15.31:0/2462579144 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa3d40b3a60 msgr2=0x7fa3d41333c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d3fff640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa3d40b3a60 0x7fa3d41333c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d3fff640 1 -- 172.21.15.31:0/2462579144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40b30b0 msgr2=0x7fa3d41323d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d3fff640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40b30b0 0x7fa3d41323d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d3fff640 1 -- 172.21.15.31:0/2462579144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc009a70 con 0x7fa3d40b46a0 2023-11-27T17:53:46.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3caffd640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa3d40b3a60 0x7fa3d41333c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:46.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d37fe640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40b30b0 0x7fa3d41323d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:46.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.053+0000 7fa3d3fff640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3d40b46a0 0x7fa3d41316a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc0b0040 tx=0x7fa3cc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:46.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.057+0000 7fa3d0ff9640 1 -- 172.21.15.31:0/2462579144 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0b9860 con 0x7fa3d40b46a0 2023-11-27T17:53:46.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.057+0000 7fa3d0ff9640 1 -- 172.21.15.31:0/2462579144 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc0b99c0 con 0x7fa3d40b46a0 2023-11-27T17:53:46.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.057+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/2462579144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d4132910 con 0x7fa3d40b46a0 2023-11-27T17:53:46.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.057+0000 7fa3d0ff9640 1 -- 172.21.15.31:0/2462579144 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc0b9d70 con 0x7fa3d40b46a0 2023-11-27T17:53:46.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.057+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/2462579144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d413c5d0 con 0x7fa3d40b46a0 2023-11-27T17:53:46.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.057+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/2462579144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d404e850 con 0x7fa3d40b46a0 2023-11-27T17:53:46.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.057+0000 7fa3d0ff9640 1 -- 172.21.15.31:0/2462579144 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa3cc0ad440 con 0x7fa3d40b46a0 2023-11-27T17:53:46.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.057+0000 7fa3d0ff9640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa3b4066820 0x7fa3b4068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.057+0000 7fa3d0ff9640 1 -- 172.21.15.31:0/2462579144 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3cc11edb0 con 0x7fa3d40b46a0 2023-11-27T17:53:46.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.057+0000 7fa3d37fe640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa3b4066820 0x7fa3b4068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.057+0000 7fa3d37fe640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa3b4066820 0x7fa3b4068ce0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40011f0 tx=0x7fa3c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:46.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.061+0000 7fa3d0ff9640 1 -- 172.21.15.31:0/2462579144 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa3cc0ec060 con 0x7fa3d40b46a0 2023-11-27T17:53:46.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.217+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/2462579144 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3d40a2d90 con 0x7fa3d40b46a0 2023-11-27T17:53:46.222 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.217+0000 7fa3d0ff9640 1 -- 172.21.15.31:0/2462579144 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7fa3cc0ef680 con 0x7fa3d40b46a0 2023-11-27T17:53:46.222 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:46.222 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.221+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/2462579144 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa3b4066820 msgr2=0x7fa3b4068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.221+0000 7fa3d9f1d640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa3b4066820 0x7fa3b4068ce0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40011f0 tx=0x7fa3c4009040 comp rx=0 tx=0).stop 2023-11-27T17:53:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.221+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/2462579144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3d40b46a0 msgr2=0x7fa3d41316a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.221+0000 7fa3d9f1d640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3d40b46a0 0x7fa3d41316a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc0b0040 tx=0x7fa3cc0196f0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.221+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/2462579144 shutdown_connections 2023-11-27T17:53:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.221+0000 7fa3d9f1d640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa3b4066820 0x7fa3b4068ce0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.221+0000 7fa3d9f1d640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa3d40b46a0 0x7fa3d41316a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.221+0000 7fa3d9f1d640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa3d40b3a60 0x7fa3d41333c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.221+0000 7fa3d9f1d640 1 --2- 172.21.15.31:0/2462579144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40b30b0 0x7fa3d41323d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.221+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/2462579144 >> 172.21.15.31:0/2462579144 conn(0x7fa3d406ab60 msgr2=0x7fa3d4146010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.221+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/2462579144 shutdown_connections 2023-11-27T17:53:46.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.221+0000 7fa3d9f1d640 1 -- 172.21.15.31:0/2462579144 wait complete. 2023-11-27T17:53:46.240 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:53:11.177026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:53:21.543531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:53:22.362977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:53:46.240 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:53:46.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fc49b640 1 Processor -- start 2023-11-27T17:53:46.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fc49b640 1 -- start start 2023-11-27T17:53:46.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fc49b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f74f40b5f30 0x7f74f4147c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fc49b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f74f40b3900 0x7f74f40724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fc49b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74f4072a20 0x7f74f40b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fc49b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f41486d0 con 0x7f74f40b5f30 2023-11-27T17:53:46.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fc49b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f4148180 con 0x7f74f40b3900 2023-11-27T17:53:46.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fc49b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f40b6940 con 0x7f74f4072a20 2023-11-27T17:53:46.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fa237640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f74f40b5f30 0x7f74f4147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fa237640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f74f40b5f30 0x7f74f4147c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42676/0 (socket says 172.21.15.31:42676) 2023-11-27T17:53:46.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fa237640 1 -- 172.21.15.31:0/3947818844 learned_addr learned my addr 172.21.15.31:0/3947818844 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:46.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74faa38640 1 --2- 172.21.15.31:0/3947818844 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74f4072a20 0x7f74f40b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74f9a36640 1 --2- 172.21.15.31:0/3947818844 >> v2:172.21.15.81:3300/0 conn(0x7f74f40b3900 0x7f74f40724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fa237640 1 -- 172.21.15.31:0/3947818844 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74f4072a20 msgr2=0x7f74f40b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:46.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fa237640 1 --2- 172.21.15.31:0/3947818844 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74f4072a20 0x7f74f40b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fa237640 1 -- 172.21.15.31:0/3947818844 >> v2:172.21.15.81:3300/0 conn(0x7f74f40b3900 msgr2=0x7f74f40724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:46.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fa237640 1 --2- 172.21.15.31:0/3947818844 >> v2:172.21.15.81:3300/0 conn(0x7f74f40b3900 0x7f74f40724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74fa237640 1 -- 172.21.15.31:0/3947818844 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f41483f0 con 0x7f74f40b5f30 2023-11-27T17:53:46.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74faa38640 1 --2- 172.21.15.31:0/3947818844 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74f4072a20 0x7f74f40b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:46.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.361+0000 7f74f9a36640 1 --2- 172.21.15.31:0/3947818844 >> v2:172.21.15.81:3300/0 conn(0x7f74f40b3900 0x7f74f40724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:46.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fa237640 1 --2- 172.21.15.31:0/3947818844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f40b5f30 0x7f74f4147c40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74f40b71f0 tx=0x7f74f001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e14aae3e5c99a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:46.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74f9235640 1 -- 172.21.15.31:0/3947818844 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f00aa5f0 con 0x7f74f40b5f30 2023-11-27T17:53:46.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74f9235640 1 -- 172.21.15.31:0/3947818844 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f00aa750 con 0x7f74f40b5f30 2023-11-27T17:53:46.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74f9235640 1 -- 172.21.15.31:0/3947818844 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f00aaae0 con 0x7f74f40b5f30 2023-11-27T17:53:46.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 -- 172.21.15.31:0/3947818844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f40b5f30 msgr2=0x7f74f4147c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 --2- 172.21.15.31:0/3947818844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f40b5f30 0x7f74f4147c40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74f40b71f0 tx=0x7f74f001c4d0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 -- 172.21.15.31:0/3947818844 shutdown_connections 2023-11-27T17:53:46.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 --2- 172.21.15.31:0/3947818844 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74f4072a20 0x7f74f40b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 --2- 172.21.15.31:0/3947818844 >> v2:172.21.15.81:3300/0 conn(0x7f74f40b3900 0x7f74f40724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 --2- 172.21.15.31:0/3947818844 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f40b5f30 0x7f74f4147c40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 -- 172.21.15.31:0/3947818844 >> 172.21.15.31:0/3947818844 conn(0x7f74f406ab60 msgr2=0x7f74f40bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:46.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 -- 172.21.15.31:0/3947818844 shutdown_connections 2023-11-27T17:53:46.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 -- 172.21.15.31:0/3947818844 wait complete. 2023-11-27T17:53:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 Processor -- start 2023-11-27T17:53:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 -- start start 2023-11-27T17:53:46.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f40b3900 0x7f74f4146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74f40b5f30 0x7f74f413f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f413f710 0x7f74f4139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f4144d80 con 0x7f74f413f710 2023-11-27T17:53:46.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f413e430 con 0x7f74f40b3900 2023-11-27T17:53:46.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f413e6d0 con 0x7f74f40b5f30 2023-11-27T17:53:46.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74faa38640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f413f710 0x7f74f4139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74faa38640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f413f710 0x7f74f4139db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42692/0 (socket says 172.21.15.31:42692) 2023-11-27T17:53:46.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74faa38640 1 -- 172.21.15.31:0/2789594927 learned_addr learned my addr 172.21.15.31:0/2789594927 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:46.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74f9a36640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74f40b5f30 0x7f74f413f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fa237640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f40b3900 0x7f74f4146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74faa38640 1 -- 172.21.15.31:0/2789594927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74f40b5f30 msgr2=0x7f74f413f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74faa38640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74f40b5f30 0x7f74f413f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74faa38640 1 -- 172.21.15.31:0/2789594927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f40b3900 msgr2=0x7f74f4146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74faa38640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f40b3900 0x7f74f4146c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74faa38640 1 -- 172.21.15.31:0/2789594927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f00094d0 con 0x7f74f413f710 2023-11-27T17:53:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74faa38640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f413f710 0x7f74f4139db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00ce80 tx=0x7f74ec00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74eaffd640 1 -- 172.21.15.31:0/2789594927 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00d840 con 0x7f74f413f710 2023-11-27T17:53:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74eaffd640 1 -- 172.21.15.31:0/2789594927 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec00d9e0 con 0x7f74f413f710 2023-11-27T17:53:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 -- 172.21.15.31:0/2789594927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f413e9b0 con 0x7f74f413f710 2023-11-27T17:53:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74eaffd640 1 -- 172.21.15.31:0/2789594927 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00dd90 con 0x7f74f413f710 2023-11-27T17:53:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.365+0000 7f74fc49b640 1 -- 172.21.15.31:0/2789594927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f4140980 con 0x7f74f413f710 2023-11-27T17:53:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.369+0000 7f74fc49b640 1 -- 172.21.15.31:0/2789594927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f413eef0 con 0x7f74f413f710 2023-11-27T17:53:46.382 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.369+0000 7f74eaffd640 1 -- 172.21.15.31:0/2789594927 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f74ec015440 con 0x7f74f413f710 2023-11-27T17:53:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.369+0000 7f74eaffd640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f74d80667f0 0x7f74d8068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.369+0000 7f74eaffd640 1 -- 172.21.15.31:0/2789594927 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74ec084bc0 con 0x7f74f413f710 2023-11-27T17:53:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.369+0000 7f74fa237640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f74d80667f0 0x7f74d8068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.369+0000 7f74fa237640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f74d80667f0 0x7f74d8068cb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f74f00ae000 tx=0x7f74f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:46.383 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.373+0000 7f74eaffd640 1 -- 172.21.15.31:0/2789594927 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f74f413eef0 con 0x7f74f413f710 2023-11-27T17:53:46.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 -- 172.21.15.31:0/2789594927 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74f413eef0 con 0x7f74f413f710 2023-11-27T17:53:46.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74eaffd640 1 -- 172.21.15.31:0/2789594927 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74f413eef0 con 0x7f74f413f710 2023-11-27T17:53:46.528 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-11-27T17:53:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 -- 172.21.15.31:0/2789594927 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f74d80667f0 msgr2=0x7f74d8068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f74d80667f0 0x7f74d8068cb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f74f00ae000 tx=0x7f74f0008040 comp rx=0 tx=0).stop 2023-11-27T17:53:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 -- 172.21.15.31:0/2789594927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f413f710 msgr2=0x7f74f4139db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f413f710 0x7f74f4139db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00ce80 tx=0x7f74ec00a710 comp rx=0 tx=0).stop 2023-11-27T17:53:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 -- 172.21.15.31:0/2789594927 shutdown_connections 2023-11-27T17:53:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f74d80667f0 0x7f74d8068cb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f74f413f710 0x7f74f4139db0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f74f40b5f30 0x7f74f413f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 --2- 172.21.15.31:0/2789594927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f74f40b3900 0x7f74f4146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 -- 172.21.15.31:0/2789594927 >> 172.21.15.31:0/2789594927 conn(0x7f74f406ab60 msgr2=0x7f74f406fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:46.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 -- 172.21.15.31:0/2789594927 shutdown_connections 2023-11-27T17:53:46.532 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.525+0000 7f74fc49b640 1 -- 172.21.15.31:0/2789594927 wait complete. 2023-11-27T17:53:46.546 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:53:46.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f879d974640 1 Processor -- start 2023-11-27T17:53:46.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f879d974640 1 -- start start 2023-11-27T17:53:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f879d974640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87981425e0 0x7f87980bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f879d974640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8798148c80 0x7f87981529c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f879d974640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87980b6840 con 0x7f87980b5d90 2023-11-27T17:53:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f879d974640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87981429c0 con 0x7f87981425e0 2023-11-27T17:53:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f879d974640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87980b6b20 con 0x7f8798148c80 2023-11-27T17:53:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f8796ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87981425e0 0x7f87980bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f8796ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87981425e0 0x7f87980bd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42704/0 (socket says 172.21.15.31:42704) 2023-11-27T17:53:46.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f8796ffd640 1 -- 172.21.15.31:0/2352445306 learned_addr learned my addr 172.21.15.31:0/2352445306 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:46.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f87977fe640 1 --2- 172.21.15.31:0/2352445306 >> v2:172.21.15.81:3300/0 conn(0x7f8798148c80 0x7f87981529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f8796ffd640 1 -- 172.21.15.31:0/2352445306 >> v2:172.21.15.81:3300/0 conn(0x7f8798148c80 msgr2=0x7f87981529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:46.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f8796ffd640 1 --2- 172.21.15.31:0/2352445306 >> v2:172.21.15.81:3300/0 conn(0x7f8798148c80 0x7f87981529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f8796ffd640 1 -- 172.21.15.31:0/2352445306 >> v1:172.21.15.81:6789/0 conn(0x7f87980b5d90 legacy=0x7f8798148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:46.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f8796ffd640 1 -- 172.21.15.31:0/2352445306 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87980b6e00 con 0x7f87981425e0 2023-11-27T17:53:46.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f8796ffd640 1 --2- 172.21.15.31:0/2352445306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87981425e0 0x7f87980bd240 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f87980b94c0 tx=0x7f8788021380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d40c99b9be787f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:46.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.669+0000 7f8795ffb640 1 -- 172.21.15.31:0/2352445306 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880b1600 con 0x7f87981425e0 2023-11-27T17:53:46.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f8795ffb640 1 -- 172.21.15.31:0/2352445306 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87880ad050 con 0x7f87981425e0 2023-11-27T17:53:46.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f8795ffb640 1 -- 172.21.15.31:0/2352445306 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880b1980 con 0x7f87981425e0 2023-11-27T17:53:46.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 -- 172.21.15.31:0/2352445306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87981425e0 msgr2=0x7f87980bd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 --2- 172.21.15.31:0/2352445306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87981425e0 0x7f87980bd240 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f87980b94c0 tx=0x7f8788021380 comp rx=0 tx=0).stop 2023-11-27T17:53:46.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 -- 172.21.15.31:0/2352445306 shutdown_connections 2023-11-27T17:53:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 --2- 172.21.15.31:0/2352445306 >> v2:172.21.15.81:3300/0 conn(0x7f8798148c80 0x7f87981529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 --2- 172.21.15.31:0/2352445306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87981425e0 0x7f87980bd240 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 -- 172.21.15.31:0/2352445306 >> 172.21.15.31:0/2352445306 conn(0x7f879806ab60 msgr2=0x7f87980bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 -- 172.21.15.31:0/2352445306 shutdown_connections 2023-11-27T17:53:46.677 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 -- 172.21.15.31:0/2352445306 wait complete. 2023-11-27T17:53:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 Processor -- start 2023-11-27T17:53:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 -- start start 2023-11-27T17:53:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87980b5d90 0x7f8798149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87981425e0 0x7f879814b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8798148c80 0x7f8798071780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.679 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87981dced0 con 0x7f87981425e0 2023-11-27T17:53:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879814b9e0 con 0x7f87980b5d90 2023-11-27T17:53:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8798149b60 con 0x7f8798148c80 2023-11-27T17:53:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f87967fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87981425e0 0x7f879814b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f87967fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87981425e0 0x7f879814b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42712/0 (socket says 172.21.15.31:42712) 2023-11-27T17:53:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f87967fc640 1 -- 172.21.15.31:0/2105404700 learned_addr learned my addr 172.21.15.31:0/2105404700 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f87977fe640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8798148c80 0x7f8798071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f8796ffd640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87980b5d90 0x7f8798149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f87967fc640 1 -- 172.21.15.31:0/2105404700 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8798148c80 msgr2=0x7f8798071780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f87967fc640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8798148c80 0x7f8798071780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f87967fc640 1 -- 172.21.15.31:0/2105404700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87980b5d90 msgr2=0x7f8798149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f87967fc640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87980b5d90 0x7f8798149620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f87967fc640 1 -- 172.21.15.31:0/2105404700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878800b770 con 0x7f87981425e0 2023-11-27T17:53:46.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f87967fc640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87981425e0 0x7f879814b100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c450 tx=0x7f878c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:46.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f877ffff640 1 -- 172.21.15.31:0/2105404700 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c012830 con 0x7f87981425e0 2023-11-27T17:53:46.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f877ffff640 1 -- 172.21.15.31:0/2105404700 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c0129b0 con 0x7f87981425e0 2023-11-27T17:53:46.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 -- 172.21.15.31:0/2105404700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87981dc880 con 0x7f87981425e0 2023-11-27T17:53:46.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f877ffff640 1 -- 172.21.15.31:0/2105404700 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c012d60 con 0x7f87981425e0 2023-11-27T17:53:46.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.673+0000 7f879d974640 1 -- 172.21.15.31:0/2105404700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879813ab10 con 0x7f87981425e0 2023-11-27T17:53:46.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.677+0000 7f879d974640 1 -- 172.21.15.31:0/2105404700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87981dd080 con 0x7f87981425e0 2023-11-27T17:53:46.682 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.677+0000 7f877ffff640 1 -- 172.21.15.31:0/2105404700 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f878c01c460 con 0x7f87981425e0 2023-11-27T17:53:46.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.677+0000 7f877ffff640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f87840667f0 0x7f8784068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.677+0000 7f877ffff640 1 -- 172.21.15.31:0/2105404700 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f878c083fe0 con 0x7f87981425e0 2023-11-27T17:53:46.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.677+0000 7f8796ffd640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f87840667f0 0x7f8784068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.677+0000 7f8796ffd640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f87840667f0 0x7f8784068cb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f87880b3000 tx=0x7f87880ac000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:46.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.681+0000 7f877ffff640 1 -- 172.21.15.31:0/2105404700 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f87981dd080 con 0x7f87981425e0 2023-11-27T17:53:46.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 -- 172.21.15.31:0/2105404700 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f879804e850 con 0x7f87981425e0 2023-11-27T17:53:46.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f877ffff640 1 -- 172.21.15.31:0/2105404700 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f878c051170 con 0x7f87981425e0 2023-11-27T17:53:46.836 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-11-27T17:53:46.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 -- 172.21.15.31:0/2105404700 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f87840667f0 msgr2=0x7f8784068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f87840667f0 0x7f8784068cb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f87880b3000 tx=0x7f87880ac000 comp rx=0 tx=0).stop 2023-11-27T17:53:46.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 -- 172.21.15.31:0/2105404700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87981425e0 msgr2=0x7f879814b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87981425e0 0x7f879814b100 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c450 tx=0x7f878c00c910 comp rx=0 tx=0).stop 2023-11-27T17:53:46.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 -- 172.21.15.31:0/2105404700 shutdown_connections 2023-11-27T17:53:46.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f87840667f0 0x7f8784068cb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8798148c80 0x7f8798071780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87981425e0 0x7f879814b100 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 --2- 172.21.15.31:0/2105404700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87980b5d90 0x7f8798149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 -- 172.21.15.31:0/2105404700 >> 172.21.15.31:0/2105404700 conn(0x7f879806ab60 msgr2=0x7f8798141040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:46.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 -- 172.21.15.31:0/2105404700 shutdown_connections 2023-11-27T17:53:46.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.833+0000 7f879d974640 1 -- 172.21.15.31:0/2105404700 wait complete. 2023-11-27T17:53:46.854 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:53:46.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23e67b6640 1 Processor -- start 2023-11-27T17:53:46.968 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23e67b6640 1 -- start start 2023-11-27T17:53:46.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23e67b6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f23e01425e0 0x7f23e00bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23e67b6640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23e00b5d90 0x7f23e0148570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23e67b6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23e00b61d0 0x7f23e0148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23e67b6640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e01429c0 con 0x7f23e00b5d90 2023-11-27T17:53:46.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23e67b6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e00b6840 con 0x7f23e01425e0 2023-11-27T17:53:46.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23e67b6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e00b6b20 con 0x7f23e00b61d0 2023-11-27T17:53:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23df7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23e00b5d90 0x7f23e0148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23df7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f23e00b5d90 0x7f23e0148570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42720/0 (socket says 172.21.15.31:42720) 2023-11-27T17:53:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23df7fe640 1 -- 172.21.15.31:0/2607798920 learned_addr learned my addr 172.21.15.31:0/2607798920 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23e4d53640 1 --2- 172.21.15.31:0/2607798920 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23e00b61d0 0x7f23e0148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23dffff640 1 --2- 172.21.15.31:0/2607798920 >> v2:172.21.15.81:3300/0 conn(0x7f23e01425e0 0x7f23e00bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23df7fe640 1 -- 172.21.15.31:0/2607798920 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23e00b61d0 msgr2=0x7f23e0148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23df7fe640 1 --2- 172.21.15.31:0/2607798920 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23e00b61d0 0x7f23e0148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23df7fe640 1 -- 172.21.15.31:0/2607798920 >> v2:172.21.15.81:3300/0 conn(0x7f23e01425e0 msgr2=0x7f23e00bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23df7fe640 1 --2- 172.21.15.31:0/2607798920 >> v2:172.21.15.81:3300/0 conn(0x7f23e01425e0 0x7f23e00bd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23df7fe640 1 -- 172.21.15.31:0/2607798920 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e00b6e00 con 0x7f23e00b5d90 2023-11-27T17:53:46.970 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23e4d53640 1 --2- 172.21.15.31:0/2607798920 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23e00b61d0 0x7f23e0148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:46.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23df7fe640 1 --2- 172.21.15.31:0/2607798920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b5d90 0x7f23e0148570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f23e00bdb80 tx=0x7f23d401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de423d0e248baea server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:46.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23deffd640 1 -- 172.21.15.31:0/2607798920 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d40aa640 con 0x7f23e00b5d90 2023-11-27T17:53:46.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23deffd640 1 -- 172.21.15.31:0/2607798920 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d40aa7a0 con 0x7f23e00b5d90 2023-11-27T17:53:46.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.965+0000 7f23deffd640 1 -- 172.21.15.31:0/2607798920 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d40aab30 con 0x7f23e00b5d90 2023-11-27T17:53:46.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 -- 172.21.15.31:0/2607798920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b5d90 msgr2=0x7f23e0148570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 --2- 172.21.15.31:0/2607798920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b5d90 0x7f23e0148570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f23e00bdb80 tx=0x7f23d401c500 comp rx=0 tx=0).stop 2023-11-27T17:53:46.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 -- 172.21.15.31:0/2607798920 shutdown_connections 2023-11-27T17:53:46.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 --2- 172.21.15.31:0/2607798920 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23e00b61d0 0x7f23e0148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 --2- 172.21.15.31:0/2607798920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b5d90 0x7f23e0148570 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 --2- 172.21.15.31:0/2607798920 >> v2:172.21.15.81:3300/0 conn(0x7f23e01425e0 0x7f23e00bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.972 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 -- 172.21.15.31:0/2607798920 >> 172.21.15.31:0/2607798920 conn(0x7f23e006ab60 msgr2=0x7f23e00bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:46.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 -- 172.21.15.31:0/2607798920 shutdown_connections 2023-11-27T17:53:46.973 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 -- 172.21.15.31:0/2607798920 wait complete. 2023-11-27T17:53:46.974 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 Processor -- start 2023-11-27T17:53:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 -- start start 2023-11-27T17:53:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23e00b5d90 0x7f23e00b7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b61d0 0x7f23e0134d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e01425e0 0x7f23e014a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e01e3ce0 con 0x7f23e00b61d0 2023-11-27T17:53:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0067580 con 0x7f23e01425e0 2023-11-27T17:53:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e01e4520 con 0x7f23e00b5d90 2023-11-27T17:53:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23df7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b61d0 0x7f23e0134d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23df7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b61d0 0x7f23e0134d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42732/0 (socket says 172.21.15.31:42732) 2023-11-27T17:53:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23df7fe640 1 -- 172.21.15.31:0/1787522115 learned_addr learned my addr 172.21.15.31:0/1787522115 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:46.975 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e4d53640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e01425e0 0x7f23e014a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23dffff640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23e00b5d90 0x7f23e00b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23df7fe640 1 -- 172.21.15.31:0/1787522115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23e00b5d90 msgr2=0x7f23e00b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23df7fe640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23e00b5d90 0x7f23e00b7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23df7fe640 1 -- 172.21.15.31:0/1787522115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e01425e0 msgr2=0x7f23e014a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23df7fe640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e01425e0 0x7f23e014a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23df7fe640 1 -- 172.21.15.31:0/1787522115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d40094d0 con 0x7f23e00b61d0 2023-11-27T17:53:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23dffff640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23e00b5d90 0x7f23e00b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23df7fe640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b61d0 0x7f23e0134d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f23d401abb0 tx=0x7f23d401ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23dcff9640 1 -- 172.21.15.31:0/1787522115 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d40bd5f0 con 0x7f23e00b61d0 2023-11-27T17:53:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23dcff9640 1 -- 172.21.15.31:0/1787522115 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d40bd770 con 0x7f23e00b61d0 2023-11-27T17:53:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 -- 172.21.15.31:0/1787522115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e00bd360 con 0x7f23e00b61d0 2023-11-27T17:53:46.976 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23dcff9640 1 -- 172.21.15.31:0/1787522115 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d40bdb20 con 0x7f23e00b61d0 2023-11-27T17:53:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 -- 172.21.15.31:0/1787522115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e01e41b0 con 0x7f23e00b61d0 2023-11-27T17:53:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.969+0000 7f23e67b6640 1 -- 172.21.15.31:0/1787522115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e0073db0 con 0x7f23e00b61d0 2023-11-27T17:53:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.973+0000 7f23dcff9640 1 -- 172.21.15.31:0/1787522115 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f23d40a8050 con 0x7f23e00b61d0 2023-11-27T17:53:46.977 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.973+0000 7f23dcff9640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f23cc0667f0 0x7f23cc068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:46.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.973+0000 7f23dcff9640 1 -- 172.21.15.31:0/1787522115 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23d411ea40 con 0x7f23e00b61d0 2023-11-27T17:53:46.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.973+0000 7f23dffff640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f23cc0667f0 0x7f23cc068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:46.978 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.973+0000 7f23dffff640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f23cc0667f0 0x7f23cc068cb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23d0006fd0 tx=0x7f23d0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:46.980 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:46.977+0000 7f23dcff9640 1 -- 172.21.15.31:0/1787522115 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f23e0073db0 con 0x7f23e00b61d0 2023-11-27T17:53:46.991 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:53:46.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:53:46.995 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:53:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.129+0000 7f23e67b6640 1 -- 172.21.15.31:0/1787522115 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23e00bd990 con 0x7f23e00b61d0 2023-11-27T17:53:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.129+0000 7f23dcff9640 1 -- 172.21.15.31:0/1787522115 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f23e00bd990 con 0x7f23e00b61d0 2023-11-27T17:53:47.135 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-11-27T17:53:47.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.133+0000 7f23e67b6640 1 -- 172.21.15.31:0/1787522115 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f23cc0667f0 msgr2=0x7f23cc068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.133+0000 7f23e67b6640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f23cc0667f0 0x7f23cc068cb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f23d0006fd0 tx=0x7f23d0008040 comp rx=0 tx=0).stop 2023-11-27T17:53:47.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.133+0000 7f23e67b6640 1 -- 172.21.15.31:0/1787522115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b61d0 msgr2=0x7f23e0134d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.133+0000 7f23e67b6640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b61d0 0x7f23e0134d40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f23d401abb0 tx=0x7f23d401ad40 comp rx=0 tx=0).stop 2023-11-27T17:53:47.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.133+0000 7f23e67b6640 1 -- 172.21.15.31:0/1787522115 shutdown_connections 2023-11-27T17:53:47.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.133+0000 7f23e67b6640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f23cc0667f0 0x7f23cc068cb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.133+0000 7f23e67b6640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e01425e0 0x7f23e014a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.133+0000 7f23e67b6640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23e00b61d0 0x7f23e0134d40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.133+0000 7f23e67b6640 1 --2- 172.21.15.31:0/1787522115 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f23e00b5d90 0x7f23e00b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.133+0000 7f23e67b6640 1 -- 172.21.15.31:0/1787522115 >> 172.21.15.31:0/1787522115 conn(0x7f23e006ab60 msgr2=0x7f23e0147130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:47.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.133+0000 7f23e67b6640 1 -- 172.21.15.31:0/1787522115 shutdown_connections 2023-11-27T17:53:47.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.133+0000 7f23e67b6640 1 -- 172.21.15.31:0/1787522115 wait complete. 2023-11-27T17:53:47.152 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:47.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065f845640 1 Processor -- start 2023-11-27T17:53:47.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065f845640 1 -- start start 2023-11-27T17:53:47.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065f845640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06581433c0 0x7f06580b6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065f845640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06580721d0 0x7f0658153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065f845640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0658072660 con 0x7f065806b7d0 2023-11-27T17:53:47.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065f845640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06580b5f70 con 0x7f06581433c0 2023-11-27T17:53:47.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065f845640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0658071d40 con 0x7f06580721d0 2023-11-27T17:53:47.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065cde0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06581433c0 0x7f06580b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065dde2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06580721d0 0x7f0658153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065dde2640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06580721d0 0x7f0658153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:60096/0 (socket says 172.21.15.31:60096) 2023-11-27T17:53:47.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065dde2640 1 -- 172.21.15.31:0/1745375472 learned_addr learned my addr 172.21.15.31:0/1745375472 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:47.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065cde0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06581433c0 0x7f06580b6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:42074/0 (socket says 172.21.15.31:42074) 2023-11-27T17:53:47.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065d5e1640 1 --1- 172.21.15.31:0/1745375472 >> v1:172.21.15.81:6789/0 conn(0x7f065806b7d0 0x7f0658142cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.31:42642/0 (socket says 172.21.15.31:42642) 2023-11-27T17:53:47.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065cde0640 1 -- 172.21.15.31:0/1745375472 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06580721d0 msgr2=0x7f0658153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:47.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065cde0640 1 --2- 172.21.15.31:0/1745375472 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06580721d0 0x7f0658153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065cde0640 1 -- 172.21.15.31:0/1745375472 >> v1:172.21.15.81:6789/0 conn(0x7f065806b7d0 legacy=0x7f0658142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065cde0640 1 -- 172.21.15.31:0/1745375472 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06580b4960 con 0x7f06581433c0 2023-11-27T17:53:47.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.261+0000 7f065dde2640 1 --2- 172.21.15.31:0/1745375472 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06580721d0 0x7f0658153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:47.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f065cde0640 1 --2- 172.21.15.31:0/1745375472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06581433c0 0x7f06580b6320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f06540097c0 tx=0x7f065401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=867169c3e5e9f275 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:47.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f064ffff640 1 -- 172.21.15.31:0/1745375472 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540a8970 con 0x7f06581433c0 2023-11-27T17:53:47.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f064ffff640 1 -- 172.21.15.31:0/1745375472 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06540a8ad0 con 0x7f06581433c0 2023-11-27T17:53:47.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f064ffff640 1 -- 172.21.15.31:0/1745375472 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540a8e60 con 0x7f06581433c0 2023-11-27T17:53:47.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f065f845640 1 -- 172.21.15.31:0/1745375472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06581433c0 msgr2=0x7f06580b6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f065f845640 1 --2- 172.21.15.31:0/1745375472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06581433c0 0x7f06580b6320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f06540097c0 tx=0x7f065401ec70 comp rx=0 tx=0).stop 2023-11-27T17:53:47.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f065f845640 1 -- 172.21.15.31:0/1745375472 shutdown_connections 2023-11-27T17:53:47.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f065f845640 1 --2- 172.21.15.31:0/1745375472 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06580721d0 0x7f0658153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f065f845640 1 --2- 172.21.15.31:0/1745375472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06581433c0 0x7f06580b6320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f065f845640 1 -- 172.21.15.31:0/1745375472 >> 172.21.15.31:0/1745375472 conn(0x7f06580b9dc0 msgr2=0x7f06580ba1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:47.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f065f845640 1 -- 172.21.15.31:0/1745375472 shutdown_connections 2023-11-27T17:53:47.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f065f845640 1 -- 172.21.15.31:0/1745375472 wait complete. 2023-11-27T17:53:47.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f065f845640 1 Processor -- start 2023-11-27T17:53:47.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.265+0000 7f065f845640 1 -- start start 2023-11-27T17:53:47.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065f845640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f065806b7d0 0x7f06581e1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065f845640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06580721d0 0x7f06581481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065f845640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06581433c0 0x7f065813b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065f845640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0658148b30 con 0x7f06581433c0 2023-11-27T17:53:47.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065f845640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06581d00c0 con 0x7f065806b7d0 2023-11-27T17:53:47.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065f845640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0658149620 con 0x7f06580721d0 2023-11-27T17:53:47.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065dde2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06581433c0 0x7f065813b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065dde2640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06581433c0 0x7f065813b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42736/0 (socket says 172.21.15.31:42736) 2023-11-27T17:53:47.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065dde2640 1 -- 172.21.15.31:0/3302375375 learned_addr learned my addr 172.21.15.31:0/3302375375 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:47.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065cde0640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06580721d0 0x7f06581481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065d5e1640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f065806b7d0 0x7f06581e1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065dde2640 1 -- 172.21.15.31:0/3302375375 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06580721d0 msgr2=0x7f06581481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065dde2640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06580721d0 0x7f06581481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065dde2640 1 -- 172.21.15.31:0/3302375375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f065806b7d0 msgr2=0x7f06581e1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065dde2640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f065806b7d0 0x7f06581e1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065dde2640 1 -- 172.21.15.31:0/3302375375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0650009b30 con 0x7f06581433c0 2023-11-27T17:53:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065dde2640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06581433c0 0x7f065813b230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f065000efc0 tx=0x7f065000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f064dffb640 1 -- 172.21.15.31:0/3302375375 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650018070 con 0x7f06581433c0 2023-11-27T17:53:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f064dffb640 1 -- 172.21.15.31:0/3302375375 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065000f040 con 0x7f06581433c0 2023-11-27T17:53:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065f845640 1 -- 172.21.15.31:0/3302375375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0654009420 con 0x7f06581433c0 2023-11-27T17:53:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f064dffb640 1 -- 172.21.15.31:0/3302375375 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065000ce00 con 0x7f06581433c0 2023-11-27T17:53:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065f845640 1 -- 172.21.15.31:0/3302375375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06581cfde0 con 0x7f06581433c0 2023-11-27T17:53:47.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065f845640 1 -- 172.21.15.31:0/3302375375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065804e850 con 0x7f06581433c0 2023-11-27T17:53:47.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f064dffb640 1 -- 172.21.15.31:0/3302375375 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f0650014480 con 0x7f06581433c0 2023-11-27T17:53:47.276 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f064dffb640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f063c0667f0 0x7f063c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065d5e1640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f063c0667f0 0x7f063c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f064dffb640 1 -- 172.21.15.31:0/3302375375 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0650084550 con 0x7f06581433c0 2023-11-27T17:53:47.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.269+0000 7f065d5e1640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f063c0667f0 0x7f063c068cb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0648000f70 tx=0x7f0648007cd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:47.279 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.273+0000 7f064dffb640 1 -- 172.21.15.31:0/3302375375 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f06500516e0 con 0x7f06581433c0 2023-11-27T17:53:47.430 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.425+0000 7f065f845640 1 -- 172.21.15.31:0/3302375375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0658149ad0 con 0x7f06581433c0 2023-11-27T17:53:47.432 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f064dffb640 1 -- 172.21.15.31:0/3302375375 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7f0650054d00 con 0x7f06581433c0 2023-11-27T17:53:47.433 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:47.433 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:47.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f065f845640 1 -- 172.21.15.31:0/3302375375 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f063c0667f0 msgr2=0x7f063c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f065f845640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f063c0667f0 0x7f063c068cb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0648000f70 tx=0x7f0648007cd0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f065f845640 1 -- 172.21.15.31:0/3302375375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06581433c0 msgr2=0x7f065813b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f065f845640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06581433c0 0x7f065813b230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f065000efc0 tx=0x7f065000c490 comp rx=0 tx=0).stop 2023-11-27T17:53:47.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f065f845640 1 -- 172.21.15.31:0/3302375375 shutdown_connections 2023-11-27T17:53:47.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f065f845640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f063c0667f0 0x7f063c068cb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f065f845640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06581433c0 0x7f065813b230 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f065f845640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06580721d0 0x7f06581481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f065f845640 1 --2- 172.21.15.31:0/3302375375 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f065806b7d0 0x7f06581e1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.435 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f065f845640 1 -- 172.21.15.31:0/3302375375 >> 172.21.15.31:0/3302375375 conn(0x7f06580b9dc0 msgr2=0x7f0658141ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:47.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f065f845640 1 -- 172.21.15.31:0/3302375375 shutdown_connections 2023-11-27T17:53:47.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.429+0000 7f065f845640 1 -- 172.21.15.31:0/3302375375 wait complete. 2023-11-27T17:53:47.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:53:11.177026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:53:21.543531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:53:22.362977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:53:47.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:53:47.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.561+0000 7f57f1fc8640 1 Processor -- start 2023-11-27T17:53:47.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.561+0000 7f57f1fc8640 1 -- start start 2023-11-27T17:53:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57f1fc8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57ec1425e0 0x7f57ec0bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57f1fc8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ec0b6840 con 0x7f57ec148c80 2023-11-27T17:53:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57f1fc8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ec0b6b20 con 0x7f57ec0b5d90 2023-11-27T17:53:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57f1fc8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ec1429c0 con 0x7f57ec1425e0 2023-11-27T17:53:47.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ebfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f57ec148c80 0x7f57ec1529c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44784/0 (socket says 172.21.15.31:44784) 2023-11-27T17:53:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ebfff640 1 -- 172.21.15.31:0/1735688501 learned_addr learned my addr 172.21.15.31:0/1735688501 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57eb7fe640 1 --2- 172.21.15.31:0/1735688501 >> v2:172.21.15.81:3300/0 conn(0x7f57ec1425e0 0x7f57ec0bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299021113 0 0) 0x7f57ec0b6840 con 0x7f57ec148c80 2023-11-27T17:53:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57d4003530 con 0x7f57ec148c80 2023-11-27T17:53:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1642370054 0 0) 0x7f57d4003530 con 0x7f57ec148c80 2023-11-27T17:53:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 >> v2:172.21.15.81:3300/0 conn(0x7f57ec1425e0 msgr2=0x7f57ec0bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 --2- 172.21.15.31:0/1735688501 >> v2:172.21.15.81:3300/0 conn(0x7f57ec1425e0 0x7f57ec0bd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 >> v1:172.21.15.81:6789/0 conn(0x7f57ec0b5d90 legacy=0x7f57ec148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ec0b6e00 con 0x7f57ec148c80 2023-11-27T17:53:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f57e4001a00 con 0x7f57ec148c80 2023-11-27T17:53:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 >> v1:172.21.15.31:6789/0 conn(0x7f57ec148c80 legacy=0x7f57ec1529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 --2- 172.21.15.31:0/1735688501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57d40039f0 0x7f57d4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 --2- 172.21.15.31:0/1735688501 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57d40047d0 0x7f57d4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 --2- 172.21.15.31:0/1735688501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d4005190 0x7f57d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec1429c0 con 0x7f57d4005190 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d400c0a0 con 0x7f57d40039f0 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d400c260 con 0x7f57d40047d0 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ebfff640 1 --2- 172.21.15.31:0/1735688501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d4005190 0x7f57d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57eb7fe640 1 --2- 172.21.15.31:0/1735688501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57d40039f0 0x7f57d4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57eaffd640 1 --2- 172.21.15.31:0/1735688501 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57d40047d0 0x7f57d4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ebfff640 1 -- 172.21.15.31:0/1735688501 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57d40047d0 msgr2=0x7f57d4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ebfff640 1 --2- 172.21.15.31:0/1735688501 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57d40047d0 0x7f57d4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ebfff640 1 -- 172.21.15.31:0/1735688501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57d40039f0 msgr2=0x7f57d4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ebfff640 1 --2- 172.21.15.31:0/1735688501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57d40039f0 0x7f57d4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ebfff640 1 -- 172.21.15.31:0/1735688501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d4003530 con 0x7f57d4005190 2023-11-27T17:53:47.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ebfff640 1 -- 172.21.15.31:0/1735688501 reap_dead start 2023-11-27T17:53:47.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ebfff640 1 --2- 172.21.15.31:0/1735688501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d4005190 0x7f57d400b990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f57e400a830 tx=0x7f57e401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da69ecd9d6d5758b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:47.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.565+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e40072d0 con 0x7f57d4005190 2023-11-27T17:53:47.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e40a8070 con 0x7f57d4005190 2023-11-27T17:53:47.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57ea7fc640 1 -- 172.21.15.31:0/1735688501 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e40076b0 con 0x7f57d4005190 2023-11-27T17:53:47.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 -- 172.21.15.31:0/1735688501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d4005190 msgr2=0x7f57d400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 --2- 172.21.15.31:0/1735688501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d4005190 0x7f57d400b990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f57e400a830 tx=0x7f57e401d340 comp rx=0 tx=0).stop 2023-11-27T17:53:47.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 -- 172.21.15.31:0/1735688501 shutdown_connections 2023-11-27T17:53:47.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 --2- 172.21.15.31:0/1735688501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57d4005190 0x7f57d400b990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 -- 172.21.15.31:0/1735688501 >> 172.21.15.31:0/1735688501 conn(0x7f57ec06ab60 msgr2=0x7f57ec0bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:47.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 -- 172.21.15.31:0/1735688501 shutdown_connections 2023-11-27T17:53:47.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 -- 172.21.15.31:0/1735688501 wait complete. 2023-11-27T17:53:47.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 Processor -- start 2023-11-27T17:53:47.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 -- start start 2023-11-27T17:53:47.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57d4005190 0x7f57ec1453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57ec071f70 0x7f57ec1e40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57ec1e45f0 0x7f57ec13ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec144570 con 0x7f57ec071f70 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec0b33e0 con 0x7f57ec1e45f0 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec147f30 con 0x7f57d4005190 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57eaffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57ec071f70 0x7f57ec1e40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57eaffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57ec071f70 0x7f57ec1e40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42750/0 (socket says 172.21.15.31:42750) 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57eaffd640 1 -- 172.21.15.31:0/3638547157 learned_addr learned my addr 172.21.15.31:0/3638547157 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57eb7fe640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57d4005190 0x7f57ec1453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57ebfff640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57ec1e45f0 0x7f57ec13ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57eaffd640 1 -- 172.21.15.31:0/3638547157 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57d4005190 msgr2=0x7f57ec1453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57eaffd640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57d4005190 0x7f57ec1453b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57eaffd640 1 -- 172.21.15.31:0/3638547157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57ec1e45f0 msgr2=0x7f57ec13ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57eaffd640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57ec1e45f0 0x7f57ec13ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57eaffd640 1 -- 172.21.15.31:0/3638547157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ec070290 con 0x7f57ec071f70 2023-11-27T17:53:47.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57eaffd640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57ec071f70 0x7f57ec1e40b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f57e000e3c0 tx=0x7f57e000e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:47.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57d3fff640 1 -- 172.21.15.31:0/3638547157 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e00052e0 con 0x7f57ec071f70 2023-11-27T17:53:47.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57d3fff640 1 -- 172.21.15.31:0/3638547157 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e0005440 con 0x7f57ec071f70 2023-11-27T17:53:47.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 -- 172.21.15.31:0/3638547157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ec148180 con 0x7f57ec071f70 2023-11-27T17:53:47.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57d3fff640 1 -- 172.21.15.31:0/3638547157 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e0003820 con 0x7f57ec071f70 2023-11-27T17:53:47.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.569+0000 7f57f1fc8640 1 -- 172.21.15.31:0/3638547157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ec143eb0 con 0x7f57ec071f70 2023-11-27T17:53:47.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.573+0000 7f57f1fc8640 1 -- 172.21.15.31:0/3638547157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ec04e850 con 0x7f57ec071f70 2023-11-27T17:53:47.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.573+0000 7f57d3fff640 1 -- 172.21.15.31:0/3638547157 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f57e0003980 con 0x7f57ec071f70 2023-11-27T17:53:47.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.573+0000 7f57d3fff640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57d80667f0 0x7f57d8068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.573+0000 7f57d3fff640 1 -- 172.21.15.31:0/3638547157 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57e0084180 con 0x7f57ec071f70 2023-11-27T17:53:47.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.573+0000 7f57eb7fe640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57d80667f0 0x7f57d8068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.573+0000 7f57eb7fe640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57d80667f0 0x7f57d8068cb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f57dc009aa0 tx=0x7f57dc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:47.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.577+0000 7f57d3fff640 1 -- 172.21.15.31:0/3638547157 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f57e00513a0 con 0x7f57ec071f70 2023-11-27T17:53:47.729 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.725+0000 7f57f1fc8640 1 -- 172.21.15.31:0/3638547157 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57ec145b30 con 0x7f57ec071f70 2023-11-27T17:53:47.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.725+0000 7f57d3fff640 1 -- 172.21.15.31:0/3638547157 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57e0019020 con 0x7f57ec071f70 2023-11-27T17:53:47.730 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-11-27T17:53:47.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.729+0000 7f57f1fc8640 1 -- 172.21.15.31:0/3638547157 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57d80667f0 msgr2=0x7f57d8068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.729+0000 7f57f1fc8640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57d80667f0 0x7f57d8068cb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f57dc009aa0 tx=0x7f57dc008040 comp rx=0 tx=0).stop 2023-11-27T17:53:47.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.729+0000 7f57f1fc8640 1 -- 172.21.15.31:0/3638547157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57ec071f70 msgr2=0x7f57ec1e40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.729+0000 7f57f1fc8640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57ec071f70 0x7f57ec1e40b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f57e000e3c0 tx=0x7f57e000e880 comp rx=0 tx=0).stop 2023-11-27T17:53:47.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.729+0000 7f57f1fc8640 1 -- 172.21.15.31:0/3638547157 shutdown_connections 2023-11-27T17:53:47.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.729+0000 7f57f1fc8640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57d80667f0 0x7f57d8068cb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.729+0000 7f57f1fc8640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57ec1e45f0 0x7f57ec13ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.729+0000 7f57f1fc8640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57ec071f70 0x7f57ec1e40b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.729+0000 7f57f1fc8640 1 --2- 172.21.15.31:0/3638547157 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57d4005190 0x7f57ec1453b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.729+0000 7f57f1fc8640 1 -- 172.21.15.31:0/3638547157 >> 172.21.15.31:0/3638547157 conn(0x7f57ec06ab60 msgr2=0x7f57ec140490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.729+0000 7f57f1fc8640 1 -- 172.21.15.31:0/3638547157 shutdown_connections 2023-11-27T17:53:47.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.729+0000 7f57f1fc8640 1 -- 172.21.15.31:0/3638547157 wait complete. 2023-11-27T17:53:47.747 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:53:47.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.857+0000 7f505d89b640 1 Processor -- start 2023-11-27T17:53:47.863 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.857+0000 7f505d89b640 1 -- start start 2023-11-27T17:53:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f50580c0670 0x7f505814b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f50580b6da0 0x7f50580b7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50580bfbd0 con 0x7f505806ab90 2023-11-27T17:53:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50580b7ce0 con 0x7f50580c0670 2023-11-27T17:53:47.864 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50580bfe70 con 0x7f50580b6da0 2023-11-27T17:53:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f50567fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f50580c0670 0x7f505814b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f50567fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f50580c0670 0x7f505814b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42760/0 (socket says 172.21.15.31:42760) 2023-11-27T17:53:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f50567fc640 1 -- 172.21.15.31:0/3741862140 learned_addr learned my addr 172.21.15.31:0/3741862140 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f50567fc640 1 -- 172.21.15.31:0/3741862140 >> v2:172.21.15.81:3300/0 conn(0x7f50580b6da0 msgr2=0x7f50580b7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f50567fc640 1 --2- 172.21.15.31:0/3741862140 >> v2:172.21.15.81:3300/0 conn(0x7f50580b6da0 0x7f50580b7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f50567fc640 1 -- 172.21.15.31:0/3741862140 >> v1:172.21.15.81:6789/0 conn(0x7f505806ab90 legacy=0x7f505806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:47.865 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f50567fc640 1 -- 172.21.15.31:0/3741862140 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50580c0150 con 0x7f50580c0670 2023-11-27T17:53:47.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f50567fc640 1 --2- 172.21.15.31:0/3741862140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50580c0670 0x7f505814b600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f505806a5f0 tx=0x7f504801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2293e4212c7d7b4e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:47.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f5055ffb640 1 -- 172.21.15.31:0/3741862140 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480ac630 con 0x7f50580c0670 2023-11-27T17:53:47.866 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f5055ffb640 1 -- 172.21.15.31:0/3741862140 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50480ac790 con 0x7f50580c0670 2023-11-27T17:53:47.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f5055ffb640 1 -- 172.21.15.31:0/3741862140 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50480acb20 con 0x7f50580c0670 2023-11-27T17:53:47.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 -- 172.21.15.31:0/3741862140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50580c0670 msgr2=0x7f505814b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 --2- 172.21.15.31:0/3741862140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50580c0670 0x7f505814b600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f505806a5f0 tx=0x7f504801c4c0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.867 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 -- 172.21.15.31:0/3741862140 shutdown_connections 2023-11-27T17:53:47.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 --2- 172.21.15.31:0/3741862140 >> v2:172.21.15.81:3300/0 conn(0x7f50580b6da0 0x7f50580b7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 --2- 172.21.15.31:0/3741862140 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f50580c0670 0x7f505814b600 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 -- 172.21.15.31:0/3741862140 >> 172.21.15.31:0/3741862140 conn(0x7f50580a28f0 msgr2=0x7f50580a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:47.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 -- 172.21.15.31:0/3741862140 shutdown_connections 2023-11-27T17:53:47.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.861+0000 7f505d89b640 1 -- 172.21.15.31:0/3741862140 wait complete. 2023-11-27T17:53:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f505d89b640 1 Processor -- start 2023-11-27T17:53:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f505d89b640 1 -- start start 2023-11-27T17:53:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f505d89b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505806ab90 0x7f50581e7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f505d89b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f50580b6da0 0x7f5058140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f505d89b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50580c0670 0x7f5058133910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f505d89b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50581e8150 con 0x7f505806ab90 2023-11-27T17:53:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f505d89b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50581e78b0 con 0x7f50580c0670 2023-11-27T17:53:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f505d89b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50581e7b90 con 0x7f50580b6da0 2023-11-27T17:53:47.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f5056ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505806ab90 0x7f50581e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f5056ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505806ab90 0x7f50581e7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42772/0 (socket says 172.21.15.31:42772) 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f5056ffd640 1 -- 172.21.15.31:0/4238957991 learned_addr learned my addr 172.21.15.31:0/4238957991 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f5056ffd640 1 -- 172.21.15.31:0/4238957991 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f50580b6da0 msgr2=0x7f5058140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f5056ffd640 1 --2- 172.21.15.31:0/4238957991 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f50580b6da0 0x7f5058140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f5056ffd640 1 -- 172.21.15.31:0/4238957991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50580c0670 msgr2=0x7f5058133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f5056ffd640 1 --2- 172.21.15.31:0/4238957991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50580c0670 0x7f5058133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f5056ffd640 1 -- 172.21.15.31:0/4238957991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50480094d0 con 0x7f505806ab90 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f5056ffd640 1 --2- 172.21.15.31:0/4238957991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505806ab90 0x7f50581e7290 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c490 tx=0x7f504c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f503ffff640 1 -- 172.21.15.31:0/4238957991 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c003600 con 0x7f505806ab90 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f503ffff640 1 -- 172.21.15.31:0/4238957991 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504c003780 con 0x7f505806ab90 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f505d89b640 1 -- 172.21.15.31:0/4238957991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50581e7e70 con 0x7f505806ab90 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f503ffff640 1 -- 172.21.15.31:0/4238957991 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504c003b70 con 0x7f505806ab90 2023-11-27T17:53:47.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f505d89b640 1 -- 172.21.15.31:0/4238957991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5058141a70 con 0x7f505806ab90 2023-11-27T17:53:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f505d89b640 1 -- 172.21.15.31:0/4238957991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50581dd4e0 con 0x7f505806ab90 2023-11-27T17:53:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.865+0000 7f503ffff640 1 -- 172.21.15.31:0/4238957991 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f504c003cd0 con 0x7f505806ab90 2023-11-27T17:53:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.869+0000 7f503ffff640 1 --2- 172.21.15.31:0/4238957991 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f50440667f0 0x7f5044068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:47.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.869+0000 7f503ffff640 1 -- 172.21.15.31:0/4238957991 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f504c0838f0 con 0x7f505806ab90 2023-11-27T17:53:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.869+0000 7f50567fc640 1 --2- 172.21.15.31:0/4238957991 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f50440667f0 0x7f5044068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:47.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.869+0000 7f50567fc640 1 --2- 172.21.15.31:0/4238957991 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f50440667f0 0x7f5044068cb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f50480ae000 tx=0x7f5048008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:47.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:47.873+0000 7f503ffff640 1 -- 172.21.15.31:0/4238957991 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f50581dd4e0 con 0x7f505806ab90 2023-11-27T17:53:48.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.021+0000 7f505d89b640 1 -- 172.21.15.31:0/4238957991 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50581dd4e0 con 0x7f505806ab90 2023-11-27T17:53:48.027 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.021+0000 7f503ffff640 1 -- 172.21.15.31:0/4238957991 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50581dd4e0 con 0x7f505806ab90 2023-11-27T17:53:48.028 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-11-27T17:53:48.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.025+0000 7f505d89b640 1 -- 172.21.15.31:0/4238957991 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f50440667f0 msgr2=0x7f5044068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.025+0000 7f505d89b640 1 --2- 172.21.15.31:0/4238957991 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f50440667f0 0x7f5044068cb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f50480ae000 tx=0x7f5048008040 comp rx=0 tx=0).stop 2023-11-27T17:53:48.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.025+0000 7f505d89b640 1 -- 172.21.15.31:0/4238957991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505806ab90 msgr2=0x7f50581e7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.025+0000 7f505d89b640 1 --2- 172.21.15.31:0/4238957991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505806ab90 0x7f50581e7290 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c490 tx=0x7f504c001e80 comp rx=0 tx=0).stop 2023-11-27T17:53:48.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.025+0000 7f505d89b640 1 -- 172.21.15.31:0/4238957991 shutdown_connections 2023-11-27T17:53:48.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.025+0000 7f505d89b640 1 --2- 172.21.15.31:0/4238957991 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f50440667f0 0x7f5044068cb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.025+0000 7f505d89b640 1 --2- 172.21.15.31:0/4238957991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50580c0670 0x7f5058133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.025+0000 7f505d89b640 1 --2- 172.21.15.31:0/4238957991 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f50580b6da0 0x7f5058140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.025+0000 7f505d89b640 1 --2- 172.21.15.31:0/4238957991 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f505806ab90 0x7f50581e7290 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.025+0000 7f505d89b640 1 -- 172.21.15.31:0/4238957991 >> 172.21.15.31:0/4238957991 conn(0x7f50580a28f0 msgr2=0x7f50580a0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:48.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.025+0000 7f505d89b640 1 -- 172.21.15.31:0/4238957991 shutdown_connections 2023-11-27T17:53:48.030 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.025+0000 7f505d89b640 1 -- 172.21.15.31:0/4238957991 wait complete. 2023-11-27T17:53:48.044 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:53:48.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde79e48640 1 Processor -- start 2023-11-27T17:53:48.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde79e48640 1 -- start start 2023-11-27T17:53:48.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde79e48640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde74143560 0x7fde740bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde79e48640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde7406f1d0 0x7fde741494f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde79e48640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde74071260 con 0x7fde74149a30 2023-11-27T17:53:48.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde79e48640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde74143940 con 0x7fde74143560 2023-11-27T17:53:48.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde79e48640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde74149ec0 con 0x7fde7406f1d0 2023-11-27T17:53:48.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde737fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fde74143560 0x7fde740bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde73fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fde74149a30 0x7fde7414c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44792/0 (socket says 172.21.15.31:44792) 2023-11-27T17:53:48.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde73fff640 1 -- 172.21.15.31:0/860421030 learned_addr learned my addr 172.21.15.31:0/860421030 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:48.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde72ffd640 1 --2- 172.21.15.31:0/860421030 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde7406f1d0 0x7fde741494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde737fe640 1 -- 172.21.15.31:0/860421030 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde7406f1d0 msgr2=0x7fde741494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:48.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde737fe640 1 --2- 172.21.15.31:0/860421030 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde7406f1d0 0x7fde741494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde737fe640 1 -- 172.21.15.31:0/860421030 >> v1:172.21.15.31:6789/0 conn(0x7fde74149a30 legacy=0x7fde7414c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde737fe640 1 -- 172.21.15.31:0/860421030 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7406f800 con 0x7fde74143560 2023-11-27T17:53:48.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.153+0000 7fde727fc640 1 -- 172.21.15.31:0/860421030 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545750401 0 0) 0x7fde74071260 con 0x7fde74149a30 2023-11-27T17:53:48.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde737fe640 1 --2- 172.21.15.31:0/860421030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde74143560 0x7fde740bd240 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fde64009d90 tx=0x7fde6401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e3d9d1f85385357 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:48.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde727fc640 1 -- 172.21.15.31:0/860421030 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640a5900 con 0x7fde74143560 2023-11-27T17:53:48.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde727fc640 1 -- 172.21.15.31:0/860421030 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde640a5a60 con 0x7fde74143560 2023-11-27T17:53:48.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde727fc640 1 -- 172.21.15.31:0/860421030 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640a5df0 con 0x7fde74143560 2023-11-27T17:53:48.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 -- 172.21.15.31:0/860421030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde74143560 msgr2=0x7fde740bd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 --2- 172.21.15.31:0/860421030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde74143560 0x7fde740bd240 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fde64009d90 tx=0x7fde6401c920 comp rx=0 tx=0).stop 2023-11-27T17:53:48.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 -- 172.21.15.31:0/860421030 shutdown_connections 2023-11-27T17:53:48.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 --2- 172.21.15.31:0/860421030 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde7406f1d0 0x7fde741494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 --2- 172.21.15.31:0/860421030 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde74143560 0x7fde740bd240 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 -- 172.21.15.31:0/860421030 >> 172.21.15.31:0/860421030 conn(0x7fde7406ab60 msgr2=0x7fde740bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:48.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 -- 172.21.15.31:0/860421030 shutdown_connections 2023-11-27T17:53:48.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 -- 172.21.15.31:0/860421030 wait complete. 2023-11-27T17:53:48.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 Processor -- start 2023-11-27T17:53:48.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 -- start start 2023-11-27T17:53:48.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde7406f1d0 0x7fde74135470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde74143560 0x7fde7414be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde74149a30 0x7fde7414a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde740bc810 con 0x7fde7406f1d0 2023-11-27T17:53:48.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde741359b0 con 0x7fde74143560 2023-11-27T17:53:48.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde740bc2f0 con 0x7fde74149a30 2023-11-27T17:53:48.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde737fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde7406f1d0 0x7fde74135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde737fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde7406f1d0 0x7fde74135470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42792/0 (socket says 172.21.15.31:42792) 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde737fe640 1 -- 172.21.15.31:0/708060555 learned_addr learned my addr 172.21.15.31:0/708060555 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde737fe640 1 -- 172.21.15.31:0/708060555 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde74149a30 msgr2=0x7fde7414a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde73fff640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde74149a30 0x7fde7414a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde72ffd640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde74143560 0x7fde7414be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde737fe640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde74149a30 0x7fde7414a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde737fe640 1 -- 172.21.15.31:0/708060555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde74143560 msgr2=0x7fde7414be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde737fe640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde74143560 0x7fde7414be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde737fe640 1 -- 172.21.15.31:0/708060555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde64009a70 con 0x7fde7406f1d0 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde73fff640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde74149a30 0x7fde7414a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde737fe640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde7406f1d0 0x7fde74135470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fde6401a550 tx=0x7fde640196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde6bfff640 1 -- 172.21.15.31:0/708060555 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640ad850 con 0x7fde7406f1d0 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde6bfff640 1 -- 172.21.15.31:0/708060555 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde640ad9b0 con 0x7fde7406f1d0 2023-11-27T17:53:48.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde6bfff640 1 -- 172.21.15.31:0/708060555 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640add80 con 0x7fde7406f1d0 2023-11-27T17:53:48.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 -- 172.21.15.31:0/708060555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde74142070 con 0x7fde7406f1d0 2023-11-27T17:53:48.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.157+0000 7fde79e48640 1 -- 172.21.15.31:0/708060555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde74141870 con 0x7fde7406f1d0 2023-11-27T17:53:48.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.161+0000 7fde79e48640 1 -- 172.21.15.31:0/708060555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7404e850 con 0x7fde7406f1d0 2023-11-27T17:53:48.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.161+0000 7fde6bfff640 1 -- 172.21.15.31:0/708060555 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fde640b4050 con 0x7fde7406f1d0 2023-11-27T17:53:48.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.161+0000 7fde6bfff640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fde540667f0 0x7fde54068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.161+0000 7fde6bfff640 1 -- 172.21.15.31:0/708060555 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde6411f410 con 0x7fde7406f1d0 2023-11-27T17:53:48.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.161+0000 7fde72ffd640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fde540667f0 0x7fde54068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.161+0000 7fde72ffd640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fde540667f0 0x7fde54068cb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde741492f0 tx=0x7fde5c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:48.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.165+0000 7fde6bfff640 1 -- 172.21.15.31:0/708060555 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fde640ec620 con 0x7fde7406f1d0 2023-11-27T17:53:48.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.321+0000 7fde79e48640 1 -- 172.21.15.31:0/708060555 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde740bc980 con 0x7fde7406f1d0 2023-11-27T17:53:48.325 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.321+0000 7fde6bfff640 1 -- 172.21.15.31:0/708060555 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde640f6030 con 0x7fde7406f1d0 2023-11-27T17:53:48.326 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-11-27T17:53:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.325+0000 7fde79e48640 1 -- 172.21.15.31:0/708060555 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fde540667f0 msgr2=0x7fde54068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.325+0000 7fde79e48640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fde540667f0 0x7fde54068cb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde741492f0 tx=0x7fde5c008040 comp rx=0 tx=0).stop 2023-11-27T17:53:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.325+0000 7fde79e48640 1 -- 172.21.15.31:0/708060555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde7406f1d0 msgr2=0x7fde74135470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.325+0000 7fde79e48640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde7406f1d0 0x7fde74135470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fde6401a550 tx=0x7fde640196c0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.325+0000 7fde79e48640 1 -- 172.21.15.31:0/708060555 shutdown_connections 2023-11-27T17:53:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.325+0000 7fde79e48640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fde540667f0 0x7fde54068cb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.325+0000 7fde79e48640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fde74149a30 0x7fde7414a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.325+0000 7fde79e48640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde74143560 0x7fde7414be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.325+0000 7fde79e48640 1 --2- 172.21.15.31:0/708060555 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde7406f1d0 0x7fde74135470 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.325+0000 7fde79e48640 1 -- 172.21.15.31:0/708060555 >> 172.21.15.31:0/708060555 conn(0x7fde7406ab60 msgr2=0x7fde740b9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:48.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.325+0000 7fde79e48640 1 -- 172.21.15.31:0/708060555 shutdown_connections 2023-11-27T17:53:48.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.325+0000 7fde79e48640 1 -- 172.21.15.31:0/708060555 wait complete. 2023-11-27T17:53:48.345 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.465+0000 7fb62d73d640 1 Processor -- start 2023-11-27T17:53:48.470 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.465+0000 7fb62d73d640 1 -- start start 2023-11-27T17:53:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.465+0000 7fb62d73d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6281430a0 0x7fb6280b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.465+0000 7fb62d73d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6280bd6b0 0x7fb628153980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.465+0000 7fb62d73d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6280b5d00 con 0x7fb6280bd240 2023-11-27T17:53:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.465+0000 7fb62d73d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb628143750 con 0x7fb6281430a0 2023-11-27T17:53:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.465+0000 7fb62d73d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb628143480 con 0x7fb6280bd6b0 2023-11-27T17:53:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.465+0000 7fb6277fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6280bd6b0 0x7fb628153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.471 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.465+0000 7fb626ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6281430a0 0x7fb6280b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.465+0000 7fb6277fe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6280bd6b0 0x7fb628153980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:60156/0 (socket says 172.21.15.31:60156) 2023-11-27T17:53:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.465+0000 7fb6277fe640 1 -- 172.21.15.31:0/3197499898 learned_addr learned my addr 172.21.15.31:0/3197499898 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb6277fe640 1 -- 172.21.15.31:0/3197499898 >> v2:172.21.15.81:3300/0 conn(0x7fb6281430a0 msgr2=0x7fb6280b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb6277fe640 1 --2- 172.21.15.31:0/3197499898 >> v2:172.21.15.81:3300/0 conn(0x7fb6281430a0 0x7fb6280b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb6277fe640 1 -- 172.21.15.31:0/3197499898 >> v1:172.21.15.81:6789/0 conn(0x7fb6280bd240 legacy=0x7fb628149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.472 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb6277fe640 1 -- 172.21.15.31:0/3197499898 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6280b4f40 con 0x7fb6280bd6b0 2023-11-27T17:53:48.473 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb626ffd640 1 --2- 172.21.15.31:0/3197499898 >> v2:172.21.15.81:3300/0 conn(0x7fb6281430a0 0x7fb6280b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:53:48.474 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb6277fe640 1 --2- 172.21.15.31:0/3197499898 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6280bd6b0 0x7fb628153980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb620009e50 tx=0x7fb62001f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3960f41f332989a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:48.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb625ffb640 1 -- 172.21.15.31:0/3197499898 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6200af400 con 0x7fb6280bd6b0 2023-11-27T17:53:48.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb625ffb640 1 -- 172.21.15.31:0/3197499898 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6200ab050 con 0x7fb6280bd6b0 2023-11-27T17:53:48.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb625ffb640 1 -- 172.21.15.31:0/3197499898 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6200af780 con 0x7fb6280bd6b0 2023-11-27T17:53:48.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb62d73d640 1 -- 172.21.15.31:0/3197499898 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6280bd6b0 msgr2=0x7fb628153980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb62d73d640 1 --2- 172.21.15.31:0/3197499898 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6280bd6b0 0x7fb628153980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb620009e50 tx=0x7fb62001f1f0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb62d73d640 1 -- 172.21.15.31:0/3197499898 shutdown_connections 2023-11-27T17:53:48.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb62d73d640 1 --2- 172.21.15.31:0/3197499898 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6280bd6b0 0x7fb628153980 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb62d73d640 1 --2- 172.21.15.31:0/3197499898 >> v2:172.21.15.81:3300/0 conn(0x7fb6281430a0 0x7fb6280b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb62d73d640 1 -- 172.21.15.31:0/3197499898 >> 172.21.15.31:0/3197499898 conn(0x7fb62806ab60 msgr2=0x7fb6280bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:48.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb62d73d640 1 -- 172.21.15.31:0/3197499898 shutdown_connections 2023-11-27T17:53:48.475 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.469+0000 7fb62d73d640 1 -- 172.21.15.31:0/3197499898 wait complete. 2023-11-27T17:53:48.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb62d73d640 1 Processor -- start 2023-11-27T17:53:48.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb62d73d640 1 -- start start 2023-11-27T17:53:48.477 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb62d73d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6280bd240 0x7fb628071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb62d73d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6280bd6b0 0x7fb6281dee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb62d73d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6281430a0 0x7fb6281df380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb62d73d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62806f9f0 con 0x7fb6280bd6b0 2023-11-27T17:53:48.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb62d73d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb628071040 con 0x7fb6281430a0 2023-11-27T17:53:48.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb62d73d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6281de960 con 0x7fb6280bd240 2023-11-27T17:53:48.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb6267fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6280bd6b0 0x7fb6281dee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb6267fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6280bd6b0 0x7fb6281dee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42798/0 (socket says 172.21.15.31:42798) 2023-11-27T17:53:48.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb6267fc640 1 -- 172.21.15.31:0/1470706669 learned_addr learned my addr 172.21.15.31:0/1470706669 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:48.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb626ffd640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6280bd240 0x7fb628071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb6277fe640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6281430a0 0x7fb6281df380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb6267fc640 1 -- 172.21.15.31:0/1470706669 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6280bd240 msgr2=0x7fb628071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.478 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb6267fc640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6280bd240 0x7fb628071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb6267fc640 1 -- 172.21.15.31:0/1470706669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6281430a0 msgr2=0x7fb6281df380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb6267fc640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6281430a0 0x7fb6281df380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb6267fc640 1 -- 172.21.15.31:0/1470706669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb618009420 con 0x7fb6280bd6b0 2023-11-27T17:53:48.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb6277fe640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6281430a0 0x7fb6281df380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:48.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb6267fc640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6280bd6b0 0x7fb6281dee40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00c530 tx=0x7fb61c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:48.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb60f7fe640 1 -- 172.21.15.31:0/1470706669 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c005220 con 0x7fb6280bd6b0 2023-11-27T17:53:48.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb62d73d640 1 -- 172.21.15.31:0/1470706669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb620009b30 con 0x7fb6280bd6b0 2023-11-27T17:53:48.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb60f7fe640 1 -- 172.21.15.31:0/1470706669 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c005380 con 0x7fb6280bd6b0 2023-11-27T17:53:48.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb60f7fe640 1 -- 172.21.15.31:0/1470706669 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c007270 con 0x7fb6280bd6b0 2023-11-27T17:53:48.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb62d73d640 1 -- 172.21.15.31:0/1470706669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62806fc00 con 0x7fb6280bd6b0 2023-11-27T17:53:48.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb62d73d640 1 -- 172.21.15.31:0/1470706669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6281deb20 con 0x7fb6280bd6b0 2023-11-27T17:53:48.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb60f7fe640 1 -- 172.21.15.31:0/1470706669 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb61c0073d0 con 0x7fb6280bd6b0 2023-11-27T17:53:48.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb60f7fe640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb6140667f0 0x7fb614068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.473+0000 7fb60f7fe640 1 -- 172.21.15.31:0/1470706669 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb61c083980 con 0x7fb6280bd6b0 2023-11-27T17:53:48.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.477+0000 7fb626ffd640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb6140667f0 0x7fb614068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.477+0000 7fb626ffd640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb6140667f0 0x7fb614068cb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb618009c50 tx=0x7fb618009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:48.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.477+0000 7fb60f7fe640 1 -- 172.21.15.31:0/1470706669 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb61c050a00 con 0x7fb6280bd6b0 2023-11-27T17:53:48.639 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.633+0000 7fb62d73d640 1 -- 172.21.15.31:0/1470706669 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6280b5d00 con 0x7fb6280bd6b0 2023-11-27T17:53:48.641 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb60f7fe640 1 -- 172.21.15.31:0/1470706669 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7fb6280b5d00 con 0x7fb6280bd6b0 2023-11-27T17:53:48.641 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:48.641 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:48.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb62d73d640 1 -- 172.21.15.31:0/1470706669 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb6140667f0 msgr2=0x7fb614068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb62d73d640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb6140667f0 0x7fb614068cb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb618009c50 tx=0x7fb618009190 comp rx=0 tx=0).stop 2023-11-27T17:53:48.643 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb62d73d640 1 -- 172.21.15.31:0/1470706669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6280bd6b0 msgr2=0x7fb6281dee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb62d73d640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6280bd6b0 0x7fb6281dee40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00c530 tx=0x7fb61c00c9f0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb62d73d640 1 -- 172.21.15.31:0/1470706669 shutdown_connections 2023-11-27T17:53:48.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb62d73d640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb6140667f0 0x7fb614068cb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.644 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb62d73d640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6281430a0 0x7fb6281df380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb62d73d640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6280bd6b0 0x7fb6281dee40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb62d73d640 1 --2- 172.21.15.31:0/1470706669 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6280bd240 0x7fb628071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb62d73d640 1 -- 172.21.15.31:0/1470706669 >> 172.21.15.31:0/1470706669 conn(0x7fb62806ab60 msgr2=0x7fb6280bc410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:48.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb62d73d640 1 -- 172.21.15.31:0/1470706669 shutdown_connections 2023-11-27T17:53:48.645 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.637+0000 7fb62d73d640 1 -- 172.21.15.31:0/1470706669 wait complete. 2023-11-27T17:53:48.659 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:53:11.177026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:53:21.543531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:53:22.362977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:53:48.660 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:53:48.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd389975640 1 Processor -- start 2023-11-27T17:53:48.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd389975640 1 -- start start 2023-11-27T17:53:48.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd389975640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd384071730 0x7fd384149c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd389975640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3840b7010 con 0x7fd38406f8d0 2023-11-27T17:53:48.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd389975640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd384071b50 con 0x7fd3840b64a0 2023-11-27T17:53:48.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd389975640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840709a0 con 0x7fd384071730 2023-11-27T17:53:48.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd3837fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd38406f8d0 0x7fd384153a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44802/0 (socket says 172.21.15.31:44802) 2023-11-27T17:53:48.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd3837fe640 1 -- 172.21.15.31:0/4248066749 learned_addr learned my addr 172.21.15.31:0/4248066749 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:48.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570300457 0 0) 0x7fd3840b7010 con 0x7fd38406f8d0 2023-11-27T17:53:48.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd36c003530 con 0x7fd38406f8d0 2023-11-27T17:53:48.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd3827fc640 1 --2- 172.21.15.31:0/4248066749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd384071730 0x7fd384149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1994307884 0 0) 0x7fd36c003530 con 0x7fd38406f8d0 2023-11-27T17:53:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd384071730 msgr2=0x7fd384149c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 --2- 172.21.15.31:0/4248066749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd384071730 0x7fd384149c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 >> v1:172.21.15.81:6789/0 conn(0x7fd3840b64a0 legacy=0x7fd3841431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38414a160 con 0x7fd38406f8d0 2023-11-27T17:53:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7fd37c001a00 con 0x7fd38406f8d0 2023-11-27T17:53:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 >> v1:172.21.15.31:6789/0 conn(0x7fd38406f8d0 legacy=0x7fd384153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 --2- 172.21.15.31:0/4248066749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd384071730 0x7fd36c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 --2- 172.21.15.31:0/4248066749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c004050 0x7fd36c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 --2- 172.21.15.31:0/4248066749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36c004d60 0x7fd36c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840709a0 con 0x7fd36c004050 2023-11-27T17:53:48.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c00bba0 con 0x7fd36c004d60 2023-11-27T17:53:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36c00bd60 con 0x7fd384071730 2023-11-27T17:53:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd3827fc640 1 --2- 172.21.15.31:0/4248066749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c004050 0x7fd36c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd382ffd640 1 --2- 172.21.15.31:0/4248066749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd384071730 0x7fd36c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd3837fe640 1 --2- 172.21.15.31:0/4248066749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36c004d60 0x7fd36c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd3827fc640 1 -- 172.21.15.31:0/4248066749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd384071730 msgr2=0x7fd36c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd3827fc640 1 --2- 172.21.15.31:0/4248066749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd384071730 0x7fd36c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd3827fc640 1 -- 172.21.15.31:0/4248066749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36c004d60 msgr2=0x7fd36c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd3827fc640 1 --2- 172.21.15.31:0/4248066749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36c004d60 0x7fd36c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.785+0000 7fd3827fc640 1 -- 172.21.15.31:0/4248066749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c003530 con 0x7fd36c004050 2023-11-27T17:53:48.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd3827fc640 1 --2- 172.21.15.31:0/4248066749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c004050 0x7fd36c0047d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd37800ba30 tx=0x7fd37801c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79078b6d58891a8b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:48.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780ac620 con 0x7fd36c004050 2023-11-27T17:53:48.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3780a6040 con 0x7fd36c004050 2023-11-27T17:53:48.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd381ffb640 1 -- 172.21.15.31:0/4248066749 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780ac9c0 con 0x7fd36c004050 2023-11-27T17:53:48.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 -- 172.21.15.31:0/4248066749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c004050 msgr2=0x7fd36c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 --2- 172.21.15.31:0/4248066749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd36c004050 0x7fd36c0047d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd37800ba30 tx=0x7fd37801c680 comp rx=0 tx=0).stop 2023-11-27T17:53:48.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd3837fe640 1 -- 172.21.15.31:0/4248066749 reap_dead start 2023-11-27T17:53:48.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 -- 172.21.15.31:0/4248066749 shutdown_connections 2023-11-27T17:53:48.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 -- 172.21.15.31:0/4248066749 >> 172.21.15.31:0/4248066749 conn(0x7fd38406ab60 msgr2=0x7fd3840bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:48.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 -- 172.21.15.31:0/4248066749 shutdown_connections 2023-11-27T17:53:48.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 -- 172.21.15.31:0/4248066749 wait complete. 2023-11-27T17:53:48.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 Processor -- start 2023-11-27T17:53:48.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 -- start start 2023-11-27T17:53:48.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36c004050 0x7fd3840b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd38414d1b0 0x7fd384145660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd384132bb0 0x7fd384133040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.797 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38414ba90 con 0x7fd384132bb0 2023-11-27T17:53:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3840b8fb0 con 0x7fd36c004050 2023-11-27T17:53:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd389975640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38414b010 con 0x7fd38414d1b0 2023-11-27T17:53:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd3837fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd384132bb0 0x7fd384133040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd3837fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd384132bb0 0x7fd384133040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42810/0 (socket says 172.21.15.31:42810) 2023-11-27T17:53:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd3837fe640 1 -- 172.21.15.31:0/2828958334 learned_addr learned my addr 172.21.15.31:0/2828958334 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd3827fc640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd38414d1b0 0x7fd384145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd382ffd640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36c004050 0x7fd3840b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd3837fe640 1 -- 172.21.15.31:0/2828958334 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd38414d1b0 msgr2=0x7fd384145660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd3837fe640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd38414d1b0 0x7fd384145660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd3837fe640 1 -- 172.21.15.31:0/2828958334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36c004050 msgr2=0x7fd3840b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd3837fe640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36c004050 0x7fd3840b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd3837fe640 1 -- 172.21.15.31:0/2828958334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38414c9b0 con 0x7fd384132bb0 2023-11-27T17:53:48.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.789+0000 7fd382ffd640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36c004050 0x7fd3840b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:48.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.793+0000 7fd3837fe640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd384132bb0 0x7fd384133040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd384070c00 tx=0x7fd37c0119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:48.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.793+0000 7fd36bfff640 1 -- 172.21.15.31:0/2828958334 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0137a0 con 0x7fd384132bb0 2023-11-27T17:53:48.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.793+0000 7fd36bfff640 1 -- 172.21.15.31:0/2828958334 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c013940 con 0x7fd384132bb0 2023-11-27T17:53:48.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.793+0000 7fd389975640 1 -- 172.21.15.31:0/2828958334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38414cc90 con 0x7fd384132bb0 2023-11-27T17:53:48.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.793+0000 7fd36bfff640 1 -- 172.21.15.31:0/2828958334 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c013cf0 con 0x7fd384132bb0 2023-11-27T17:53:48.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.793+0000 7fd389975640 1 -- 172.21.15.31:0/2828958334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd384133580 con 0x7fd384132bb0 2023-11-27T17:53:48.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.793+0000 7fd389975640 1 -- 172.21.15.31:0/2828958334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38414ce80 con 0x7fd384132bb0 2023-11-27T17:53:48.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.793+0000 7fd36bfff640 1 -- 172.21.15.31:0/2828958334 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fd37c01f460 con 0x7fd384132bb0 2023-11-27T17:53:48.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.793+0000 7fd36bfff640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd3700667f0 0x7fd370068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:48.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.793+0000 7fd36bfff640 1 -- 172.21.15.31:0/2828958334 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd37c087020 con 0x7fd384132bb0 2023-11-27T17:53:48.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.793+0000 7fd382ffd640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd3700667f0 0x7fd370068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:48.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.793+0000 7fd382ffd640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd3700667f0 0x7fd370068cb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd3740016e0 tx=0x7fd374009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:48.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.797+0000 7fd36bfff640 1 -- 172.21.15.31:0/2828958334 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fd37c0541e0 con 0x7fd384132bb0 2023-11-27T17:53:48.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.953+0000 7fd389975640 1 -- 172.21.15.31:0/2828958334 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd38404e850 con 0x7fd384132bb0 2023-11-27T17:53:48.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.953+0000 7fd36bfff640 1 -- 172.21.15.31:0/2828958334 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd37c057800 con 0x7fd384132bb0 2023-11-27T17:53:48.959 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-11-27T17:53:48.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.957+0000 7fd389975640 1 -- 172.21.15.31:0/2828958334 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd3700667f0 msgr2=0x7fd370068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.957+0000 7fd389975640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd3700667f0 0x7fd370068cb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd3740016e0 tx=0x7fd374009040 comp rx=0 tx=0).stop 2023-11-27T17:53:48.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.957+0000 7fd389975640 1 -- 172.21.15.31:0/2828958334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd384132bb0 msgr2=0x7fd384133040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:48.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.957+0000 7fd389975640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd384132bb0 0x7fd384133040 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd384070c00 tx=0x7fd37c0119f0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.957+0000 7fd389975640 1 -- 172.21.15.31:0/2828958334 shutdown_connections 2023-11-27T17:53:48.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.957+0000 7fd389975640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fd3700667f0 0x7fd370068cb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.957+0000 7fd389975640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd384132bb0 0x7fd384133040 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.957+0000 7fd389975640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fd38414d1b0 0x7fd384145660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.957+0000 7fd389975640 1 --2- 172.21.15.31:0/2828958334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd36c004050 0x7fd3840b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:48.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.957+0000 7fd389975640 1 -- 172.21.15.31:0/2828958334 >> 172.21.15.31:0/2828958334 conn(0x7fd38406ab60 msgr2=0x7fd3840b9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:48.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.957+0000 7fd389975640 1 -- 172.21.15.31:0/2828958334 shutdown_connections 2023-11-27T17:53:48.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:48.957+0000 7fd389975640 1 -- 172.21.15.31:0/2828958334 wait complete. 2023-11-27T17:53:48.977 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:53:49.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.101+0000 7f8a13348640 1 Processor -- start 2023-11-27T17:53:49.108 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a13348640 1 -- start start 2023-11-27T17:53:49.109 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a13348640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8a0c06cda0 0x7f8a0c14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a13348640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8a0c14b440 0x7f8a0c06b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a13348640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8a0c0b56f0 0x7f8a0c06baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a13348640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0b4d10 con 0x7f8a0c14b440 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a13348640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0b4aa0 con 0x7f8a0c0b56f0 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a13348640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0b5eb0 con 0x7f8a0c06cda0 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a108e3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8a0c14b440 0x7f8a0c06b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a108e3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8a0c14b440 0x7f8a0c06b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42820/0 (socket says 172.21.15.31:42820) 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a108e3640 1 -- 172.21.15.31:0/1571399690 learned_addr learned my addr 172.21.15.31:0/1571399690 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a110e4640 1 --2- 172.21.15.31:0/1571399690 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8a0c06cda0 0x7f8a0c14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a118e5640 1 --2- 172.21.15.31:0/1571399690 >> v2:172.21.15.81:3300/0 conn(0x7f8a0c0b56f0 0x7f8a0c06baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a108e3640 1 -- 172.21.15.31:0/1571399690 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8a0c06cda0 msgr2=0x7f8a0c14f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a108e3640 1 --2- 172.21.15.31:0/1571399690 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8a0c06cda0 0x7f8a0c14f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a108e3640 1 -- 172.21.15.31:0/1571399690 >> v2:172.21.15.81:3300/0 conn(0x7f8a0c0b56f0 msgr2=0x7f8a0c06baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:49.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a108e3640 1 --2- 172.21.15.31:0/1571399690 >> v2:172.21.15.81:3300/0 conn(0x7f8a0c0b56f0 0x7f8a0c06baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.113 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a108e3640 1 -- 172.21.15.31:0/1571399690 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c0b5bd0 con 0x7f8a0c14b440 2023-11-27T17:53:49.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a108e3640 1 --2- 172.21.15.31:0/1571399690 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a0c14b440 0x7f8a0c06b5b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c06db00 tx=0x7f89fc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bffae3e8e1e943 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:49.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a03fff640 1 -- 172.21.15.31:0/1571399690 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0ac410 con 0x7f8a0c14b440 2023-11-27T17:53:49.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a03fff640 1 -- 172.21.15.31:0/1571399690 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc0ac570 con 0x7f8a0c14b440 2023-11-27T17:53:49.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.105+0000 7f8a03fff640 1 -- 172.21.15.31:0/1571399690 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0ac900 con 0x7f8a0c14b440 2023-11-27T17:53:49.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 -- 172.21.15.31:0/1571399690 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a0c14b440 msgr2=0x7f8a0c06b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 --2- 172.21.15.31:0/1571399690 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a0c14b440 0x7f8a0c06b5b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c06db00 tx=0x7f89fc01c500 comp rx=0 tx=0).stop 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 -- 172.21.15.31:0/1571399690 shutdown_connections 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 --2- 172.21.15.31:0/1571399690 >> v2:172.21.15.81:3300/0 conn(0x7f8a0c0b56f0 0x7f8a0c06baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 --2- 172.21.15.31:0/1571399690 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a0c14b440 0x7f8a0c06b5b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 --2- 172.21.15.31:0/1571399690 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8a0c06cda0 0x7f8a0c14f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 -- 172.21.15.31:0/1571399690 >> 172.21.15.31:0/1571399690 conn(0x7f8a0c0bb7d0 msgr2=0x7f8a0c0bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 -- 172.21.15.31:0/1571399690 shutdown_connections 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 -- 172.21.15.31:0/1571399690 wait complete. 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 Processor -- start 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 -- start start 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c06cda0 0x7f8a0c0b9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8a0c0b56f0 0x7f8a0c146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a0c146760 0x7f8a0c1e8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c147570 con 0x7f8a0c146760 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c145d90 con 0x7f8a0c06cda0 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c148ad0 con 0x7f8a0c0b56f0 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a118e5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a0c146760 0x7f8a0c1e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a118e5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a0c146760 0x7f8a0c1e8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42834/0 (socket says 172.21.15.31:42834) 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a118e5640 1 -- 172.21.15.31:0/1606246458 learned_addr learned my addr 172.21.15.31:0/1606246458 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a110e4640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c06cda0 0x7f8a0c0b9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a108e3640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8a0c0b56f0 0x7f8a0c146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a118e5640 1 -- 172.21.15.31:0/1606246458 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8a0c0b56f0 msgr2=0x7f8a0c146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a118e5640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8a0c0b56f0 0x7f8a0c146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a118e5640 1 -- 172.21.15.31:0/1606246458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c06cda0 msgr2=0x7f8a0c0b9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a118e5640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c06cda0 0x7f8a0c0b9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a118e5640 1 -- 172.21.15.31:0/1606246458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0094d0 con 0x7f8a0c146760 2023-11-27T17:53:49.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a118e5640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a0c146760 0x7f8a0c1e8250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400cd50 tx=0x7f8a0400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:49.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a01ffb640 1 -- 172.21.15.31:0/1606246458 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04003ba0 con 0x7f8a0c146760 2023-11-27T17:53:49.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a01ffb640 1 -- 172.21.15.31:0/1606246458 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a04003d00 con 0x7f8a0c146760 2023-11-27T17:53:49.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 -- 172.21.15.31:0/1606246458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c1e7b70 con 0x7f8a0c146760 2023-11-27T17:53:49.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a01ffb640 1 -- 172.21.15.31:0/1606246458 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04004240 con 0x7f8a0c146760 2023-11-27T17:53:49.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.109+0000 7f8a13348640 1 -- 172.21.15.31:0/1606246458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c147a30 con 0x7f8a0c146760 2023-11-27T17:53:49.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.113+0000 7f8a13348640 1 -- 172.21.15.31:0/1606246458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c145f40 con 0x7f8a0c146760 2023-11-27T17:53:49.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.113+0000 7f8a01ffb640 1 -- 172.21.15.31:0/1606246458 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f8a040043a0 con 0x7f8a0c146760 2023-11-27T17:53:49.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.113+0000 7f8a01ffb640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f89f00667f0 0x7f89f0068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.113+0000 7f8a01ffb640 1 -- 172.21.15.31:0/1606246458 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a04012070 con 0x7f8a0c146760 2023-11-27T17:53:49.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.113+0000 7f8a110e4640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f89f00667f0 0x7f89f0068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.113+0000 7f8a110e4640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f89f00667f0 0x7f89f0068cb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800ba30 tx=0x7f8a08008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:49.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.117+0000 7f8a01ffb640 1 -- 172.21.15.31:0/1606246458 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f8a0c145f40 con 0x7f8a0c146760 2023-11-27T17:53:49.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.265+0000 7f8a13348640 1 -- 172.21.15.31:0/1606246458 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a0c145f40 con 0x7f8a0c146760 2023-11-27T17:53:49.270 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.265+0000 7f8a01ffb640 1 -- 172.21.15.31:0/1606246458 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8a0c145f40 con 0x7f8a0c146760 2023-11-27T17:53:49.270 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-11-27T17:53:49.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.269+0000 7f8a13348640 1 -- 172.21.15.31:0/1606246458 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f89f00667f0 msgr2=0x7f89f0068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.269+0000 7f8a13348640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f89f00667f0 0x7f89f0068cb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800ba30 tx=0x7f8a08008040 comp rx=0 tx=0).stop 2023-11-27T17:53:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.269+0000 7f8a13348640 1 -- 172.21.15.31:0/1606246458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a0c146760 msgr2=0x7f8a0c1e8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.269+0000 7f8a13348640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a0c146760 0x7f8a0c1e8250 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400cd50 tx=0x7f8a0400a660 comp rx=0 tx=0).stop 2023-11-27T17:53:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.269+0000 7f8a13348640 1 -- 172.21.15.31:0/1606246458 shutdown_connections 2023-11-27T17:53:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.269+0000 7f8a13348640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f89f00667f0 0x7f89f0068cb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.269+0000 7f8a13348640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a0c146760 0x7f8a0c1e8250 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.269+0000 7f8a13348640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8a0c0b56f0 0x7f8a0c146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.269+0000 7f8a13348640 1 --2- 172.21.15.31:0/1606246458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a0c06cda0 0x7f8a0c0b9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.269+0000 7f8a13348640 1 -- 172.21.15.31:0/1606246458 >> 172.21.15.31:0/1606246458 conn(0x7f8a0c0bb7d0 msgr2=0x7f8a0c0bbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.269+0000 7f8a13348640 1 -- 172.21.15.31:0/1606246458 shutdown_connections 2023-11-27T17:53:49.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.269+0000 7f8a13348640 1 -- 172.21.15.31:0/1606246458 wait complete. 2023-11-27T17:53:49.288 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:53:49.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.405+0000 7fe51a46c640 1 Processor -- start 2023-11-27T17:53:49.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.405+0000 7fe51a46c640 1 -- start start 2023-11-27T17:53:49.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe51a46c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe514143560 0x7fe5140bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe51a46c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe514149c00 0x7fe514153a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe51a46c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe514071260 con 0x7fe51406f1d0 2023-11-27T17:53:49.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe51a46c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe514143940 con 0x7fe514149c00 2023-11-27T17:53:49.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe51a46c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51406f800 con 0x7fe514143560 2023-11-27T17:53:49.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe518a09640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe514149c00 0x7fe514153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe5137fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe51406f1d0 0x7fe5141494f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44818/0 (socket says 172.21.15.31:44818) 2023-11-27T17:53:49.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe5137fe640 1 -- 172.21.15.31:0/4164591408 learned_addr learned my addr 172.21.15.31:0/4164591408 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:49.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe513fff640 1 --2- 172.21.15.31:0/4164591408 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe514143560 0x7fe5140bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe518a09640 1 -- 172.21.15.31:0/4164591408 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe514143560 msgr2=0x7fe5140bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:49.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe518a09640 1 --2- 172.21.15.31:0/4164591408 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe514143560 0x7fe5140bd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe518a09640 1 -- 172.21.15.31:0/4164591408 >> v1:172.21.15.31:6789/0 conn(0x7fe51406f1d0 legacy=0x7fe5141494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe518a09640 1 -- 172.21.15.31:0/4164591408 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51406fae0 con 0x7fe514149c00 2023-11-27T17:53:49.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe512ffd640 1 -- 172.21.15.31:0/4164591408 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427999386 0 0) 0x7fe514071260 con 0x7fe51406f1d0 2023-11-27T17:53:49.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe513fff640 1 --2- 172.21.15.31:0/4164591408 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe514143560 0x7fe5140bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:49.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe518a09640 1 --2- 172.21.15.31:0/4164591408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe514149c00 0x7fe514153a40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe50c0097c0 tx=0x7fe50c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591e9746ea427189 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:49.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe512ffd640 1 -- 172.21.15.31:0/4164591408 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c0ac410 con 0x7fe514149c00 2023-11-27T17:53:49.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe512ffd640 1 -- 172.21.15.31:0/4164591408 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c0ac570 con 0x7fe514149c00 2023-11-27T17:53:49.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe512ffd640 1 -- 172.21.15.31:0/4164591408 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c0ac900 con 0x7fe514149c00 2023-11-27T17:53:49.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe51a46c640 1 -- 172.21.15.31:0/4164591408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe514149c00 msgr2=0x7fe514153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe51a46c640 1 --2- 172.21.15.31:0/4164591408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe514149c00 0x7fe514153a40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe50c0097c0 tx=0x7fe50c01c450 comp rx=0 tx=0).stop 2023-11-27T17:53:49.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe51a46c640 1 -- 172.21.15.31:0/4164591408 shutdown_connections 2023-11-27T17:53:49.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe51a46c640 1 --2- 172.21.15.31:0/4164591408 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe514149c00 0x7fe514153a40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe51a46c640 1 --2- 172.21.15.31:0/4164591408 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe514143560 0x7fe5140bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe51a46c640 1 -- 172.21.15.31:0/4164591408 >> 172.21.15.31:0/4164591408 conn(0x7fe51406ab60 msgr2=0x7fe5140bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:49.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.409+0000 7fe51a46c640 1 -- 172.21.15.31:0/4164591408 shutdown_connections 2023-11-27T17:53:49.416 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe51a46c640 1 -- 172.21.15.31:0/4164591408 wait complete. 2023-11-27T17:53:49.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe51a46c640 1 Processor -- start 2023-11-27T17:53:49.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe51a46c640 1 -- start start 2023-11-27T17:53:49.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe51a46c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51406f1d0 0x7fe5140bc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe51a46c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe514143560 0x7fe5140baa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe51a46c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe514149c00 0x7fe514136c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe51a46c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe514147ae0 con 0x7fe51406f1d0 2023-11-27T17:53:49.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe51a46c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5140b53a0 con 0x7fe514143560 2023-11-27T17:53:49.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe51a46c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5140b5680 con 0x7fe514149c00 2023-11-27T17:53:49.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe513fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51406f1d0 0x7fe5140bc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe513fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51406f1d0 0x7fe5140bc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42844/0 (socket says 172.21.15.31:42844) 2023-11-27T17:53:49.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe513fff640 1 -- 172.21.15.31:0/2831300959 learned_addr learned my addr 172.21.15.31:0/2831300959 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:49.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe518a09640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe514149c00 0x7fe514136c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe5137fe640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe514143560 0x7fe5140baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe513fff640 1 -- 172.21.15.31:0/2831300959 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe514149c00 msgr2=0x7fe514136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe513fff640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe514149c00 0x7fe514136c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe513fff640 1 -- 172.21.15.31:0/2831300959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe514143560 msgr2=0x7fe5140baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe513fff640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe514143560 0x7fe5140baa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe513fff640 1 -- 172.21.15.31:0/2831300959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c009420 con 0x7fe51406f1d0 2023-11-27T17:53:49.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe513fff640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51406f1d0 0x7fe5140bc220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe50400cf60 tx=0x7fe50400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:49.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe510ff9640 1 -- 172.21.15.31:0/2831300959 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50400d840 con 0x7fe51406f1d0 2023-11-27T17:53:49.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe510ff9640 1 -- 172.21.15.31:0/2831300959 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50400d9a0 con 0x7fe51406f1d0 2023-11-27T17:53:49.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe51a46c640 1 -- 172.21.15.31:0/2831300959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe514147d80 con 0x7fe51406f1d0 2023-11-27T17:53:49.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe510ff9640 1 -- 172.21.15.31:0/2831300959 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50400dd30 con 0x7fe51406f1d0 2023-11-27T17:53:49.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe51a46c640 1 -- 172.21.15.31:0/2831300959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5140bc760 con 0x7fe51406f1d0 2023-11-27T17:53:49.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.413+0000 7fe51a46c640 1 -- 172.21.15.31:0/2831300959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe51404e850 con 0x7fe51406f1d0 2023-11-27T17:53:49.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.417+0000 7fe510ff9640 1 -- 172.21.15.31:0/2831300959 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe504015440 con 0x7fe51406f1d0 2023-11-27T17:53:49.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.417+0000 7fe510ff9640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fe4f40667f0 0x7fe4f4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.417+0000 7fe510ff9640 1 -- 172.21.15.31:0/2831300959 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe504084bd0 con 0x7fe51406f1d0 2023-11-27T17:53:49.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.417+0000 7fe5137fe640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fe4f40667f0 0x7fe4f4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.417+0000 7fe5137fe640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fe4f40667f0 0x7fe4f4068cb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe514148b00 tx=0x7fe4fc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:49.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.421+0000 7fe510ff9640 1 -- 172.21.15.31:0/2831300959 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe504051e10 con 0x7fe51406f1d0 2023-11-27T17:53:49.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.577+0000 7fe51a46c640 1 -- 172.21.15.31:0/2831300959 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe514070640 con 0x7fe51406f1d0 2023-11-27T17:53:49.581 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.577+0000 7fe510ff9640 1 -- 172.21.15.31:0/2831300959 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe50401a020 con 0x7fe51406f1d0 2023-11-27T17:53:49.581 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-11-27T17:53:49.583 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.577+0000 7fe51a46c640 1 -- 172.21.15.31:0/2831300959 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fe4f40667f0 msgr2=0x7fe4f4068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.577+0000 7fe51a46c640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fe4f40667f0 0x7fe4f4068cb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe514148b00 tx=0x7fe4fc009040 comp rx=0 tx=0).stop 2023-11-27T17:53:49.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.577+0000 7fe51a46c640 1 -- 172.21.15.31:0/2831300959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51406f1d0 msgr2=0x7fe5140bc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.577+0000 7fe51a46c640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51406f1d0 0x7fe5140bc220 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe50400cf60 tx=0x7fe50400cf90 comp rx=0 tx=0).stop 2023-11-27T17:53:49.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.581+0000 7fe51a46c640 1 -- 172.21.15.31:0/2831300959 shutdown_connections 2023-11-27T17:53:49.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.581+0000 7fe51a46c640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fe4f40667f0 0x7fe4f4068cb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.585 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.581+0000 7fe51a46c640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe514149c00 0x7fe514136c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.581+0000 7fe51a46c640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe514143560 0x7fe5140baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.581+0000 7fe51a46c640 1 --2- 172.21.15.31:0/2831300959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe51406f1d0 0x7fe5140bc220 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.581+0000 7fe51a46c640 1 -- 172.21.15.31:0/2831300959 >> 172.21.15.31:0/2831300959 conn(0x7fe51406ab60 msgr2=0x7fe51413dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:49.586 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.581+0000 7fe51a46c640 1 -- 172.21.15.31:0/2831300959 shutdown_connections 2023-11-27T17:53:49.587 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.581+0000 7fe51a46c640 1 -- 172.21.15.31:0/2831300959 wait complete. 2023-11-27T17:53:49.614 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-11-27T17:53:49.614 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:49.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.725+0000 7f4062b31640 1 Processor -- start 2023-11-27T17:53:49.732 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f4062b31640 1 -- start start 2023-11-27T17:53:49.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f4062b31640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405c0b41c0 0x7f405c14bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f4062b31640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f405c14c270 0x7f405c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f4062b31640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405c0bd950 con 0x7f405c148d50 2023-11-27T17:53:49.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f4062b31640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c149130 con 0x7f405c14c270 2023-11-27T17:53:49.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f4062b31640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c148190 con 0x7f405c0b41c0 2023-11-27T17:53:49.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f40610ce640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f405c14c270 0x7f405c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f40610ce640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f405c14c270 0x7f405c1529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42852/0 (socket says 172.21.15.31:42852) 2023-11-27T17:53:49.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f40610ce640 1 -- 172.21.15.31:0/2312397491 learned_addr learned my addr 172.21.15.31:0/2312397491 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:49.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f405bfff640 1 --2- 172.21.15.31:0/2312397491 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405c0b41c0 0x7f405c14bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f40610ce640 1 -- 172.21.15.31:0/2312397491 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405c0b41c0 msgr2=0x7f405c14bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:49.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f40610ce640 1 --2- 172.21.15.31:0/2312397491 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405c0b41c0 0x7f405c14bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f40610ce640 1 -- 172.21.15.31:0/2312397491 >> v1:172.21.15.81:6789/0 conn(0x7f405c148d50 legacy=0x7f405c0bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:49.734 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f40610ce640 1 -- 172.21.15.31:0/2312397491 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0b4c10 con 0x7f405c14c270 2023-11-27T17:53:49.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f40610ce640 1 --2- 172.21.15.31:0/2312397491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c14c270 0x7f405c1529e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f405400bb10 tx=0x7f40540213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a28533f1243a678 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:49.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f405b7fe640 1 -- 172.21.15.31:0/2312397491 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40540b1600 con 0x7f405c14c270 2023-11-27T17:53:49.735 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f405b7fe640 1 -- 172.21.15.31:0/2312397491 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40540ad050 con 0x7f405c14c270 2023-11-27T17:53:49.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.729+0000 7f405b7fe640 1 -- 172.21.15.31:0/2312397491 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40540b1980 con 0x7f405c14c270 2023-11-27T17:53:49.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 -- 172.21.15.31:0/2312397491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c14c270 msgr2=0x7f405c1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 --2- 172.21.15.31:0/2312397491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c14c270 0x7f405c1529e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f405400bb10 tx=0x7f40540213c0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 -- 172.21.15.31:0/2312397491 shutdown_connections 2023-11-27T17:53:49.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 --2- 172.21.15.31:0/2312397491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c14c270 0x7f405c1529e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 --2- 172.21.15.31:0/2312397491 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405c0b41c0 0x7f405c14bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 -- 172.21.15.31:0/2312397491 >> 172.21.15.31:0/2312397491 conn(0x7f405c06ab60 msgr2=0x7f405c0bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:49.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 -- 172.21.15.31:0/2312397491 shutdown_connections 2023-11-27T17:53:49.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 -- 172.21.15.31:0/2312397491 wait complete. 2023-11-27T17:53:49.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 Processor -- start 2023-11-27T17:53:49.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 -- start start 2023-11-27T17:53:49.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c148d50 0x7f405c1e4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405c14c270 0x7f405c13caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405c13cfe0 0x7f405c0ba930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0bc4c0 con 0x7f405c148d50 2023-11-27T17:53:49.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c1e42c0 con 0x7f405c13cfe0 2023-11-27T17:53:49.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c13d430 con 0x7f405c14c270 2023-11-27T17:53:49.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40608cd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c148d50 0x7f405c1e4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40608cd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c148d50 0x7f405c1e4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42858/0 (socket says 172.21.15.31:42858) 2023-11-27T17:53:49.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40608cd640 1 -- 172.21.15.31:0/2020361632 learned_addr learned my addr 172.21.15.31:0/2020361632 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:49.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40610ce640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405c13cfe0 0x7f405c0ba930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f405bfff640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405c14c270 0x7f405c13caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40608cd640 1 -- 172.21.15.31:0/2020361632 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405c14c270 msgr2=0x7f405c13caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40608cd640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405c14c270 0x7f405c13caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40608cd640 1 -- 172.21.15.31:0/2020361632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405c13cfe0 msgr2=0x7f405c0ba930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40608cd640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405c13cfe0 0x7f405c0ba930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40608cd640 1 -- 172.21.15.31:0/2020361632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405400b770 con 0x7f405c148d50 2023-11-27T17:53:49.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f405bfff640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405c14c270 0x7f405c13caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:49.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40608cd640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c148d50 0x7f405c1e4d30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f404c00c7c0 tx=0x7f404c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:49.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40597fa640 1 -- 172.21.15.31:0/2020361632 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c00aa50 con 0x7f405c148d50 2023-11-27T17:53:49.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40597fa640 1 -- 172.21.15.31:0/2020361632 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c00abb0 con 0x7f405c148d50 2023-11-27T17:53:49.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 -- 172.21.15.31:0/2020361632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c1e4530 con 0x7f405c148d50 2023-11-27T17:53:49.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f40597fa640 1 -- 172.21.15.31:0/2020361632 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c012420 con 0x7f405c148d50 2023-11-27T17:53:49.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.733+0000 7f4062b31640 1 -- 172.21.15.31:0/2020361632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c13ff20 con 0x7f405c148d50 2023-11-27T17:53:49.741 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.737+0000 7f4062b31640 1 -- 172.21.15.31:0/2020361632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c04e850 con 0x7f405c148d50 2023-11-27T17:53:49.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.737+0000 7f40597fa640 1 -- 172.21.15.31:0/2020361632 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f404c012580 con 0x7f405c148d50 2023-11-27T17:53:49.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.737+0000 7f40597fa640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f4048066820 0x7f4048068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:49.742 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.737+0000 7f40597fa640 1 -- 172.21.15.31:0/2020361632 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f404c084440 con 0x7f405c148d50 2023-11-27T17:53:49.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.737+0000 7f405bfff640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f4048066820 0x7f4048068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:49.743 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.737+0000 7f405bfff640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f4048066820 0x7f4048068ce0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f405c141120 tx=0x7f4050008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:49.745 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.741+0000 7f40597fa640 1 -- 172.21.15.31:0/2020361632 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f404c0515d0 con 0x7f405c148d50 2023-11-27T17:53:49.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.909+0000 7f4062b31640 1 -- 172.21.15.31:0/2020361632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f405c1e49e0 con 0x7f405c148d50 2023-11-27T17:53:49.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f40597fa640 1 -- 172.21.15.31:0/2020361632 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7f404c054bf0 con 0x7f405c148d50 2023-11-27T17:53:49.918 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:49.918 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:49.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f4062b31640 1 -- 172.21.15.31:0/2020361632 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f4048066820 msgr2=0x7f4048068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f4062b31640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f4048066820 0x7f4048068ce0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f405c141120 tx=0x7f4050008040 comp rx=0 tx=0).stop 2023-11-27T17:53:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f4062b31640 1 -- 172.21.15.31:0/2020361632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c148d50 msgr2=0x7f405c1e4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f4062b31640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c148d50 0x7f405c1e4d30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f404c00c7c0 tx=0x7f404c00cc80 comp rx=0 tx=0).stop 2023-11-27T17:53:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f4062b31640 1 -- 172.21.15.31:0/2020361632 shutdown_connections 2023-11-27T17:53:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f4062b31640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f4048066820 0x7f4048068ce0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f4062b31640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f405c13cfe0 0x7f405c0ba930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f4062b31640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f405c14c270 0x7f405c13caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f4062b31640 1 --2- 172.21.15.31:0/2020361632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f405c148d50 0x7f405c1e4d30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f4062b31640 1 -- 172.21.15.31:0/2020361632 >> 172.21.15.31:0/2020361632 conn(0x7f405c06ab60 msgr2=0x7f405c0a22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:49.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f4062b31640 1 -- 172.21.15.31:0/2020361632 shutdown_connections 2023-11-27T17:53:49.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:49.913+0000 7f4062b31640 1 -- 172.21.15.31:0/2020361632 wait complete. 2023-11-27T17:53:49.934 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:53:11.177026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:53:21.543531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:53:22.362977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:53:49.935 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:53:50.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.049+0000 7f1735e5b640 1 Processor -- start 2023-11-27T17:53:50.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.049+0000 7f1735e5b640 1 -- start start 2023-11-27T17:53:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f1735e5b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1730149c00 0x7f1730154a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.057 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f1735e5b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1730071260 con 0x7f1730143560 2023-11-27T17:53:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f1735e5b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1730143940 con 0x7f173006f1d0 2023-11-27T17:53:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f1735e5b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17300bd950 con 0x7f1730149c00 2023-11-27T17:53:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172f7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1730143560 0x7f17300bd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44832/0 (socket says 172.21.15.31:44832) 2023-11-27T17:53:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172f7fe640 1 -- 172.21.15.31:0/3312547174 learned_addr learned my addr 172.21.15.31:0/3312547174 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172ffff640 1 --2- 172.21.15.31:0/3312547174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1730149c00 0x7f1730154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143042760 0 0) 0x7f1730071260 con 0x7f1730143560 2023-11-27T17:53:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f171c003530 con 0x7f1730143560 2023-11-27T17:53:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2522458847 0 0) 0x7f171c003530 con 0x7f1730143560 2023-11-27T17:53:50.058 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1730149c00 msgr2=0x7f1730154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:50.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 --2- 172.21.15.31:0/3312547174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1730149c00 0x7f1730154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 >> v1:172.21.15.81:6789/0 conn(0x7f173006f1d0 legacy=0x7f17301494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173006f800 con 0x7f1730143560 2023-11-27T17:53:50.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f1728001a00 con 0x7f1730143560 2023-11-27T17:53:50.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 >> v1:172.21.15.31:6789/0 conn(0x7f1730143560 legacy=0x7f17300bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 --2- 172.21.15.31:0/3312547174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1730149c00 0x7f171c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 --2- 172.21.15.31:0/3312547174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c003fa0 0x7f171c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 --2- 172.21.15.31:0/3312547174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f171c004d10 0x7f171c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17300bd950 con 0x7f171c004d10 2023-11-27T17:53:50.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171c00baf0 con 0x7f171c003fa0 2023-11-27T17:53:50.059 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171c00bcb0 con 0x7f1730149c00 2023-11-27T17:53:50.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172ffff640 1 --2- 172.21.15.31:0/3312547174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f171c004d10 0x7f171c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172effd640 1 --2- 172.21.15.31:0/3312547174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c003fa0 0x7f171c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172ffff640 1 -- 172.21.15.31:0/3312547174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1730149c00 msgr2=0x7f171c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:50.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172ffff640 1 --2- 172.21.15.31:0/3312547174 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1730149c00 0x7f171c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172ffff640 1 -- 172.21.15.31:0/3312547174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c003fa0 msgr2=0x7f171c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:50.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172ffff640 1 --2- 172.21.15.31:0/3312547174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c003fa0 0x7f171c0047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.060 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172ffff640 1 -- 172.21.15.31:0/3312547174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c003530 con 0x7f171c004d10 2023-11-27T17:53:50.063 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.053+0000 7f172ffff640 1 --2- 172.21.15.31:0/3312547174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f171c004d10 0x7f171c005190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1720009ae0 tx=0x7f172001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6bb2695f71100 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:50.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200a5680 con 0x7f171c004d10 2023-11-27T17:53:50.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17200a57e0 con 0x7f171c004d10 2023-11-27T17:53:50.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172e7fc640 1 -- 172.21.15.31:0/3312547174 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17200a5b90 con 0x7f171c004d10 2023-11-27T17:53:50.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 -- 172.21.15.31:0/3312547174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f171c004d10 msgr2=0x7f171c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 --2- 172.21.15.31:0/3312547174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f171c004d10 0x7f171c005190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1720009ae0 tx=0x7f172001ca90 comp rx=0 tx=0).stop 2023-11-27T17:53:50.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172ffff640 1 -- 172.21.15.31:0/3312547174 reap_dead start 2023-11-27T17:53:50.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 -- 172.21.15.31:0/3312547174 shutdown_connections 2023-11-27T17:53:50.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 -- 172.21.15.31:0/3312547174 >> 172.21.15.31:0/3312547174 conn(0x7f173006ab60 msgr2=0x7f17300bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:50.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 -- 172.21.15.31:0/3312547174 shutdown_connections 2023-11-27T17:53:50.064 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 -- 172.21.15.31:0/3312547174 wait complete. 2023-11-27T17:53:50.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 Processor -- start 2023-11-27T17:53:50.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 -- start start 2023-11-27T17:53:50.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c004d10 0x7f1730142680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1730143e40 0x7f17301e1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17301e2140 0x7f1730148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1730143c10 con 0x7f1730143e40 2023-11-27T17:53:50.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1730142bc0 con 0x7f171c004d10 2023-11-27T17:53:50.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17300b8a70 con 0x7f17301e2140 2023-11-27T17:53:50.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1730143e40 0x7f17301e1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172effd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1730143e40 0x7f17301e1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42868/0 (socket says 172.21.15.31:42868) 2023-11-27T17:53:50.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172effd640 1 -- 172.21.15.31:0/922775510 learned_addr learned my addr 172.21.15.31:0/922775510 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:50.065 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172ffff640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17301e2140 0x7f1730148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172f7fe640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c004d10 0x7f1730142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172effd640 1 -- 172.21.15.31:0/922775510 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17301e2140 msgr2=0x7f1730148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172effd640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17301e2140 0x7f1730148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172effd640 1 -- 172.21.15.31:0/922775510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c004d10 msgr2=0x7f1730142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172effd640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c004d10 0x7f1730142680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172effd640 1 -- 172.21.15.31:0/922775510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17301e25c0 con 0x7f1730143e40 2023-11-27T17:53:50.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172f7fe640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c004d10 0x7f1730142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:50.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f172effd640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1730143e40 0x7f17301e1c00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f171800d770 tx=0x7f171800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:50.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1727fff640 1 -- 172.21.15.31:0/922775510 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718005270 con 0x7f1730143e40 2023-11-27T17:53:50.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1727fff640 1 -- 172.21.15.31:0/922775510 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17180053d0 con 0x7f1730143e40 2023-11-27T17:53:50.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 -- 172.21.15.31:0/922775510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17301d57b0 con 0x7f1730143e40 2023-11-27T17:53:50.066 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1727fff640 1 -- 172.21.15.31:0/922775510 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800b8b0 con 0x7f1730143e40 2023-11-27T17:53:50.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 -- 172.21.15.31:0/922775510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1730144600 con 0x7f1730143e40 2023-11-27T17:53:50.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.057+0000 7f1735e5b640 1 -- 172.21.15.31:0/922775510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17301d55e0 con 0x7f1730143e40 2023-11-27T17:53:50.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.061+0000 7f1727fff640 1 -- 172.21.15.31:0/922775510 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f171800ba10 con 0x7f1730143e40 2023-11-27T17:53:50.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.061+0000 7f1727fff640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17100667f0 0x7f1710068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.067 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.061+0000 7f1727fff640 1 -- 172.21.15.31:0/922775510 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17180840e0 con 0x7f1730143e40 2023-11-27T17:53:50.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.061+0000 7f172f7fe640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17100667f0 0x7f1710068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.061+0000 7f172f7fe640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17100667f0 0x7f1710068cb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1728007fd0 tx=0x7f1728009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:50.068 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.065+0000 7f1727fff640 1 -- 172.21.15.31:0/922775510 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1718051270 con 0x7f1730143e40 2023-11-27T17:53:50.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 -- 172.21.15.31:0/922775510 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f173004e850 con 0x7f1730143e40 2023-11-27T17:53:50.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1727fff640 1 -- 172.21.15.31:0/922775510 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1718019310 con 0x7f1730143e40 2023-11-27T17:53:50.220 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-11-27T17:53:50.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 -- 172.21.15.31:0/922775510 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17100667f0 msgr2=0x7f1710068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17100667f0 0x7f1710068cb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1728007fd0 tx=0x7f1728009040 comp rx=0 tx=0).stop 2023-11-27T17:53:50.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 -- 172.21.15.31:0/922775510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1730143e40 msgr2=0x7f17301e1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1730143e40 0x7f17301e1c00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f171800d770 tx=0x7f171800dc30 comp rx=0 tx=0).stop 2023-11-27T17:53:50.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 -- 172.21.15.31:0/922775510 shutdown_connections 2023-11-27T17:53:50.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f17100667f0 0x7f1710068cb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f17301e2140 0x7f1730148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1730143e40 0x7f17301e1c00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 --2- 172.21.15.31:0/922775510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f171c004d10 0x7f1730142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 -- 172.21.15.31:0/922775510 >> 172.21.15.31:0/922775510 conn(0x7f173006ab60 msgr2=0x7f17300b77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:50.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 -- 172.21.15.31:0/922775510 shutdown_connections 2023-11-27T17:53:50.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.217+0000 7f1735e5b640 1 -- 172.21.15.31:0/922775510 wait complete. 2023-11-27T17:53:50.240 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:53:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.349+0000 7f0035f58640 1 Processor -- start 2023-11-27T17:53:50.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.349+0000 7f0035f58640 1 -- start start 2023-11-27T17:53:50.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f0035f58640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0030143560 0x7f00300bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f0035f58640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f003006f1d0 0x7f00301494f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f0035f58640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0030071260 con 0x7f0030149a30 2023-11-27T17:53:50.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f0035f58640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0030143940 con 0x7f0030143560 2023-11-27T17:53:50.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f0035f58640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0030149ec0 con 0x7f003006f1d0 2023-11-27T17:53:50.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002f7fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0030143560 0x7f00300bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002ffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0030149a30 0x7f003014c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44836/0 (socket says 172.21.15.31:44836) 2023-11-27T17:53:50.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002ffff640 1 -- 172.21.15.31:0/4269482563 learned_addr learned my addr 172.21.15.31:0/4269482563 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:50.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002effd640 1 --2- 172.21.15.31:0/4269482563 >> v2:172.21.15.81:3300/0 conn(0x7f003006f1d0 0x7f00301494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.357 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002f7fe640 1 -- 172.21.15.31:0/4269482563 >> v2:172.21.15.81:3300/0 conn(0x7f003006f1d0 msgr2=0x7f00301494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002f7fe640 1 --2- 172.21.15.31:0/4269482563 >> v2:172.21.15.81:3300/0 conn(0x7f003006f1d0 0x7f00301494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002f7fe640 1 -- 172.21.15.31:0/4269482563 >> v1:172.21.15.31:6789/0 conn(0x7f0030149a30 legacy=0x7f003014c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002f7fe640 1 -- 172.21.15.31:0/4269482563 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003006f800 con 0x7f0030143560 2023-11-27T17:53:50.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002e7fc640 1 -- 172.21.15.31:0/4269482563 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007935255 0 0) 0x7f0030071260 con 0x7f0030149a30 2023-11-27T17:53:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002f7fe640 1 --2- 172.21.15.31:0/4269482563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0030143560 0x7f00300bd240 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00300b6d70 tx=0x7f002001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88234318e589876a server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002e7fc640 1 -- 172.21.15.31:0/4269482563 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020004230 con 0x7f0030143560 2023-11-27T17:53:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002e7fc640 1 -- 172.21.15.31:0/4269482563 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00200a7050 con 0x7f0030143560 2023-11-27T17:53:50.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.353+0000 7f002e7fc640 1 -- 172.21.15.31:0/4269482563 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020003620 con 0x7f0030143560 2023-11-27T17:53:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 -- 172.21.15.31:0/4269482563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0030143560 msgr2=0x7f00300bd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 --2- 172.21.15.31:0/4269482563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0030143560 0x7f00300bd240 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f00300b6d70 tx=0x7f002001c430 comp rx=0 tx=0).stop 2023-11-27T17:53:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 -- 172.21.15.31:0/4269482563 shutdown_connections 2023-11-27T17:53:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 --2- 172.21.15.31:0/4269482563 >> v2:172.21.15.81:3300/0 conn(0x7f003006f1d0 0x7f00301494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 --2- 172.21.15.31:0/4269482563 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0030143560 0x7f00300bd240 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 -- 172.21.15.31:0/4269482563 >> 172.21.15.31:0/4269482563 conn(0x7f003006ab60 msgr2=0x7f00300bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 -- 172.21.15.31:0/4269482563 shutdown_connections 2023-11-27T17:53:50.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 -- 172.21.15.31:0/4269482563 wait complete. 2023-11-27T17:53:50.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 Processor -- start 2023-11-27T17:53:50.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 -- start start 2023-11-27T17:53:50.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f003006f1d0 0x7f0030139140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0030143560 0x7f00300b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0030149a30 0x7f00300b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00301545e0 con 0x7f0030149a30 2023-11-27T17:53:50.363 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0030139680 con 0x7f003006f1d0 2023-11-27T17:53:50.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0030153ff0 con 0x7f0030143560 2023-11-27T17:53:50.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f002ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0030149a30 0x7f00300b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f002ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0030149a30 0x7f00300b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42890/0 (socket says 172.21.15.31:42890) 2023-11-27T17:53:50.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f002ffff640 1 -- 172.21.15.31:0/1238773089 learned_addr learned my addr 172.21.15.31:0/1238773089 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:50.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f002effd640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0030143560 0x7f00300b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f002f7fe640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f003006f1d0 0x7f0030139140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f002ffff640 1 -- 172.21.15.31:0/1238773089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0030143560 msgr2=0x7f00300b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f002ffff640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0030143560 0x7f00300b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f002ffff640 1 -- 172.21.15.31:0/1238773089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f003006f1d0 msgr2=0x7f0030139140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f002ffff640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f003006f1d0 0x7f0030139140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f002ffff640 1 -- 172.21.15.31:0/1238773089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0020009420 con 0x7f0030149a30 2023-11-27T17:53:50.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f002ffff640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0030149a30 0x7f00300b5900 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f002800c3c0 tx=0x7f002800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:50.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0017fff640 1 -- 172.21.15.31:0/1238773089 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00280074e0 con 0x7f0030149a30 2023-11-27T17:53:50.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0017fff640 1 -- 172.21.15.31:0/1238773089 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0028007640 con 0x7f0030149a30 2023-11-27T17:53:50.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 -- 172.21.15.31:0/1238773089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0030147f70 con 0x7f0030149a30 2023-11-27T17:53:50.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0017fff640 1 -- 172.21.15.31:0/1238773089 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0028004a30 con 0x7f0030149a30 2023-11-27T17:53:50.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.357+0000 7f0035f58640 1 -- 172.21.15.31:0/1238773089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0030154200 con 0x7f0030149a30 2023-11-27T17:53:50.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.361+0000 7f0035f58640 1 -- 172.21.15.31:0/1238773089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003004e850 con 0x7f0030149a30 2023-11-27T17:53:50.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.361+0000 7f0017fff640 1 -- 172.21.15.31:0/1238773089 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f0028004b90 con 0x7f0030149a30 2023-11-27T17:53:50.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.361+0000 7f0017fff640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f001c0667f0 0x7f001c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.361+0000 7f0017fff640 1 -- 172.21.15.31:0/1238773089 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0028083fb0 con 0x7f0030149a30 2023-11-27T17:53:50.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.361+0000 7f002f7fe640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f001c0667f0 0x7f001c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.361+0000 7f002f7fe640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f001c0667f0 0x7f001c068cb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f00200ad000 tx=0x7f0020008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:50.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.365+0000 7f0017fff640 1 -- 172.21.15.31:0/1238773089 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f00280b5280 con 0x7f0030149a30 2023-11-27T17:53:50.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.513+0000 7f0035f58640 1 -- 172.21.15.31:0/1238773089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f003013ded0 con 0x7f0030149a30 2023-11-27T17:53:50.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.513+0000 7f0017fff640 1 -- 172.21.15.31:0/1238773089 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0028054b40 con 0x7f0030149a30 2023-11-27T17:53:50.518 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-11-27T17:53:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.517+0000 7f0035f58640 1 -- 172.21.15.31:0/1238773089 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f001c0667f0 msgr2=0x7f001c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.517+0000 7f0035f58640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f001c0667f0 0x7f001c068cb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f00200ad000 tx=0x7f0020008040 comp rx=0 tx=0).stop 2023-11-27T17:53:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.517+0000 7f0035f58640 1 -- 172.21.15.31:0/1238773089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0030149a30 msgr2=0x7f00300b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.517+0000 7f0035f58640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0030149a30 0x7f00300b5900 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f002800c3c0 tx=0x7f002800c880 comp rx=0 tx=0).stop 2023-11-27T17:53:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.517+0000 7f0035f58640 1 -- 172.21.15.31:0/1238773089 shutdown_connections 2023-11-27T17:53:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.517+0000 7f0035f58640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f001c0667f0 0x7f001c068cb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.517+0000 7f0035f58640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0030149a30 0x7f00300b5900 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.517+0000 7f0035f58640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0030143560 0x7f00300b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.517+0000 7f0035f58640 1 --2- 172.21.15.31:0/1238773089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f003006f1d0 0x7f0030139140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.517+0000 7f0035f58640 1 -- 172.21.15.31:0/1238773089 >> 172.21.15.31:0/1238773089 conn(0x7f003006ab60 msgr2=0x7f00300bce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.517+0000 7f0035f58640 1 -- 172.21.15.31:0/1238773089 shutdown_connections 2023-11-27T17:53:50.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.517+0000 7f0035f58640 1 -- 172.21.15.31:0/1238773089 wait complete. 2023-11-27T17:53:50.536 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:53:50.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.657+0000 7f0c2de3f640 1 Processor -- start 2023-11-27T17:53:50.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.657+0000 7f0c2de3f640 1 -- start start 2023-11-27T17:53:50.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c2de3f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c280bd4a0 0x7f0c280b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c2de3f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c28145240 0x7f0c28145660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c2de3f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c280b5fe0 con 0x7f0c2814eb60 2023-11-27T17:53:50.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c2de3f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c280b6420 con 0x7f0c280bd4a0 2023-11-27T17:53:50.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c2de3f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280b56b0 con 0x7f0c28145240 2023-11-27T17:53:50.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c277fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c280bd4a0 0x7f0c280b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c277fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c280bd4a0 0x7f0c280b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42900/0 (socket says 172.21.15.31:42900) 2023-11-27T17:53:50.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c277fe640 1 -- 172.21.15.31:0/3635044116 learned_addr learned my addr 172.21.15.31:0/3635044116 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:50.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c26ffd640 1 --2- 172.21.15.31:0/3635044116 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c28145240 0x7f0c28145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c277fe640 1 -- 172.21.15.31:0/3635044116 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c28145240 msgr2=0x7f0c28145660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:50.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c277fe640 1 --2- 172.21.15.31:0/3635044116 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c28145240 0x7f0c28145660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c277fe640 1 -- 172.21.15.31:0/3635044116 >> v1:172.21.15.81:6789/0 conn(0x7f0c2814eb60 legacy=0x7f0c2814efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:50.666 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c277fe640 1 -- 172.21.15.31:0/3635044116 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c280b5990 con 0x7f0c280bd4a0 2023-11-27T17:53:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c277fe640 1 --2- 172.21.15.31:0/3635044116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c280bd4a0 0x7f0c280b4030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009e50 tx=0x7f0c2001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767982016ca81ab4 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c267fc640 1 -- 172.21.15.31:0/3635044116 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c200a57b0 con 0x7f0c280bd4a0 2023-11-27T17:53:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c267fc640 1 -- 172.21.15.31:0/3635044116 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c200a5910 con 0x7f0c280bd4a0 2023-11-27T17:53:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.661+0000 7f0c267fc640 1 -- 172.21.15.31:0/3635044116 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c200a5ca0 con 0x7f0c280bd4a0 2023-11-27T17:53:50.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3635044116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c280bd4a0 msgr2=0x7f0c280b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 --2- 172.21.15.31:0/3635044116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c280bd4a0 0x7f0c280b4030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009e50 tx=0x7f0c2001c910 comp rx=0 tx=0).stop 2023-11-27T17:53:50.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3635044116 shutdown_connections 2023-11-27T17:53:50.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 --2- 172.21.15.31:0/3635044116 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c28145240 0x7f0c28145660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 --2- 172.21.15.31:0/3635044116 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c280bd4a0 0x7f0c280b4030 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3635044116 >> 172.21.15.31:0/3635044116 conn(0x7f0c2806ab60 msgr2=0x7f0c280bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:50.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3635044116 shutdown_connections 2023-11-27T17:53:50.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3635044116 wait complete. 2023-11-27T17:53:50.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 Processor -- start 2023-11-27T17:53:50.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 -- start start 2023-11-27T17:53:50.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c280bd4a0 0x7f0c2814d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c28145240 0x7f0c28146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c2814eb60 0x7f0c2814aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2814d8d0 con 0x7f0c2814eb60 2023-11-27T17:53:50.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c281479a0 con 0x7f0c28145240 2023-11-27T17:53:50.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2814ddb0 con 0x7f0c280bd4a0 2023-11-27T17:53:50.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c27fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c2814eb60 0x7f0c2814aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c27fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c2814eb60 0x7f0c2814aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42906/0 (socket says 172.21.15.31:42906) 2023-11-27T17:53:50.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c27fff640 1 -- 172.21.15.31:0/3094348812 learned_addr learned my addr 172.21.15.31:0/3094348812 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:50.671 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c277fe640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c280bd4a0 0x7f0c2814d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c26ffd640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c28145240 0x7f0c28146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c27fff640 1 -- 172.21.15.31:0/3094348812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c280bd4a0 msgr2=0x7f0c2814d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c27fff640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c280bd4a0 0x7f0c2814d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c27fff640 1 -- 172.21.15.31:0/3094348812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c28145240 msgr2=0x7f0c28146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c27fff640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c28145240 0x7f0c28146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c27fff640 1 -- 172.21.15.31:0/3094348812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c20009b30 con 0x7f0c2814eb60 2023-11-27T17:53:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c27fff640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c2814eb60 0x7f0c2814aaa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800b410 tx=0x7f0c1800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c0ffff640 1 -- 172.21.15.31:0/3094348812 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18011830 con 0x7f0c2814eb60 2023-11-27T17:53:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c0ffff640 1 -- 172.21.15.31:0/3094348812 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c180119d0 con 0x7f0c2814eb60 2023-11-27T17:53:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3094348812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c28145f30 con 0x7f0c2814eb60 2023-11-27T17:53:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c0ffff640 1 -- 172.21.15.31:0/3094348812 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18011d80 con 0x7f0c2814eb60 2023-11-27T17:53:50.672 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.665+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3094348812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2814bed0 con 0x7f0c2814eb60 2023-11-27T17:53:50.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.669+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3094348812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c28146350 con 0x7f0c2814eb60 2023-11-27T17:53:50.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.669+0000 7f0c0ffff640 1 -- 172.21.15.31:0/3094348812 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f0c180193b0 con 0x7f0c2814eb60 2023-11-27T17:53:50.673 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.669+0000 7f0c0ffff640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0c140667f0 0x7f0c14068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.669+0000 7f0c0ffff640 1 -- 172.21.15.31:0/3094348812 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c18083f40 con 0x7f0c2814eb60 2023-11-27T17:53:50.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.669+0000 7f0c277fe640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0c140667f0 0x7f0c14068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.674 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.669+0000 7f0c277fe640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0c140667f0 0x7f0c14068cb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0c200ae000 tx=0x7f0c200a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:50.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.673+0000 7f0c0ffff640 1 -- 172.21.15.31:0/3094348812 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f0c28146350 con 0x7f0c2814eb60 2023-11-27T17:53:50.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.821+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3094348812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c28146350 con 0x7f0c2814eb60 2023-11-27T17:53:50.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.821+0000 7f0c0ffff640 1 -- 172.21.15.31:0/3094348812 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c28146350 con 0x7f0c2814eb60 2023-11-27T17:53:50.826 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-11-27T17:53:50.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.825+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3094348812 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0c140667f0 msgr2=0x7f0c14068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.825+0000 7f0c2de3f640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0c140667f0 0x7f0c14068cb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0c200ae000 tx=0x7f0c200a7070 comp rx=0 tx=0).stop 2023-11-27T17:53:50.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.825+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3094348812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c2814eb60 msgr2=0x7f0c2814aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.825+0000 7f0c2de3f640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c2814eb60 0x7f0c2814aaa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800b410 tx=0x7f0c1800b8d0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.825+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3094348812 shutdown_connections 2023-11-27T17:53:50.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.825+0000 7f0c2de3f640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0c140667f0 0x7f0c14068cb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.825+0000 7f0c2de3f640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c2814eb60 0x7f0c2814aaa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.825+0000 7f0c2de3f640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c28145240 0x7f0c28146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.829 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.825+0000 7f0c2de3f640 1 --2- 172.21.15.31:0/3094348812 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0c280bd4a0 0x7f0c2814d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.825+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3094348812 >> 172.21.15.31:0/3094348812 conn(0x7f0c2806ab60 msgr2=0x7f0c280b85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:50.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.825+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3094348812 shutdown_connections 2023-11-27T17:53:50.830 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.825+0000 7f0c2de3f640 1 -- 172.21.15.31:0/3094348812 wait complete. 2023-11-27T17:53:50.844 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-11-27T17:53:50.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b92e5640 1 Processor -- start 2023-11-27T17:53:50.956 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b92e5640 1 -- start start 2023-11-27T17:53:50.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b92e5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58b40b7480 0x7f58b414e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b92e5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58b40b5fd0 0x7f58b414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b92e5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b4145ad0 con 0x7f58b41456f0 2023-11-27T17:53:50.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b92e5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b40bbcf0 con 0x7f58b40b7480 2023-11-27T17:53:50.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b92e5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b40b66c0 con 0x7f58b40b5fd0 2023-11-27T17:53:50.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b27fc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f58b40b7480 0x7f58b414e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b2ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f58b41456f0 0x7f58b40bb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44838/0 (socket says 172.21.15.31:44838) 2023-11-27T17:53:50.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b2ffd640 1 -- 172.21.15.31:0/3710121192 learned_addr learned my addr 172.21.15.31:0/3710121192 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:50.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b27fc640 1 -- 172.21.15.31:0/3710121192 >> v2:172.21.15.81:3300/0 conn(0x7f58b40b5fd0 msgr2=0x7f58b414eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:50.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b27fc640 1 --2- 172.21.15.31:0/3710121192 >> v2:172.21.15.81:3300/0 conn(0x7f58b40b5fd0 0x7f58b414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b27fc640 1 -- 172.21.15.31:0/3710121192 >> v1:172.21.15.31:6789/0 conn(0x7f58b41456f0 legacy=0x7f58b40bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b27fc640 1 -- 172.21.15.31:0/3710121192 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b40b69a0 con 0x7f58b40b7480 2023-11-27T17:53:50.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.953+0000 7f58b27fc640 1 --2- 172.21.15.31:0/3710121192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58b40b7480 0x7f58b414e990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f58b40bb280 tx=0x7f58a401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6dce14fc35c5b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:50.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b1ffb640 1 -- 172.21.15.31:0/3710121192 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40ab650 con 0x7f58b40b7480 2023-11-27T17:53:50.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b1ffb640 1 -- 172.21.15.31:0/3710121192 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a40ab7b0 con 0x7f58b40b7480 2023-11-27T17:53:50.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b1ffb640 1 -- 172.21.15.31:0/3710121192 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40abb40 con 0x7f58b40b7480 2023-11-27T17:53:50.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 -- 172.21.15.31:0/3710121192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58b40b7480 msgr2=0x7f58b414e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 --2- 172.21.15.31:0/3710121192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58b40b7480 0x7f58b414e990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f58b40bb280 tx=0x7f58a401c430 comp rx=0 tx=0).stop 2023-11-27T17:53:50.960 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 -- 172.21.15.31:0/3710121192 shutdown_connections 2023-11-27T17:53:50.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 --2- 172.21.15.31:0/3710121192 >> v2:172.21.15.81:3300/0 conn(0x7f58b40b5fd0 0x7f58b414eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 --2- 172.21.15.31:0/3710121192 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58b40b7480 0x7f58b414e990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 -- 172.21.15.31:0/3710121192 >> 172.21.15.31:0/3710121192 conn(0x7f58b40bd6e0 msgr2=0x7f58b40bdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:50.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 -- 172.21.15.31:0/3710121192 shutdown_connections 2023-11-27T17:53:50.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 -- 172.21.15.31:0/3710121192 wait complete. 2023-11-27T17:53:50.961 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 Processor -- start 2023-11-27T17:53:50.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 -- start start 2023-11-27T17:53:50.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b40b5fd0 0x7f58b4137320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.963 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58b40b7480 0x7f58b413ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b41456f0 0x7f58b40bfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b41e3e90 con 0x7f58b40b7480 2023-11-27T17:53:50.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b41e7850 con 0x7f58b40b5fd0 2023-11-27T17:53:50.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b41e7af0 con 0x7f58b41456f0 2023-11-27T17:53:50.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b27fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58b40b7480 0x7f58b413ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b27fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58b40b7480 0x7f58b413ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42928/0 (socket says 172.21.15.31:42928) 2023-11-27T17:53:50.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b27fc640 1 -- 172.21.15.31:0/2855510947 learned_addr learned my addr 172.21.15.31:0/2855510947 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:50.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b2ffd640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b40b5fd0 0x7f58b4137320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b37fe640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b41456f0 0x7f58b40bfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b27fc640 1 -- 172.21.15.31:0/2855510947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b41456f0 msgr2=0x7f58b40bfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.964 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b27fc640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b41456f0 0x7f58b40bfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b27fc640 1 -- 172.21.15.31:0/2855510947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b40b5fd0 msgr2=0x7f58b4137320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:50.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b27fc640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b40b5fd0 0x7f58b4137320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:50.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b27fc640 1 -- 172.21.15.31:0/2855510947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4009420 con 0x7f58b40b7480 2023-11-27T17:53:50.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b2ffd640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b40b5fd0 0x7f58b4137320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:50.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b27fc640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58b40b7480 0x7f58b413ed10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f58a40ad040 tx=0x7f58a401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:50.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f589b7fe640 1 -- 172.21.15.31:0/2855510947 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40b5810 con 0x7f58b40b7480 2023-11-27T17:53:50.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f589b7fe640 1 -- 172.21.15.31:0/2855510947 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a40b5990 con 0x7f58b40b7480 2023-11-27T17:53:50.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 -- 172.21.15.31:0/2855510947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b41e7dd0 con 0x7f58b40b7480 2023-11-27T17:53:50.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f589b7fe640 1 -- 172.21.15.31:0/2855510947 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40b5d40 con 0x7f58b40b7480 2023-11-27T17:53:50.965 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.957+0000 7f58b92e5640 1 -- 172.21.15.31:0/2855510947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b413a7a0 con 0x7f58b40b7480 2023-11-27T17:53:50.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.961+0000 7f58b92e5640 1 -- 172.21.15.31:0/2855510947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b4066f60 con 0x7f58b40b7480 2023-11-27T17:53:50.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.961+0000 7f589b7fe640 1 -- 172.21.15.31:0/2855510947 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f58a40b4390 con 0x7f58b40b7480 2023-11-27T17:53:50.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.961+0000 7f589b7fe640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f58a00667f0 0x7f58a0068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:50.966 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.961+0000 7f589b7fe640 1 -- 172.21.15.31:0/2855510947 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58a411f040 con 0x7f58b40b7480 2023-11-27T17:53:50.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.961+0000 7f58b2ffd640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f58a00667f0 0x7f58a0068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:50.967 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.961+0000 7f58b2ffd640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f58a00667f0 0x7f58a0068cb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f58a8005890 tx=0x7f58a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:50.969 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:50.965+0000 7f589b7fe640 1 -- 172.21.15.31:0/2855510947 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f58a40ec030 con 0x7f58b40b7480 2023-11-27T17:53:51.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.169+0000 7f58b92e5640 1 -- 172.21.15.31:0/2855510947 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f58b41e8280 con 0x7f58b40b7480 2023-11-27T17:53:51.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.181+0000 7f589b7fe640 1 -- 172.21.15.31:0/2855510947 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v50) v1 ==== 166+0+0 (secure 0 0 0) 0x7f58a40ef650 con 0x7f58b40b7480 2023-11-27T17:53:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.185+0000 7f58b92e5640 1 -- 172.21.15.31:0/2855510947 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f58a00667f0 msgr2=0x7f58a0068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.185+0000 7f58b92e5640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f58a00667f0 0x7f58a0068cb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f58a8005890 tx=0x7f58a8009040 comp rx=0 tx=0).stop 2023-11-27T17:53:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.185+0000 7f58b92e5640 1 -- 172.21.15.31:0/2855510947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58b40b7480 msgr2=0x7f58b413ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.189+0000 7f58b92e5640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58b40b7480 0x7f58b413ed10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f58a40ad040 tx=0x7f58a401ac70 comp rx=0 tx=0).stop 2023-11-27T17:53:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.189+0000 7f58b92e5640 1 -- 172.21.15.31:0/2855510947 shutdown_connections 2023-11-27T17:53:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.189+0000 7f58b92e5640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f58a00667f0 0x7f58a0068cb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.189+0000 7f58b92e5640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f58b41456f0 0x7f58b40bfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.189+0000 7f58b92e5640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f58b40b7480 0x7f58b413ed10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.189+0000 7f58b92e5640 1 --2- 172.21.15.31:0/2855510947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58b40b5fd0 0x7f58b4137320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.189+0000 7f58b92e5640 1 -- 172.21.15.31:0/2855510947 >> 172.21.15.31:0/2855510947 conn(0x7f58b40bd6e0 msgr2=0x7f58b41422f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:51.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.189+0000 7f58b92e5640 1 -- 172.21.15.31:0/2855510947 shutdown_connections 2023-11-27T17:53:51.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.189+0000 7f58b92e5640 1 -- 172.21.15.31:0/2855510947 wait complete. 2023-11-27T17:53:51.208 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-27T17:53:51.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.325+0000 7f6b1de78640 1 Processor -- start 2023-11-27T17:53:51.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.325+0000 7f6b1de78640 1 -- start start 2023-11-27T17:53:51.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b1de78640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b18145240 0x7f6b18145660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b1de78640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b180b4740 con 0x7f6b1814eb60 2023-11-27T17:53:51.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b1de78640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b180b5fe0 con 0x7f6b180bd4a0 2023-11-27T17:53:51.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b1de78640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180b6420 con 0x7f6b18145240 2023-11-27T17:53:51.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b17fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6b1814eb60 0x7f6b1814efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44848/0 (socket says 172.21.15.31:44848) 2023-11-27T17:53:51.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b17fff640 1 -- 172.21.15.31:0/2559679397 learned_addr learned my addr 172.21.15.31:0/2559679397 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:51.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b16ffd640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b18145240 0x7f6b18145660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418583586 0 0) 0x7f6b180b4740 con 0x7f6b1814eb60 2023-11-27T17:53:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b00003530 con 0x7f6b1814eb60 2023-11-27T17:53:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 159654771 0 0) 0x7f6b00003530 con 0x7f6b1814eb60 2023-11-27T17:53:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b18145240 msgr2=0x7f6b18145660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b18145240 0x7f6b18145660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 >> v1:172.21.15.81:6789/0 conn(0x7f6b180bd4a0 legacy=0x7f6b180b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b180b56b0 con 0x7f6b1814eb60 2023-11-27T17:53:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f6b10001a00 con 0x7f6b1814eb60 2023-11-27T17:53:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 >> v1:172.21.15.31:6789/0 conn(0x7f6b1814eb60 legacy=0x7f6b1814efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b00003a20 0x7f6b00003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b000047d0 0x7f6b00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b18145240 0x7f6b00005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180b6420 con 0x7f6b000047d0 2023-11-27T17:53:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0000bb50 con 0x7f6b00003a20 2023-11-27T17:53:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0000bd10 con 0x7f6b18145240 2023-11-27T17:53:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b16ffd640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b000047d0 0x7f6b00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b177fe640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b00003a20 0x7f6b00003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b17fff640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b18145240 0x7f6b00005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b16ffd640 1 -- 172.21.15.31:0/2559679397 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b18145240 msgr2=0x7f6b00005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b16ffd640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b18145240 0x7f6b00005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b16ffd640 1 -- 172.21.15.31:0/2559679397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b00003a20 msgr2=0x7f6b00003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b16ffd640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b00003a20 0x7f6b00003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b16ffd640 1 -- 172.21.15.31:0/2559679397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b00003530 con 0x7f6b000047d0 2023-11-27T17:53:51.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.329+0000 7f6b17fff640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b18145240 0x7f6b00005240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:51.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b16ffd640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b000047d0 0x7f6b00004c50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009ab0 tx=0x7f6b0801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fc10bf2b70992d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:51.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080a55d0 con 0x7f6b000047d0 2023-11-27T17:53:51.339 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b080a5730 con 0x7f6b000047d0 2023-11-27T17:53:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b167fc640 1 -- 172.21.15.31:0/2559679397 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080a5ae0 con 0x7f6b000047d0 2023-11-27T17:53:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 -- 172.21.15.31:0/2559679397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b000047d0 msgr2=0x7f6b00004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 --2- 172.21.15.31:0/2559679397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b000047d0 0x7f6b00004c50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009ab0 tx=0x7f6b0801ca00 comp rx=0 tx=0).stop 2023-11-27T17:53:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b17fff640 1 -- 172.21.15.31:0/2559679397 reap_dead start 2023-11-27T17:53:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 -- 172.21.15.31:0/2559679397 shutdown_connections 2023-11-27T17:53:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 -- 172.21.15.31:0/2559679397 >> 172.21.15.31:0/2559679397 conn(0x7f6b1806ab60 msgr2=0x7f6b180bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 -- 172.21.15.31:0/2559679397 shutdown_connections 2023-11-27T17:53:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 -- 172.21.15.31:0/2559679397 wait complete. 2023-11-27T17:53:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 Processor -- start 2023-11-27T17:53:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 -- start start 2023-11-27T17:53:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b000047d0 0x7f6b18149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.340 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b180714f0 0x7f6b18071c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1814c470 0x7f6b1813f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b18072150 con 0x7f6b1814c470 2023-11-27T17:53:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b18071950 con 0x7f6b000047d0 2023-11-27T17:53:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b181497e0 con 0x7f6b180714f0 2023-11-27T17:53:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b17fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1814c470 0x7f6b1813f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b17fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1814c470 0x7f6b1813f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42936/0 (socket says 172.21.15.31:42936) 2023-11-27T17:53:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b17fff640 1 -- 172.21.15.31:0/441023668 learned_addr learned my addr 172.21.15.31:0/441023668 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b177fe640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b000047d0 0x7f6b18149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b16ffd640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b180714f0 0x7f6b18071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b17fff640 1 -- 172.21.15.31:0/441023668 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b180714f0 msgr2=0x7f6b18071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b17fff640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b180714f0 0x7f6b18071c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b17fff640 1 -- 172.21.15.31:0/441023668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b000047d0 msgr2=0x7f6b18149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b17fff640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b000047d0 0x7f6b18149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b17fff640 1 -- 172.21.15.31:0/441023668 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1806f9a0 con 0x7f6b1814c470 2023-11-27T17:53:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b17fff640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1814c470 0x7f6b1813f940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6b1806f160 tx=0x7f6b1000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6afffff640 1 -- 172.21.15.31:0/441023668 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10004d70 con 0x7f6b1814c470 2023-11-27T17:53:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6afffff640 1 -- 172.21.15.31:0/441023668 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1000bb80 con 0x7f6b1814c470 2023-11-27T17:53:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 -- 172.21.15.31:0/441023668 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1806fc80 con 0x7f6b1814c470 2023-11-27T17:53:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6afffff640 1 -- 172.21.15.31:0/441023668 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10007110 con 0x7f6b1814c470 2023-11-27T17:53:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.333+0000 7f6b1de78640 1 -- 172.21.15.31:0/441023668 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b18070240 con 0x7f6b1814c470 2023-11-27T17:53:51.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.337+0000 7f6b1de78640 1 -- 172.21.15.31:0/441023668 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1804e850 con 0x7f6b1814c470 2023-11-27T17:53:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.337+0000 7f6afffff640 1 -- 172.21.15.31:0/441023668 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f6b10007270 con 0x7f6b1814c470 2023-11-27T17:53:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.337+0000 7f6afffff640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6b040667f0 0x7f6b04068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.337+0000 7f6afffff640 1 -- 172.21.15.31:0/441023668 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b10084070 con 0x7f6b1814c470 2023-11-27T17:53:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.337+0000 7f6b177fe640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6b040667f0 0x7f6b04068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.337+0000 7f6b177fe640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6b040667f0 0x7f6b04068cb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c005510 tx=0x7f6b0c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:51.344 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.341+0000 7f6afffff640 1 -- 172.21.15.31:0/441023668 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f6b100b5280 con 0x7f6b1814c470 2023-11-27T17:53:51.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.493+0000 7f6b1de78640 1 -- 172.21.15.31:0/441023668 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6b1814c1b0 con 0x7f6b1814c470 2023-11-27T17:53:51.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6afffff640 1 -- 172.21.15.31:0/441023668 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6b10051160 con 0x7f6b1814c470 2023-11-27T17:53:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6b1de78640 1 -- 172.21.15.31:0/441023668 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6b040667f0 msgr2=0x7f6b04068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6b1de78640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6b040667f0 0x7f6b04068cb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c005510 tx=0x7f6b0c009040 comp rx=0 tx=0).stop 2023-11-27T17:53:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6b1de78640 1 -- 172.21.15.31:0/441023668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1814c470 msgr2=0x7f6b1813f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6b1de78640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1814c470 0x7f6b1813f940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6b1806f160 tx=0x7f6b1000b4a0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6b1de78640 1 -- 172.21.15.31:0/441023668 shutdown_connections 2023-11-27T17:53:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6b1de78640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6b040667f0 0x7f6b04068cb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6b1de78640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b1814c470 0x7f6b1813f940 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6b1de78640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f6b180714f0 0x7f6b18071c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6b1de78640 1 --2- 172.21.15.31:0/441023668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b000047d0 0x7f6b18149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6b1de78640 1 -- 172.21.15.31:0/441023668 >> 172.21.15.31:0/441023668 conn(0x7f6b1806ab60 msgr2=0x7f6b18141b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:51.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6b1de78640 1 -- 172.21.15.31:0/441023668 shutdown_connections 2023-11-27T17:53:51.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.501+0000 7f6b1de78640 1 -- 172.21.15.31:0/441023668 wait complete. 2023-11-27T17:53:51.523 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-27T17:53:51.524 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T17:53:51.561 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T17:53:51.611 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-27T17:53:51.668 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-27T17:53:51.668 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:53:51.668 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:53:51.677 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:53:51.677 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:53:51.733 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:53:51.733 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:53:51.785 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:51.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.909+0000 7f1958cbf640 1 Processor -- start 2023-11-27T17:53:51.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.909+0000 7f1958cbf640 1 -- start start 2023-11-27T17:53:51.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1958cbf640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414e880 0x7f19540b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1958cbf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1954144dd0 0x7f1954145260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1958cbf640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19540b8d90 con 0x7f19540b8440 2023-11-27T17:53:51.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1958cbf640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540ba130 con 0x7f1954144dd0 2023-11-27T17:53:51.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1958cbf640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195406bc10 con 0x7f195414e880 2023-11-27T17:53:51.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195259c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f19540b8440 0x7f19540bcf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44856/0 (socket says 172.21.15.31:44856) 2023-11-27T17:53:51.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195259c640 1 -- 172.21.15.31:0/1136850035 learned_addr learned my addr 172.21.15.31:0/1136850035 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:51.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1951d9b640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414e880 0x7f19540b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1952d9d640 1 --2- 172.21.15.31:0/1136850035 >> v2:172.21.15.81:3300/0 conn(0x7f1954144dd0 0x7f1954145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524251504 0 0) 0x7f19540b8d90 con 0x7f19540b8440 2023-11-27T17:53:51.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f193c003530 con 0x7f19540b8440 2023-11-27T17:53:51.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2292916205 0 0) 0x7f193c003530 con 0x7f19540b8440 2023-11-27T17:53:51.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414e880 msgr2=0x7f19540b9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:51.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414e880 0x7f19540b9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 >> v2:172.21.15.81:3300/0 conn(0x7f1954144dd0 msgr2=0x7f1954145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:51.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 --2- 172.21.15.31:0/1136850035 >> v2:172.21.15.81:3300/0 conn(0x7f1954144dd0 0x7f1954145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19541457a0 con 0x7f19540b8440 2023-11-27T17:53:51.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f1944001680 con 0x7f19540b8440 2023-11-27T17:53:51.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 >> v1:172.21.15.31:6789/0 conn(0x7f19540b8440 legacy=0x7f19540bcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414e880 0x7f193c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c003f70 0x7f193c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f193c004d10 0x7f193c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195406bc10 con 0x7f193c004d10 2023-11-27T17:53:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c00b9c0 con 0x7f193c003f70 2023-11-27T17:53:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c00bb80 con 0x7f195414e880 2023-11-27T17:53:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1952d9d640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f193c004d10 0x7f193c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1951d9b640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c003f70 0x7f193c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195259c640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414e880 0x7f193c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1952d9d640 1 -- 172.21.15.31:0/1136850035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414e880 msgr2=0x7f193c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:51.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1952d9d640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414e880 0x7f193c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1952d9d640 1 -- 172.21.15.31:0/1136850035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c003f70 msgr2=0x7f193c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:51.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1952d9d640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f193c003f70 0x7f193c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1952d9d640 1 -- 172.21.15.31:0/1136850035 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c003530 con 0x7f193c004d10 2023-11-27T17:53:51.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f195259c640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414e880 0x7f193c0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:51.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.913+0000 7f1952d9d640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f193c004d10 0x7f193c005190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f194c009fc0 tx=0x7f194c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62379d14d9a3314 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:51.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c0a5cb0 con 0x7f193c004d10 2023-11-27T17:53:51.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c00f040 con 0x7f193c004d10 2023-11-27T17:53:51.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f195159a640 1 -- 172.21.15.31:0/1136850035 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c0ad680 con 0x7f193c004d10 2023-11-27T17:53:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 -- 172.21.15.31:0/1136850035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f193c004d10 msgr2=0x7f193c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 --2- 172.21.15.31:0/1136850035 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f193c004d10 0x7f193c005190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f194c009fc0 tx=0x7f194c01cca0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1952d9d640 1 -- 172.21.15.31:0/1136850035 reap_dead start 2023-11-27T17:53:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 -- 172.21.15.31:0/1136850035 shutdown_connections 2023-11-27T17:53:51.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 -- 172.21.15.31:0/1136850035 >> 172.21.15.31:0/1136850035 conn(0x7f19540c0ce0 msgr2=0x7f19540c10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:51.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 -- 172.21.15.31:0/1136850035 shutdown_connections 2023-11-27T17:53:51.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 -- 172.21.15.31:0/1136850035 wait complete. 2023-11-27T17:53:51.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 Processor -- start 2023-11-27T17:53:51.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 -- start start 2023-11-27T17:53:51.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f195413eeb0 0x7f195414d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414d870 0x7f1954137620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1954137b60 0x7f19541e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195413f8b0 con 0x7f1954137b60 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19541412a0 con 0x7f195413eeb0 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195414dcf0 con 0x7f195414d870 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1952d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1954137b60 0x7f19541e3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1952d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1954137b60 0x7f19541e3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42952/0 (socket says 172.21.15.31:42952) 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1952d9d640 1 -- 172.21.15.31:0/966320127 learned_addr learned my addr 172.21.15.31:0/966320127 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1951d9b640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414d870 0x7f1954137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f195259c640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f195413eeb0 0x7f195414d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1952d9d640 1 -- 172.21.15.31:0/966320127 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414d870 msgr2=0x7f1954137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1952d9d640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414d870 0x7f1954137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1952d9d640 1 -- 172.21.15.31:0/966320127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f195413eeb0 msgr2=0x7f195414d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1952d9d640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f195413eeb0 0x7f195414d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1952d9d640 1 -- 172.21.15.31:0/966320127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195414c5f0 con 0x7f1954137b60 2023-11-27T17:53:51.932 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1952d9d640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1954137b60 0x7f19541e3a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f194c0b0040 tx=0x7f194c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1942ffd640 1 -- 172.21.15.31:0/966320127 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c0039a0 con 0x7f1954137b60 2023-11-27T17:53:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1942ffd640 1 -- 172.21.15.31:0/966320127 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194c003b00 con 0x7f1954137b60 2023-11-27T17:53:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 -- 172.21.15.31:0/966320127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1954140fc0 con 0x7f1954137b60 2023-11-27T17:53:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1942ffd640 1 -- 172.21.15.31:0/966320127 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194c003e70 con 0x7f1954137b60 2023-11-27T17:53:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.917+0000 7f1958cbf640 1 -- 172.21.15.31:0/966320127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1954137fe0 con 0x7f1954137b60 2023-11-27T17:53:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.921+0000 7f1958cbf640 1 -- 172.21.15.31:0/966320127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195404e850 con 0x7f1954137b60 2023-11-27T17:53:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.921+0000 7f1942ffd640 1 -- 172.21.15.31:0/966320127 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f194c0b4040 con 0x7f1954137b60 2023-11-27T17:53:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.921+0000 7f1942ffd640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1934066820 0x7f1934068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.921+0000 7f195259c640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1934066820 0x7f1934068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.921+0000 7f1942ffd640 1 -- 172.21.15.31:0/966320127 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f194c11e020 con 0x7f1954137b60 2023-11-27T17:53:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.921+0000 7f195259c640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1934066820 0x7f1934068ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f19440017f0 tx=0x7f1944009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:51.933 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:51.925+0000 7f1942ffd640 1 -- 172.21.15.31:0/966320127 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f194c0eb2f0 con 0x7f1954137b60 2023-11-27T17:53:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.081+0000 7f1958cbf640 1 -- 172.21.15.31:0/966320127 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f195414cfe0 con 0x7f1954137b60 2023-11-27T17:53:52.089 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1942ffd640 1 -- 172.21.15.31:0/966320127 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7f194c0ee910 con 0x7f1954137b60 2023-11-27T17:53:52.089 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:52.089 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1958cbf640 1 -- 172.21.15.31:0/966320127 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1934066820 msgr2=0x7f1934068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1958cbf640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1934066820 0x7f1934068ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f19440017f0 tx=0x7f1944009040 comp rx=0 tx=0).stop 2023-11-27T17:53:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1958cbf640 1 -- 172.21.15.31:0/966320127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1954137b60 msgr2=0x7f19541e3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1958cbf640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1954137b60 0x7f19541e3a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f194c0b0040 tx=0x7f194c009750 comp rx=0 tx=0).stop 2023-11-27T17:53:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1958cbf640 1 -- 172.21.15.31:0/966320127 shutdown_connections 2023-11-27T17:53:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1958cbf640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1934066820 0x7f1934068ce0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1958cbf640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1954137b60 0x7f19541e3a50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1958cbf640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f195414d870 0x7f1954137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1958cbf640 1 --2- 172.21.15.31:0/966320127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f195413eeb0 0x7f195414d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1958cbf640 1 -- 172.21.15.31:0/966320127 >> 172.21.15.31:0/966320127 conn(0x7f19540c0ce0 msgr2=0x7f19540b9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:52.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1958cbf640 1 -- 172.21.15.31:0/966320127 shutdown_connections 2023-11-27T17:53:52.092 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.085+0000 7f1958cbf640 1 -- 172.21.15.31:0/966320127 wait complete. 2023-11-27T17:53:52.108 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:53:11.177026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:53:21.543531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:53:22.362977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:53:52.108 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:53:52.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde7bb4640 1 Processor -- start 2023-11-27T17:53:52.236 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde7bb4640 1 -- start start 2023-11-27T17:53:52.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde7bb4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efde006ab90 0x7efde006af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde7bb4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efde00c0670 0x7efde014b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde7bb4640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde006b4b0 con 0x7efde00b6da0 2023-11-27T17:53:52.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde7bb4640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00bfbd0 con 0x7efde006ab90 2023-11-27T17:53:52.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde7bb4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde00b7ce0 con 0x7efde00c0670 2023-11-27T17:53:52.237 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde6151640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efde00b6da0 0x7efde014eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44872/0 (socket says 172.21.15.31:44872) 2023-11-27T17:53:52.238 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde6151640 1 -- 172.21.15.31:0/211674209 learned_addr learned my addr 172.21.15.31:0/211674209 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:52.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde514f640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efde00c0670 0x7efde014b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.239 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde5950640 1 --2- 172.21.15.31:0/211674209 >> v2:172.21.15.81:3300/0 conn(0x7efde006ab90 0x7efde006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306931918 0 0) 0x7efde006b4b0 con 0x7efde00b6da0 2023-11-27T17:53:52.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdcc003530 con 0x7efde00b6da0 2023-11-27T17:53:52.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2790002181 0 0) 0x7efdcc003530 con 0x7efde00b6da0 2023-11-27T17:53:52.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efde00c0670 msgr2=0x7efde014b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:52.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efde00c0670 0x7efde014b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 >> v2:172.21.15.81:3300/0 conn(0x7efde006ab90 msgr2=0x7efde006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:52.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 --2- 172.21.15.31:0/211674209 >> v2:172.21.15.81:3300/0 conn(0x7efde006ab90 0x7efde006af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde00bfe70 con 0x7efde00b6da0 2023-11-27T17:53:52.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7efdd8001a00 con 0x7efde00b6da0 2023-11-27T17:53:52.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 >> v1:172.21.15.31:6789/0 conn(0x7efde00b6da0 legacy=0x7efde014eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.240 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efde00c0670 0x7efdcc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdcc003f70 0x7efdcc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdcc004d10 0x7efdcc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde00bfbd0 con 0x7efdcc003f70 2023-11-27T17:53:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde00b7ce0 con 0x7efdcc004d10 2023-11-27T17:53:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc00b9c0 con 0x7efde00c0670 2023-11-27T17:53:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde514f640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdcc003f70 0x7efdcc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde5950640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efde00c0670 0x7efdcc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde514f640 1 -- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efde00c0670 msgr2=0x7efdcc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde514f640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efde00c0670 0x7efdcc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde514f640 1 -- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdcc004d10 msgr2=0x7efdcc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde6151640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdcc004d10 0x7efdcc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.241 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde514f640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdcc004d10 0x7efdcc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde514f640 1 -- 172.21.15.31:0/211674209 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc003530 con 0x7efdcc003f70 2023-11-27T17:53:52.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde5950640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efde00c0670 0x7efdcc0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:52.242 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.233+0000 7efde6151640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efdcc004d10 0x7efdcc005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:52.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde514f640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdcc003f70 0x7efdcc0047d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009ae0 tx=0x7efdd001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcea2bb0f01009ba server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:52.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd00a5530 con 0x7efdcc003f70 2023-11-27T17:53:52.244 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd00a5690 con 0x7efdcc003f70 2023-11-27T17:53:52.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde494e640 1 -- 172.21.15.31:0/211674209 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd00a5a40 con 0x7efdcc003f70 2023-11-27T17:53:52.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 -- 172.21.15.31:0/211674209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdcc003f70 msgr2=0x7efdcc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 --2- 172.21.15.31:0/211674209 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efdcc003f70 0x7efdcc0047d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009ae0 tx=0x7efdd001ca50 comp rx=0 tx=0).stop 2023-11-27T17:53:52.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde6151640 1 -- 172.21.15.31:0/211674209 reap_dead start 2023-11-27T17:53:52.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 -- 172.21.15.31:0/211674209 shutdown_connections 2023-11-27T17:53:52.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 -- 172.21.15.31:0/211674209 >> 172.21.15.31:0/211674209 conn(0x7efde00a28f0 msgr2=0x7efde00a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:52.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 -- 172.21.15.31:0/211674209 shutdown_connections 2023-11-27T17:53:52.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 -- 172.21.15.31:0/211674209 wait complete. 2023-11-27T17:53:52.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 Processor -- start 2023-11-27T17:53:52.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 -- start start 2023-11-27T17:53:52.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efdcc003f70 0x7efde01468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.245 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde0148990 0x7efde00ba000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde00b9090 0x7efde00b9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0146df0 con 0x7efde0148990 2023-11-27T17:53:52.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde00b9a50 con 0x7efde00b9090 2023-11-27T17:53:52.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.237+0000 7efde7bb4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde0143bc0 con 0x7efdcc003f70 2023-11-27T17:53:52.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde514f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde0148990 0x7efde00ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde514f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde0148990 0x7efde00ba000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42966/0 (socket says 172.21.15.31:42966) 2023-11-27T17:53:52.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde514f640 1 -- 172.21.15.31:0/672912484 learned_addr learned my addr 172.21.15.31:0/672912484 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:52.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde5950640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efdcc003f70 0x7efde01468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde6151640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde00b9090 0x7efde00b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde514f640 1 -- 172.21.15.31:0/672912484 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efdcc003f70 msgr2=0x7efde01468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde514f640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efdcc003f70 0x7efde01468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.246 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde514f640 1 -- 172.21.15.31:0/672912484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde00b9090 msgr2=0x7efde00b9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde514f640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde00b9090 0x7efde00b9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde514f640 1 -- 172.21.15.31:0/672912484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde0148000 con 0x7efde0148990 2023-11-27T17:53:52.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde5950640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efdcc003f70 0x7efde01468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:52.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde514f640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde0148990 0x7efde00ba000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009ae0 tx=0x7efdcc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:52.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efdd67fc640 1 -- 172.21.15.31:0/672912484 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd00bc070 con 0x7efde0148990 2023-11-27T17:53:52.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efdd67fc640 1 -- 172.21.15.31:0/672912484 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd00a5e80 con 0x7efde0148990 2023-11-27T17:53:52.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde7bb4640 1 -- 172.21.15.31:0/672912484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde01e0bb0 con 0x7efde0148990 2023-11-27T17:53:52.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efdd67fc640 1 -- 172.21.15.31:0/672912484 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0004220 con 0x7efde0148990 2023-11-27T17:53:52.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde7bb4640 1 -- 172.21.15.31:0/672912484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde01e1170 con 0x7efde0148990 2023-11-27T17:53:52.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde7bb4640 1 -- 172.21.15.31:0/672912484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde004e850 con 0x7efde0148990 2023-11-27T17:53:52.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efdd67fc640 1 -- 172.21.15.31:0/672912484 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7efdd00b4040 con 0x7efde0148990 2023-11-27T17:53:52.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efdd67fc640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efdc4066820 0x7efdc4068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efdd67fc640 1 -- 172.21.15.31:0/672912484 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdd011dfe0 con 0x7efde0148990 2023-11-27T17:53:52.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde5950640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efdc4066820 0x7efdc4068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.241+0000 7efde5950640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efdc4066820 0x7efdc4068ce0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efddc009b40 tx=0x7efddc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:52.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.245+0000 7efdd67fc640 1 -- 172.21.15.31:0/672912484 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7efdd00eb200 con 0x7efde0148990 2023-11-27T17:53:52.409 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.405+0000 7efde7bb4640 1 -- 172.21.15.31:0/672912484 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efde00bce20 con 0x7efde0148990 2023-11-27T17:53:52.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.405+0000 7efdd67fc640 1 -- 172.21.15.31:0/672912484 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7efdd00ee820 con 0x7efde0148990 2023-11-27T17:53:52.410 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-11-27T17:53:52.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.409+0000 7efde7bb4640 1 -- 172.21.15.31:0/672912484 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efdc4066820 msgr2=0x7efdc4068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.409+0000 7efde7bb4640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efdc4066820 0x7efdc4068ce0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efddc009b40 tx=0x7efddc008040 comp rx=0 tx=0).stop 2023-11-27T17:53:52.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.409+0000 7efde7bb4640 1 -- 172.21.15.31:0/672912484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde0148990 msgr2=0x7efde00ba000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.409+0000 7efde7bb4640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde0148990 0x7efde00ba000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009ae0 tx=0x7efdcc005800 comp rx=0 tx=0).stop 2023-11-27T17:53:52.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.409+0000 7efde7bb4640 1 -- 172.21.15.31:0/672912484 shutdown_connections 2023-11-27T17:53:52.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.409+0000 7efde7bb4640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efdc4066820 0x7efdc4068ce0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.409+0000 7efde7bb4640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde00b9090 0x7efde00b9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.409+0000 7efde7bb4640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efde0148990 0x7efde00ba000 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.409+0000 7efde7bb4640 1 --2- 172.21.15.31:0/672912484 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efdcc003f70 0x7efde01468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.409+0000 7efde7bb4640 1 -- 172.21.15.31:0/672912484 >> 172.21.15.31:0/672912484 conn(0x7efde00a28f0 msgr2=0x7efde00befc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:52.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.409+0000 7efde7bb4640 1 -- 172.21.15.31:0/672912484 shutdown_connections 2023-11-27T17:53:52.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.409+0000 7efde7bb4640 1 -- 172.21.15.31:0/672912484 wait complete. 2023-11-27T17:53:52.429 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:53:52.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.552+0000 7fc3c80d7640 1 Processor -- start 2023-11-27T17:53:52.559 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.552+0000 7fc3c80d7640 1 -- start start 2023-11-27T17:53:52.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c80d7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3c00b5d90 0x7fc3c0148570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c80d7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c00bd950 con 0x7fc3c01425e0 2023-11-27T17:53:52.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c80d7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c00b6840 con 0x7fc3c00b61d0 2023-11-27T17:53:52.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c80d7640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c01429c0 con 0x7fc3c00b5d90 2023-11-27T17:53:52.560 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c5672640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc3c00b5d90 0x7fc3c0148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c5e73640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc3c01425e0 0x7fc3c00bd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44886/0 (socket says 172.21.15.31:44886) 2023-11-27T17:53:52.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c5e73640 1 -- 172.21.15.31:0/2144086704 learned_addr learned my addr 172.21.15.31:0/2144086704 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:52.561 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c5672640 1 -- 172.21.15.31:0/2144086704 >> v1:172.21.15.81:6789/0 conn(0x7fc3c00b61d0 legacy=0x7fc3c01529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:52.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c5672640 1 -- 172.21.15.31:0/2144086704 >> v1:172.21.15.31:6789/0 conn(0x7fc3c01425e0 legacy=0x7fc3c00bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c4e71640 1 -- 172.21.15.31:0/2144086704 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505617406 0 0) 0x7fc3c00bd950 con 0x7fc3c01425e0 2023-11-27T17:53:52.562 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c5672640 1 -- 172.21.15.31:0/2144086704 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c00b6b20 con 0x7fc3c00b5d90 2023-11-27T17:53:52.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c5672640 1 --2- 172.21.15.31:0/2144086704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c00b5d90 0x7fc3c0148570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00097c0 tx=0x7fc3b001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4606af32299688e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:52.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c4e71640 1 -- 172.21.15.31:0/2144086704 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00ab600 con 0x7fc3c00b5d90 2023-11-27T17:53:52.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c4e71640 1 -- 172.21.15.31:0/2144086704 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b00a7050 con 0x7fc3c00b5d90 2023-11-27T17:53:52.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.556+0000 7fc3c4e71640 1 -- 172.21.15.31:0/2144086704 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00ab980 con 0x7fc3c00b5d90 2023-11-27T17:53:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 -- 172.21.15.31:0/2144086704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c00b5d90 msgr2=0x7fc3c0148570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 --2- 172.21.15.31:0/2144086704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c00b5d90 0x7fc3c0148570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00097c0 tx=0x7fc3b001c410 comp rx=0 tx=0).stop 2023-11-27T17:53:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 -- 172.21.15.31:0/2144086704 shutdown_connections 2023-11-27T17:53:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 --2- 172.21.15.31:0/2144086704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c00b5d90 0x7fc3c0148570 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 -- 172.21.15.31:0/2144086704 >> 172.21.15.31:0/2144086704 conn(0x7fc3c006ab60 msgr2=0x7fc3c00bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 -- 172.21.15.31:0/2144086704 shutdown_connections 2023-11-27T17:53:52.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 -- 172.21.15.31:0/2144086704 wait complete. 2023-11-27T17:53:52.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 Processor -- start 2023-11-27T17:53:52.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 -- start start 2023-11-27T17:53:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c00b5d90 0x7fc3c0144d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc3c00b61d0 0x7fc3c00bc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c01425e0 0x7fc3c0133120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c0145260 con 0x7fc3c01425e0 2023-11-27T17:53:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c014bcc0 con 0x7fc3c00b5d90 2023-11-27T17:53:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c014b6b0 con 0x7fc3c00b61d0 2023-11-27T17:53:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c6674640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c01425e0 0x7fc3c0133120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c6674640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c01425e0 0x7fc3c0133120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42974/0 (socket says 172.21.15.31:42974) 2023-11-27T17:53:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c6674640 1 -- 172.21.15.31:0/3271027502 learned_addr learned my addr 172.21.15.31:0/3271027502 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c5e73640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c00b5d90 0x7fc3c0144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c5672640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc3c00b61d0 0x7fc3c00bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c6674640 1 -- 172.21.15.31:0/3271027502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc3c00b61d0 msgr2=0x7fc3c00bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c6674640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc3c00b61d0 0x7fc3c00bc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c6674640 1 -- 172.21.15.31:0/3271027502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c00b5d90 msgr2=0x7fc3c0144d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c6674640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c00b5d90 0x7fc3c0144d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c6674640 1 -- 172.21.15.31:0/3271027502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0009420 con 0x7fc3c01425e0 2023-11-27T17:53:52.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c6674640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c01425e0 0x7fc3c0133120 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c7b0 tx=0x7fc3b800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:52.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3b67fc640 1 -- 172.21.15.31:0/3271027502 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8004b70 con 0x7fc3c01425e0 2023-11-27T17:53:52.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3b67fc640 1 -- 172.21.15.31:0/3271027502 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b8004cd0 con 0x7fc3c01425e0 2023-11-27T17:53:52.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 -- 172.21.15.31:0/3271027502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c0149fa0 con 0x7fc3c01425e0 2023-11-27T17:53:52.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3b67fc640 1 -- 172.21.15.31:0/3271027502 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b800aa90 con 0x7fc3c01425e0 2023-11-27T17:53:52.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 -- 172.21.15.31:0/3271027502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c014ba00 con 0x7fc3c01425e0 2023-11-27T17:53:52.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.560+0000 7fc3c80d7640 1 -- 172.21.15.31:0/3271027502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c004e850 con 0x7fc3c01425e0 2023-11-27T17:53:52.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.564+0000 7fc3b67fc640 1 -- 172.21.15.31:0/3271027502 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fc3b800abf0 con 0x7fc3c01425e0 2023-11-27T17:53:52.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.564+0000 7fc3b67fc640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fc3a40667f0 0x7fc3a4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.564+0000 7fc3b67fc640 1 -- 172.21.15.31:0/3271027502 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3b8084bb0 con 0x7fc3c01425e0 2023-11-27T17:53:52.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.564+0000 7fc3c5e73640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fc3a40667f0 0x7fc3a4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.564+0000 7fc3c5e73640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fc3a40667f0 0x7fc3a4068cb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc000f70 tx=0x7fc3bc007c10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:52.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.568+0000 7fc3b67fc640 1 -- 172.21.15.31:0/3271027502 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fc3b8051d20 con 0x7fc3c01425e0 2023-11-27T17:53:52.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 -- 172.21.15.31:0/3271027502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3c014be00 con 0x7fc3c01425e0 2023-11-27T17:53:52.728 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3b67fc640 1 -- 172.21.15.31:0/3271027502 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3b8055340 con 0x7fc3c01425e0 2023-11-27T17:53:52.728 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-11-27T17:53:52.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 -- 172.21.15.31:0/3271027502 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fc3a40667f0 msgr2=0x7fc3a4068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.730 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fc3a40667f0 0x7fc3a4068cb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc000f70 tx=0x7fc3bc007c10 comp rx=0 tx=0).stop 2023-11-27T17:53:52.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 -- 172.21.15.31:0/3271027502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c01425e0 msgr2=0x7fc3c0133120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c01425e0 0x7fc3c0133120 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800c7b0 tx=0x7fc3b800cc70 comp rx=0 tx=0).stop 2023-11-27T17:53:52.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 -- 172.21.15.31:0/3271027502 shutdown_connections 2023-11-27T17:53:52.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fc3a40667f0 0x7fc3a4068cb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc3c01425e0 0x7fc3c0133120 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fc3c00b61d0 0x7fc3c00bc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 --2- 172.21.15.31:0/3271027502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3c00b5d90 0x7fc3c0144d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 -- 172.21.15.31:0/3271027502 >> 172.21.15.31:0/3271027502 conn(0x7fc3c006ab60 msgr2=0x7fc3c0147a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:52.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 -- 172.21.15.31:0/3271027502 shutdown_connections 2023-11-27T17:53:52.731 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.724+0000 7fc3c80d7640 1 -- 172.21.15.31:0/3271027502 wait complete. 2023-11-27T17:53:52.748 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:53:52.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f2633241640 1 Processor -- start 2023-11-27T17:53:52.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f2633241640 1 -- start start 2023-11-27T17:53:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f2633241640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f262c142470 0x7f262c071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f2633241640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f262c148050 0x7f262c148480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f2633241640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f262c0b6cc0 con 0x7f262c0b74b0 2023-11-27T17:53:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f2633241640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c0b98c0 con 0x7f262c148050 2023-11-27T17:53:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f2633241640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c06bc80 con 0x7f262c142470 2023-11-27T17:53:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f26317de640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f262c148050 0x7f262c148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f26317de640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f262c148050 0x7f262c148480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42976/0 (socket says 172.21.15.31:42976) 2023-11-27T17:53:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f26317de640 1 -- 172.21.15.31:0/791707811 learned_addr learned my addr 172.21.15.31:0/791707811 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:52.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f2630fdd640 1 --2- 172.21.15.31:0/791707811 >> v2:172.21.15.81:3300/0 conn(0x7f262c142470 0x7f262c071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f26317de640 1 -- 172.21.15.31:0/791707811 >> v2:172.21.15.81:3300/0 conn(0x7f262c142470 msgr2=0x7f262c071800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f26317de640 1 --2- 172.21.15.31:0/791707811 >> v2:172.21.15.81:3300/0 conn(0x7f262c142470 0x7f262c071800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f26317de640 1 -- 172.21.15.31:0/791707811 >> v1:172.21.15.81:6789/0 conn(0x7f262c0b74b0 legacy=0x7f262c06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f26317de640 1 -- 172.21.15.31:0/791707811 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c1489c0 con 0x7f262c148050 2023-11-27T17:53:52.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.876+0000 7f26317de640 1 --2- 172.21.15.31:0/791707811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f262c148050 0x7f262c148480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f262c06f190 tx=0x7f262401f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa5c274866c3029 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:52.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f262b7fe640 1 -- 172.21.15.31:0/791707811 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26240af400 con 0x7f262c148050 2023-11-27T17:53:52.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f262b7fe640 1 -- 172.21.15.31:0/791707811 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26240ab050 con 0x7f262c148050 2023-11-27T17:53:52.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f262b7fe640 1 -- 172.21.15.31:0/791707811 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26240af780 con 0x7f262c148050 2023-11-27T17:53:52.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 -- 172.21.15.31:0/791707811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f262c148050 msgr2=0x7f262c148480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 --2- 172.21.15.31:0/791707811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f262c148050 0x7f262c148480 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f262c06f190 tx=0x7f262401f180 comp rx=0 tx=0).stop 2023-11-27T17:53:52.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 -- 172.21.15.31:0/791707811 shutdown_connections 2023-11-27T17:53:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 --2- 172.21.15.31:0/791707811 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f262c148050 0x7f262c148480 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 --2- 172.21.15.31:0/791707811 >> v2:172.21.15.81:3300/0 conn(0x7f262c142470 0x7f262c071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 -- 172.21.15.31:0/791707811 >> 172.21.15.31:0/791707811 conn(0x7f262c0b9d30 msgr2=0x7f262c0ba140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 -- 172.21.15.31:0/791707811 shutdown_connections 2023-11-27T17:53:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 -- 172.21.15.31:0/791707811 wait complete. 2023-11-27T17:53:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 Processor -- start 2023-11-27T17:53:52.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 -- start start 2023-11-27T17:53:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f262c0b74b0 0x7f262c144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f262c142470 0x7f262c1396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c148050 0x7f262c139c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c138f80 con 0x7f262c0b74b0 2023-11-27T17:53:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c139260 con 0x7f262c148050 2023-11-27T17:53:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c13a490 con 0x7f262c142470 2023-11-27T17:53:52.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2630fdd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f262c0b74b0 0x7f262c144ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2630fdd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f262c0b74b0 0x7f262c144ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42982/0 (socket says 172.21.15.31:42982) 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2630fdd640 1 -- 172.21.15.31:0/747675439 learned_addr learned my addr 172.21.15.31:0/747675439 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f26317de640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c148050 0x7f262c139c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f262bfff640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f262c142470 0x7f262c1396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2630fdd640 1 -- 172.21.15.31:0/747675439 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f262c142470 msgr2=0x7f262c1396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2630fdd640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f262c142470 0x7f262c1396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2630fdd640 1 -- 172.21.15.31:0/747675439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c148050 msgr2=0x7f262c139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2630fdd640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c148050 0x7f262c139c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2630fdd640 1 -- 172.21.15.31:0/747675439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2624009b30 con 0x7f262c0b74b0 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f26317de640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c148050 0x7f262c139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2630fdd640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f262c0b74b0 0x7f262c144ca0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f261c00d830 tx=0x7f261c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f26297fa640 1 -- 172.21.15.31:0/747675439 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00b6c0 con 0x7f262c0b74b0 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f26297fa640 1 -- 172.21.15.31:0/747675439 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c00b820 con 0x7f262c0b74b0 2023-11-27T17:53:52.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 -- 172.21.15.31:0/747675439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c142fe0 con 0x7f262c0b74b0 2023-11-27T17:53:52.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f26297fa640 1 -- 172.21.15.31:0/747675439 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c00bb90 con 0x7f262c0b74b0 2023-11-27T17:53:52.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.880+0000 7f2633241640 1 -- 172.21.15.31:0/747675439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c06fa90 con 0x7f262c0b74b0 2023-11-27T17:53:52.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.884+0000 7f2633241640 1 -- 172.21.15.31:0/747675439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c04e850 con 0x7f262c0b74b0 2023-11-27T17:53:52.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.884+0000 7f26297fa640 1 -- 172.21.15.31:0/747675439 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f261c01e460 con 0x7f262c0b74b0 2023-11-27T17:53:52.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.884+0000 7f26297fa640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f26180667f0 0x7f2618068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:52.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.884+0000 7f26297fa640 1 -- 172.21.15.31:0/747675439 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f261c084a70 con 0x7f262c0b74b0 2023-11-27T17:53:52.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.884+0000 7f262bfff640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f26180667f0 0x7f2618068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:52.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.884+0000 7f262bfff640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f26180667f0 0x7f2618068cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f262c138f10 tx=0x7f2620009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:52.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:52.888+0000 7f26297fa640 1 -- 172.21.15.31:0/747675439 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f261c051b70 con 0x7f262c0b74b0 2023-11-27T17:53:53.051 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.044+0000 7f2633241640 1 -- 172.21.15.31:0/747675439 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f262c0667f0 con 0x7f262c0b74b0 2023-11-27T17:53:53.052 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f26297fa640 1 -- 172.21.15.31:0/747675439 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f261c055190 con 0x7f262c0b74b0 2023-11-27T17:53:53.052 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-11-27T17:53:53.054 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f2633241640 1 -- 172.21.15.31:0/747675439 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f26180667f0 msgr2=0x7f2618068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f2633241640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f26180667f0 0x7f2618068cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f262c138f10 tx=0x7f2620009040 comp rx=0 tx=0).stop 2023-11-27T17:53:53.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f2633241640 1 -- 172.21.15.31:0/747675439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f262c0b74b0 msgr2=0x7f262c144ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f2633241640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f262c0b74b0 0x7f262c144ca0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f261c00d830 tx=0x7f261c00dcf0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f2633241640 1 -- 172.21.15.31:0/747675439 shutdown_connections 2023-11-27T17:53:53.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f2633241640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f26180667f0 0x7f2618068cb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f2633241640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c148050 0x7f262c139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f2633241640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f262c142470 0x7f262c1396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f2633241640 1 --2- 172.21.15.31:0/747675439 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f262c0b74b0 0x7f262c144ca0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f2633241640 1 -- 172.21.15.31:0/747675439 >> 172.21.15.31:0/747675439 conn(0x7f262c0b9d30 msgr2=0x7f262c06a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:53.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f2633241640 1 -- 172.21.15.31:0/747675439 shutdown_connections 2023-11-27T17:53:53.055 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.048+0000 7f2633241640 1 -- 172.21.15.31:0/747675439 wait complete. 2023-11-27T17:53:53.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-27T17:53:53.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0d1574640 1 Processor -- start 2023-11-27T17:53:53.194 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0d1574640 1 -- start start 2023-11-27T17:53:53.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0d1574640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa0cc14c7b0 0x7fa0cc0b5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0d1574640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0cc06ef70 0x7fa0cc06f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0d1574640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0cc0b4360 con 0x7fa0cc0a42b0 2023-11-27T17:53:53.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0d1574640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0cc06e7a0 con 0x7fa0cc14c7b0 2023-11-27T17:53:53.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0d1574640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0b4030 con 0x7fa0cc06ef70 2023-11-27T17:53:53.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0caffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa0cc0a42b0 0x7fa0cc0b47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44890/0 (socket says 172.21.15.31:44890) 2023-11-27T17:53:53.195 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0caffd640 1 -- 172.21.15.31:0/3142530506 learned_addr learned my addr 172.21.15.31:0/3142530506 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:53.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0ca7fc640 1 --2- 172.21.15.31:0/3142530506 >> v2:172.21.15.81:3300/0 conn(0x7fa0cc14c7b0 0x7fa0cc0b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0cb7fe640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0cc06ef70 0x7fa0cc06f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329297427 0 0) 0x7fa0cc0b4360 con 0x7fa0cc0a42b0 2023-11-27T17:53:53.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.188+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0b4003530 con 0x7fa0cc0a42b0 2023-11-27T17:53:53.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4277194658 0 0) 0x7fa0b4003530 con 0x7fa0cc0a42b0 2023-11-27T17:53:53.197 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0cc06ef70 msgr2=0x7fa0cc06f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:53.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0cc06ef70 0x7fa0cc06f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 >> v2:172.21.15.81:3300/0 conn(0x7fa0cc14c7b0 msgr2=0x7fa0cc0b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:53.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 --2- 172.21.15.31:0/3142530506 >> v2:172.21.15.81:3300/0 conn(0x7fa0cc14c7b0 0x7fa0cc0b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc06f9e0 con 0x7fa0cc0a42b0 2023-11-27T17:53:53.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7fa0bc001680 con 0x7fa0cc0a42b0 2023-11-27T17:53:53.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 >> v1:172.21.15.31:6789/0 conn(0x7fa0cc0a42b0 legacy=0x7fa0cc0b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0b40039f0 0x7fa0b4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b40047d0 0x7fa0b4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0cc06ef70 0x7fa0b4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc06e7a0 con 0x7fa0b40047d0 2023-11-27T17:53:53.198 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0b4030 con 0x7fa0b40039f0 2023-11-27T17:53:53.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b400ba40 con 0x7fa0cc06ef70 2023-11-27T17:53:53.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0ca7fc640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b40047d0 0x7fa0b4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0caffd640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0b40039f0 0x7fa0b4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0cb7fe640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0cc06ef70 0x7fa0b4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0ca7fc640 1 -- 172.21.15.31:0/3142530506 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0cc06ef70 msgr2=0x7fa0b4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:53.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0ca7fc640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0cc06ef70 0x7fa0b4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0ca7fc640 1 -- 172.21.15.31:0/3142530506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0b40039f0 msgr2=0x7fa0b4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:53.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0ca7fc640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0b40039f0 0x7fa0b4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0ca7fc640 1 -- 172.21.15.31:0/3142530506 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4003530 con 0x7fa0b40047d0 2023-11-27T17:53:53.199 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0caffd640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0b40039f0 0x7fa0b4003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:53.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0ca7fc640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b40047d0 0x7fa0b4004c50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009ab0 tx=0x7fa0c001cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517e3d1727c1c7d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:53.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00a5610 con 0x7fa0b40047d0 2023-11-27T17:53:53.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c00a5770 con 0x7fa0b40047d0 2023-11-27T17:53:53.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0c9ffb640 1 -- 172.21.15.31:0/3142530506 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00a5b20 con 0x7fa0b40047d0 2023-11-27T17:53:53.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0d1574640 1 -- 172.21.15.31:0/3142530506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b40047d0 msgr2=0x7fa0b4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0d1574640 1 --2- 172.21.15.31:0/3142530506 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0b40047d0 0x7fa0b4004c50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009ab0 tx=0x7fa0c001cb00 comp rx=0 tx=0).stop 2023-11-27T17:53:53.202 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0cb7fe640 1 -- 172.21.15.31:0/3142530506 reap_dead start 2023-11-27T17:53:53.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0d1574640 1 -- 172.21.15.31:0/3142530506 shutdown_connections 2023-11-27T17:53:53.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0d1574640 1 -- 172.21.15.31:0/3142530506 >> 172.21.15.31:0/3142530506 conn(0x7fa0cc0bb7d0 msgr2=0x7fa0cc0bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:53.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0d1574640 1 -- 172.21.15.31:0/3142530506 shutdown_connections 2023-11-27T17:53:53.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.192+0000 7fa0d1574640 1 -- 172.21.15.31:0/3142530506 wait complete. 2023-11-27T17:53:53.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0d1574640 1 Processor -- start 2023-11-27T17:53:53.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0d1574640 1 -- start start 2023-11-27T17:53:53.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0d1574640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0b40047d0 0x7fa0cc0b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0d1574640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0cc06d3a0 0x7fa0cc0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0d1574640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc06b670 0x7fa0cc14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0d1574640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc0b67e0 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0d1574640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc14b570 con 0x7fa0cc06b670 2023-11-27T17:53:53.203 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0d1574640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc06cba0 con 0x7fa0b40047d0 2023-11-27T17:53:53.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0ca7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0cc06d3a0 0x7fa0cc0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0ca7fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0cc06d3a0 0x7fa0cc0b62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43012/0 (socket says 172.21.15.31:43012) 2023-11-27T17:53:53.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0ca7fc640 1 -- 172.21.15.31:0/2349478416 learned_addr learned my addr 172.21.15.31:0/2349478416 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:53.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0caffd640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0b40047d0 0x7fa0cc0b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0ca7fc640 1 -- 172.21.15.31:0/2349478416 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0b40047d0 msgr2=0x7fa0cc0b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0ca7fc640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0b40047d0 0x7fa0cc0b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0cb7fe640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc06b670 0x7fa0cc14ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0ca7fc640 1 -- 172.21.15.31:0/2349478416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc06b670 msgr2=0x7fa0cc14ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0ca7fc640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc06b670 0x7fa0cc14ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0ca7fc640 1 -- 172.21.15.31:0/2349478416 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0cc06ce80 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0cb7fe640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc06b670 0x7fa0cc14ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:53.204 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0ca7fc640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0cc06d3a0 0x7fa0cc0b62a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009ab0 tx=0x7fa0b4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:53.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0b37fe640 1 -- 172.21.15.31:0/2349478416 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00be070 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0b37fe640 1 -- 172.21.15.31:0/2349478416 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c0004020 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0d1574640 1 -- 172.21.15.31:0/2349478416 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc14b290 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0b37fe640 1 -- 172.21.15.31:0/2349478416 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0004390 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.205 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0d1574640 1 -- 172.21.15.31:0/2349478416 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc1e3da0 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0d1574640 1 -- 172.21.15.31:0/2349478416 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc06d010 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.196+0000 7fa0b37fe640 1 -- 172.21.15.31:0/2349478416 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa0c00b4040 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.200+0000 7fa0b37fe640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa0b8066820 0x7fa0b8068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.200+0000 7fa0b37fe640 1 -- 172.21.15.31:0/2349478416 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0c011e120 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.200+0000 7fa0caffd640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa0b8066820 0x7fa0b8068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.206 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.200+0000 7fa0caffd640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa0b8066820 0x7fa0b8068ce0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc001870 tx=0x7fa0bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:53.208 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.204+0000 7fa0b37fe640 1 -- 172.21.15.31:0/2349478416 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa0c00eb3d0 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 -- 172.21.15.31:0/2349478416 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa0cc04e850 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.369 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0b37fe640 1 -- 172.21.15.31:0/2349478416 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa0c00ee9f0 con 0x7fa0cc06d3a0 2023-11-27T17:53:53.369 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2023-11-27T17:53:53.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 -- 172.21.15.31:0/2349478416 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa0b8066820 msgr2=0x7fa0b8068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa0b8066820 0x7fa0b8068ce0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc001870 tx=0x7fa0bc009040 comp rx=0 tx=0).stop 2023-11-27T17:53:53.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 -- 172.21.15.31:0/2349478416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0cc06d3a0 msgr2=0x7fa0cc0b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0cc06d3a0 0x7fa0cc0b62a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009ab0 tx=0x7fa0b4005800 comp rx=0 tx=0).stop 2023-11-27T17:53:53.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 -- 172.21.15.31:0/2349478416 shutdown_connections 2023-11-27T17:53:53.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa0b8066820 0x7fa0b8068ce0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa0cc06b670 0x7fa0cc14ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0cc06d3a0 0x7fa0cc0b62a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 --2- 172.21.15.31:0/2349478416 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa0b40047d0 0x7fa0cc0b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 -- 172.21.15.31:0/2349478416 >> 172.21.15.31:0/2349478416 conn(0x7fa0cc0bb7d0 msgr2=0x7fa0cc0bcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:53.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 -- 172.21.15.31:0/2349478416 shutdown_connections 2023-11-27T17:53:53.372 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.364+0000 7fa0d1574640 1 -- 172.21.15.31:0/2349478416 wait complete. 2023-11-27T17:53:53.387 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-27T17:53:53.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:53.387 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-27T17:53:53.430 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-27T17:53:53.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:53:53.431 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-27T17:53:53.493 INFO:tasks.cephfs.cephfs_test_case:[] 2023-11-27T17:53:53.493 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:53:53.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.612+0000 7fdd16e81640 1 Processor -- start 2023-11-27T17:53:53.620 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd16e81640 1 -- start start 2023-11-27T17:53:53.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd16e81640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdd100bab00 0x7fdd100b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd16e81640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd100baee0 0x7fdd101430b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd16e81640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd100b6670 con 0x7fdd101435f0 2023-11-27T17:53:53.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd16e81640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd100b6cf0 con 0x7fdd100baee0 2023-11-27T17:53:53.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd16e81640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd100b9570 con 0x7fdd100bab00 2023-11-27T17:53:53.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd0ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd100baee0 0x7fdd101430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd0ffff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdd100baee0 0x7fdd101430b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43018/0 (socket says 172.21.15.31:43018) 2023-11-27T17:53:53.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd0ffff640 1 -- 172.21.15.31:0/2999274754 learned_addr learned my addr 172.21.15.31:0/2999274754 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:53.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd14c1d640 1 --2- 172.21.15.31:0/2999274754 >> v2:172.21.15.81:3300/0 conn(0x7fdd100bab00 0x7fdd100b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd0ffff640 1 -- 172.21.15.31:0/2999274754 >> v2:172.21.15.81:3300/0 conn(0x7fdd100bab00 msgr2=0x7fdd100b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:53.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd0ffff640 1 --2- 172.21.15.31:0/2999274754 >> v2:172.21.15.81:3300/0 conn(0x7fdd100bab00 0x7fdd100b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd0ffff640 1 -- 172.21.15.31:0/2999274754 >> v1:172.21.15.81:6789/0 conn(0x7fdd101435f0 legacy=0x7fdd101491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:53.622 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd0ffff640 1 -- 172.21.15.31:0/2999274754 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd100b9e10 con 0x7fdd100baee0 2023-11-27T17:53:53.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd0ffff640 1 --2- 172.21.15.31:0/2999274754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd100baee0 0x7fdd101430b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdd100bc730 tx=0x7fdd0401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c520a341aefd1020 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:53.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.616+0000 7fdd0f7fe640 1 -- 172.21.15.31:0/2999274754 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040ac410 con 0x7fdd100baee0 2023-11-27T17:53:53.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd0f7fe640 1 -- 172.21.15.31:0/2999274754 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040ac570 con 0x7fdd100baee0 2023-11-27T17:53:53.623 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd0f7fe640 1 -- 172.21.15.31:0/2999274754 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040ac900 con 0x7fdd100baee0 2023-11-27T17:53:53.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 -- 172.21.15.31:0/2999274754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd100baee0 msgr2=0x7fdd101430b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 --2- 172.21.15.31:0/2999274754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd100baee0 0x7fdd101430b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdd100bc730 tx=0x7fdd0401c4c0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 -- 172.21.15.31:0/2999274754 shutdown_connections 2023-11-27T17:53:53.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 --2- 172.21.15.31:0/2999274754 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd100baee0 0x7fdd101430b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.624 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 --2- 172.21.15.31:0/2999274754 >> v2:172.21.15.81:3300/0 conn(0x7fdd100bab00 0x7fdd100b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 -- 172.21.15.31:0/2999274754 >> 172.21.15.31:0/2999274754 conn(0x7fdd100beb70 msgr2=0x7fdd100bef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:53.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 -- 172.21.15.31:0/2999274754 shutdown_connections 2023-11-27T17:53:53.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 -- 172.21.15.31:0/2999274754 wait complete. 2023-11-27T17:53:53.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 Processor -- start 2023-11-27T17:53:53.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 -- start start 2023-11-27T17:53:53.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd100bab00 0x7fdd1013a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd100baee0 0x7fdd10143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd101435f0 0x7fdd1006b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1013a7f0 con 0x7fdd101435f0 2023-11-27T17:53:53.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd10137d40 con 0x7fdd100baee0 2023-11-27T17:53:53.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd101e77d0 con 0x7fdd100bab00 2023-11-27T17:53:53.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd1541e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd101435f0 0x7fdd1006b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd1541e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd101435f0 0x7fdd1006b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43028/0 (socket says 172.21.15.31:43028) 2023-11-27T17:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd1541e640 1 -- 172.21.15.31:0/1572043967 learned_addr learned my addr 172.21.15.31:0/1572043967 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd14c1d640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd100bab00 0x7fdd1013a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd0ffff640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd100baee0 0x7fdd10143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd1541e640 1 -- 172.21.15.31:0/1572043967 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd100bab00 msgr2=0x7fdd1013a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd1541e640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd100bab00 0x7fdd1013a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd1541e640 1 -- 172.21.15.31:0/1572043967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd100baee0 msgr2=0x7fdd10143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd1541e640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd100baee0 0x7fdd10143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd1541e640 1 -- 172.21.15.31:0/1572043967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd040094d0 con 0x7fdd101435f0 2023-11-27T17:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd1541e640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd101435f0 0x7fdd1006b670 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800b970 tx=0x7fdd0800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd0d7fa640 1 -- 172.21.15.31:0/1572043967 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0800cb40 con 0x7fdd101435f0 2023-11-27T17:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd0d7fa640 1 -- 172.21.15.31:0/1572043967 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0800cca0 con 0x7fdd101435f0 2023-11-27T17:53:53.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd0d7fa640 1 -- 172.21.15.31:0/1572043967 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd08014680 con 0x7fdd101435f0 2023-11-27T17:53:53.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 -- 172.21.15.31:0/1572043967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1006d310 con 0x7fdd101435f0 2023-11-27T17:53:53.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.620+0000 7fdd16e81640 1 -- 172.21.15.31:0/1572043967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd101e8050 con 0x7fdd101435f0 2023-11-27T17:53:53.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.624+0000 7fdd16e81640 1 -- 172.21.15.31:0/1572043967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd100b68b0 con 0x7fdd101435f0 2023-11-27T17:53:53.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.624+0000 7fdd0d7fa640 1 -- 172.21.15.31:0/1572043967 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fdd0801d3b0 con 0x7fdd101435f0 2023-11-27T17:53:53.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.624+0000 7fdd0d7fa640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdcfc0667f0 0x7fdcfc068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.624+0000 7fdd0d7fa640 1 -- 172.21.15.31:0/1572043967 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd08083f70 con 0x7fdd101435f0 2023-11-27T17:53:53.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.624+0000 7fdd14c1d640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdcfc0667f0 0x7fdcfc068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.624+0000 7fdd14c1d640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdcfc0667f0 0x7fdcfc068cb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd00007a60 tx=0x7fdd00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:53.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.628+0000 7fdd0d7fa640 1 -- 172.21.15.31:0/1572043967 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fdd080b5280 con 0x7fdd101435f0 2023-11-27T17:53:53.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.808+0000 7fdd16e81640 1 -- 172.21.15.31:0/1572043967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd1004e850 con 0x7fdd101435f0 2023-11-27T17:53:53.816 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd0d7fa640 1 -- 172.21.15.31:0/1572043967 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4111 (secure 0 0 0) 0x7fdd080511b0 con 0x7fdd101435f0 2023-11-27T17:53:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:53.816 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/1250401972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1250401972},{"type":"v1","addr":"172.21.15.31:6836","nonce":1250401972}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1133939246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1133939246},{"type":"v1","addr":"172.21.15.31:6837","nonce":1133939246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:53:23.383311+0000","modified":"2023-11-27T17:53:25.372630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6833/88283146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":88283146},{"type":"v1","addr":"172.21.15.81:6833","nonce":88283146}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:53:53.816 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2023-11-27T17:53:53.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd16e81640 1 -- 172.21.15.31:0/1572043967 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdcfc0667f0 msgr2=0x7fdcfc068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd16e81640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdcfc0667f0 0x7fdcfc068cb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd00007a60 tx=0x7fdd00008040 comp rx=0 tx=0).stop 2023-11-27T17:53:53.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd16e81640 1 -- 172.21.15.31:0/1572043967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd101435f0 msgr2=0x7fdd1006b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd16e81640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd101435f0 0x7fdd1006b670 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800b970 tx=0x7fdd0800be30 comp rx=0 tx=0).stop 2023-11-27T17:53:53.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd16e81640 1 -- 172.21.15.31:0/1572043967 shutdown_connections 2023-11-27T17:53:53.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd16e81640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fdcfc0667f0 0x7fdcfc068cb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd16e81640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdd101435f0 0x7fdd1006b670 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd16e81640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdd100baee0 0x7fdd10143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd16e81640 1 --2- 172.21.15.31:0/1572043967 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fdd100bab00 0x7fdd1013a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd16e81640 1 -- 172.21.15.31:0/1572043967 >> 172.21.15.31:0/1572043967 conn(0x7fdd100beb70 msgr2=0x7fdd100bca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:53.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd16e81640 1 -- 172.21.15.31:0/1572043967 shutdown_connections 2023-11-27T17:53:53.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.812+0000 7fdd16e81640 1 -- 172.21.15.31:0/1572043967 wait complete. 2023-11-27T17:53:53.834 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:53.947 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.940+0000 7efe832ac640 1 Processor -- start 2023-11-27T17:53:53.948 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe832ac640 1 -- start start 2023-11-27T17:53:53.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe832ac640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe7c1430a0 0x7efe7c0b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe832ac640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efe7c0bd240 0x7efe7c149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe832ac640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe7c0b5d00 con 0x7efe7c0bd680 2023-11-27T17:53:53.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe832ac640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7c143750 con 0x7efe7c0bd240 2023-11-27T17:53:53.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe832ac640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c143480 con 0x7efe7c1430a0 2023-11-27T17:53:53.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe80847640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efe7c0bd240 0x7efe7c149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe80847640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efe7c0bd240 0x7efe7c149070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43038/0 (socket says 172.21.15.31:43038) 2023-11-27T17:53:53.949 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe80847640 1 -- 172.21.15.31:0/3292344834 learned_addr learned my addr 172.21.15.31:0/3292344834 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:53.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe81048640 1 --2- 172.21.15.31:0/3292344834 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe7c1430a0 0x7efe7c0b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe80847640 1 -- 172.21.15.31:0/3292344834 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe7c1430a0 msgr2=0x7efe7c0b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:53.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe80847640 1 --2- 172.21.15.31:0/3292344834 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe7c1430a0 0x7efe7c0b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe80847640 1 -- 172.21.15.31:0/3292344834 >> v1:172.21.15.31:6789/0 conn(0x7efe7c0bd680 legacy=0x7efe7c14c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe73fff640 1 -- 172.21.15.31:0/3292344834 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770955799 0 0) 0x7efe740014a0 con 0x7efe7c0bd680 2023-11-27T17:53:53.950 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe80847640 1 -- 172.21.15.31:0/3292344834 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c0b4f40 con 0x7efe7c0bd240 2023-11-27T17:53:53.951 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.944+0000 7efe80847640 1 --2- 172.21.15.31:0/3292344834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe7c0bd240 0x7efe7c149070 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009870 tx=0x7efe6c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb57ddcf1deb206f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:53.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe73fff640 1 -- 172.21.15.31:0/3292344834 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0a8a30 con 0x7efe7c0bd240 2023-11-27T17:53:53.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe73fff640 1 -- 172.21.15.31:0/3292344834 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c0a8b90 con 0x7efe7c0bd240 2023-11-27T17:53:53.953 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe73fff640 1 -- 172.21.15.31:0/3292344834 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0b0440 con 0x7efe7c0bd240 2023-11-27T17:53:53.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 -- 172.21.15.31:0/3292344834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe7c0bd240 msgr2=0x7efe7c149070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 --2- 172.21.15.31:0/3292344834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe7c0bd240 0x7efe7c149070 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009870 tx=0x7efe6c01ed30 comp rx=0 tx=0).stop 2023-11-27T17:53:53.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 -- 172.21.15.31:0/3292344834 shutdown_connections 2023-11-27T17:53:53.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 --2- 172.21.15.31:0/3292344834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe7c0bd240 0x7efe7c149070 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 --2- 172.21.15.31:0/3292344834 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe7c1430a0 0x7efe7c0b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 -- 172.21.15.31:0/3292344834 >> 172.21.15.31:0/3292344834 conn(0x7efe7c06ab60 msgr2=0x7efe7c0bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:53.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 -- 172.21.15.31:0/3292344834 shutdown_connections 2023-11-27T17:53:53.954 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 -- 172.21.15.31:0/3292344834 wait complete. 2023-11-27T17:53:53.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 Processor -- start 2023-11-27T17:53:53.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 -- start start 2023-11-27T17:53:53.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe7c0bd240 0x7efe7c1d5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe7c0bd680 0x7efe7c14c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe7c1430a0 0x7efe7c14c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c14acf0 con 0x7efe7c0bd240 2023-11-27T17:53:53.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c1d5d50 con 0x7efe7c1430a0 2023-11-27T17:53:53.955 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe832ac640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7c14be70 con 0x7efe7c0bd680 2023-11-27T17:53:53.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.948+0000 7efe81048640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe7c0bd240 0x7efe7c1d5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe81048640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe7c0bd240 0x7efe7c1d5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43040/0 (socket says 172.21.15.31:43040) 2023-11-27T17:53:53.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe81048640 1 -- 172.21.15.31:0/1335312717 learned_addr learned my addr 172.21.15.31:0/1335312717 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:53.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe80847640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe7c0bd680 0x7efe7c14c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe81849640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe7c1430a0 0x7efe7c14c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe81048640 1 -- 172.21.15.31:0/1335312717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe7c0bd680 msgr2=0x7efe7c14c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe81048640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe7c0bd680 0x7efe7c14c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe81048640 1 -- 172.21.15.31:0/1335312717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe7c1430a0 msgr2=0x7efe7c14c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:53.957 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe81048640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe7c1430a0 0x7efe7c14c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:53.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe81048640 1 -- 172.21.15.31:0/1335312717 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c0094d0 con 0x7efe7c0bd240 2023-11-27T17:53:53.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe81849640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe7c1430a0 0x7efe7c14c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:53.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe81048640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe7c0bd240 0x7efe7c1d5810 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efe7800d5f0 tx=0x7efe7800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:53.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe71ffb640 1 -- 172.21.15.31:0/1335312717 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780125f0 con 0x7efe7c0bd240 2023-11-27T17:53:53.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe71ffb640 1 -- 172.21.15.31:0/1335312717 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78012750 con 0x7efe7c0bd240 2023-11-27T17:53:53.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe832ac640 1 -- 172.21.15.31:0/1335312717 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7c14bb70 con 0x7efe7c0bd240 2023-11-27T17:53:53.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe71ffb640 1 -- 172.21.15.31:0/1335312717 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78012ae0 con 0x7efe7c0bd240 2023-11-27T17:53:53.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe832ac640 1 -- 172.21.15.31:0/1335312717 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7c146810 con 0x7efe7c0bd240 2023-11-27T17:53:53.958 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe832ac640 1 -- 172.21.15.31:0/1335312717 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7c04e850 con 0x7efe7c0bd240 2023-11-27T17:53:53.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe71ffb640 1 -- 172.21.15.31:0/1335312717 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7efe78012c40 con 0x7efe7c0bd240 2023-11-27T17:53:53.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe71ffb640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efe600667f0 0x7efe60068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:53.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe71ffb640 1 -- 172.21.15.31:0/1335312717 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe78084660 con 0x7efe7c0bd240 2023-11-27T17:53:53.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe80847640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efe600667f0 0x7efe60068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:53.959 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.952+0000 7efe80847640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efe600667f0 0x7efe60068cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0b2000 tx=0x7efe6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:53.962 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:53.956+0000 7efe71ffb640 1 -- 172.21.15.31:0/1335312717 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7efe780517f0 con 0x7efe7c0bd240 2023-11-27T17:53:54.110 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.104+0000 7efe832ac640 1 -- 172.21.15.31:0/1335312717 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe7c0b8650 con 0x7efe7c0bd240 2023-11-27T17:53:54.112 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe71ffb640 1 -- 172.21.15.31:0/1335312717 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7efe78007380 con 0x7efe7c0bd240 2023-11-27T17:53:54.113 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:54.113 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:54.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe832ac640 1 -- 172.21.15.31:0/1335312717 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efe600667f0 msgr2=0x7efe60068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe832ac640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efe600667f0 0x7efe60068cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0b2000 tx=0x7efe6c009040 comp rx=0 tx=0).stop 2023-11-27T17:53:54.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe832ac640 1 -- 172.21.15.31:0/1335312717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe7c0bd240 msgr2=0x7efe7c1d5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe832ac640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe7c0bd240 0x7efe7c1d5810 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efe7800d5f0 tx=0x7efe7800dab0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe832ac640 1 -- 172.21.15.31:0/1335312717 shutdown_connections 2023-11-27T17:53:54.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe832ac640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7efe600667f0 0x7efe60068cb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe832ac640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efe7c1430a0 0x7efe7c14c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe832ac640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7efe7c0bd680 0x7efe7c14c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe832ac640 1 --2- 172.21.15.31:0/1335312717 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe7c0bd240 0x7efe7c1d5810 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe832ac640 1 -- 172.21.15.31:0/1335312717 >> 172.21.15.31:0/1335312717 conn(0x7efe7c06ab60 msgr2=0x7efe7c0bb230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:54.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe832ac640 1 -- 172.21.15.31:0/1335312717 shutdown_connections 2023-11-27T17:53:54.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.108+0000 7efe832ac640 1 -- 172.21.15.31:0/1335312717 wait complete. 2023-11-27T17:53:54.131 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:53:11.177026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-27T17:53:21.543531+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-27T17:53:22.362977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:53:54.131 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:53:54.247 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1befa8640 1 Processor -- start 2023-11-27T17:53:54.248 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1befa8640 1 -- start start 2023-11-27T17:53:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1befa8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa1b806ab90 0x7fa1b806af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1befa8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa1b80c0670 0x7fa1b814b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1befa8640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa1b80b6da0 0x7fa1b814eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1befa8640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b806b4b0 con 0x7fa1b80b6da0 2023-11-27T17:53:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1befa8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b80bfbd0 con 0x7fa1b806ab90 2023-11-27T17:53:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1befa8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b80b7ce0 con 0x7fa1b80c0670 2023-11-27T17:53:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1bd545640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa1b80b6da0 0x7fa1b814eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1bd545640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa1b80b6da0 0x7fa1b814eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43056/0 (socket says 172.21.15.31:43056) 2023-11-27T17:53:54.249 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1bd545640 1 -- 172.21.15.31:0/3010453336 learned_addr learned my addr 172.21.15.31:0/3010453336 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1b7fff640 1 --2- 172.21.15.31:0/3010453336 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa1b80c0670 0x7fa1b814b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1bcd44640 1 --2- 172.21.15.31:0/3010453336 >> v2:172.21.15.81:3300/0 conn(0x7fa1b806ab90 0x7fa1b806af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1bd545640 1 -- 172.21.15.31:0/3010453336 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa1b80c0670 msgr2=0x7fa1b814b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1bd545640 1 --2- 172.21.15.31:0/3010453336 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa1b80c0670 0x7fa1b814b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1bd545640 1 -- 172.21.15.31:0/3010453336 >> v2:172.21.15.81:3300/0 conn(0x7fa1b806ab90 msgr2=0x7fa1b806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1bd545640 1 --2- 172.21.15.31:0/3010453336 >> v2:172.21.15.81:3300/0 conn(0x7fa1b806ab90 0x7fa1b806af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1bd545640 1 -- 172.21.15.31:0/3010453336 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b80bfe70 con 0x7fa1b80b6da0 2023-11-27T17:53:54.250 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1b7fff640 1 --2- 172.21.15.31:0/3010453336 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa1b80c0670 0x7fa1b814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1bd545640 1 --2- 172.21.15.31:0/3010453336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1b80b6da0 0x7fa1b814eb00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80a39b0 tx=0x7fa1b001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7ce791f09e19e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1b77fe640 1 -- 172.21.15.31:0/3010453336 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00a5650 con 0x7fa1b80b6da0 2023-11-27T17:53:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1b77fe640 1 -- 172.21.15.31:0/3010453336 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b00a57b0 con 0x7fa1b80b6da0 2023-11-27T17:53:54.251 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.244+0000 7fa1b77fe640 1 -- 172.21.15.31:0/3010453336 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00a5b40 con 0x7fa1b80b6da0 2023-11-27T17:53:54.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 -- 172.21.15.31:0/3010453336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1b80b6da0 msgr2=0x7fa1b814eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 --2- 172.21.15.31:0/3010453336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1b80b6da0 0x7fa1b814eb00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80a39b0 tx=0x7fa1b001c9d0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 -- 172.21.15.31:0/3010453336 shutdown_connections 2023-11-27T17:53:54.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 --2- 172.21.15.31:0/3010453336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1b80b6da0 0x7fa1b814eb00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 --2- 172.21.15.31:0/3010453336 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa1b80c0670 0x7fa1b814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 --2- 172.21.15.31:0/3010453336 >> v2:172.21.15.81:3300/0 conn(0x7fa1b806ab90 0x7fa1b806af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 -- 172.21.15.31:0/3010453336 >> 172.21.15.31:0/3010453336 conn(0x7fa1b80a28f0 msgr2=0x7fa1b80a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:54.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 -- 172.21.15.31:0/3010453336 shutdown_connections 2023-11-27T17:53:54.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 -- 172.21.15.31:0/3010453336 wait complete. 2023-11-27T17:53:54.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 Processor -- start 2023-11-27T17:53:54.253 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 -- start start 2023-11-27T17:53:54.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b806ab90 0x7fa1b8149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa1b80b6da0 0x7fa1b814a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1b80c0670 0x7fa1b813f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b8149db0 con 0x7fa1b80c0670 2023-11-27T17:53:54.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b814a820 con 0x7fa1b806ab90 2023-11-27T17:53:54.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b814ce70 con 0x7fa1b80b6da0 2023-11-27T17:53:54.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1bd545640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1b80c0670 0x7fa1b813f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1bd545640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1b80c0670 0x7fa1b813f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43066/0 (socket says 172.21.15.31:43066) 2023-11-27T17:53:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1bd545640 1 -- 172.21.15.31:0/1791277864 learned_addr learned my addr 172.21.15.31:0/1791277864 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1b7fff640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa1b80b6da0 0x7fa1b814a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1bcd44640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b806ab90 0x7fa1b8149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1bd545640 1 -- 172.21.15.31:0/1791277864 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa1b80b6da0 msgr2=0x7fa1b814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1bd545640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa1b80b6da0 0x7fa1b814a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1bd545640 1 -- 172.21.15.31:0/1791277864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b806ab90 msgr2=0x7fa1b8149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1bd545640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b806ab90 0x7fa1b8149870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1bd545640 1 -- 172.21.15.31:0/1791277864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0009b30 con 0x7fa1b80c0670 2023-11-27T17:53:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1bd545640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1b80c0670 0x7fa1b813f4d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00af040 tx=0x7fa1b0019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1b57fa640 1 -- 172.21.15.31:0/1791277864 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00b8670 con 0x7fa1b80c0670 2023-11-27T17:53:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1b57fa640 1 -- 172.21.15.31:0/1791277864 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b00b87d0 con 0x7fa1b80c0670 2023-11-27T17:53:54.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1b57fa640 1 -- 172.21.15.31:0/1791277864 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00b8b80 con 0x7fa1b80c0670 2023-11-27T17:53:54.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 -- 172.21.15.31:0/1791277864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b814a560 con 0x7fa1b80c0670 2023-11-27T17:53:54.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.248+0000 7fa1befa8640 1 -- 172.21.15.31:0/1791277864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b814c820 con 0x7fa1b80c0670 2023-11-27T17:53:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.252+0000 7fa1befa8640 1 -- 172.21.15.31:0/1791277864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b814d000 con 0x7fa1b80c0670 2023-11-27T17:53:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.252+0000 7fa1b57fa640 1 -- 172.21.15.31:0/1791277864 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa1b00b8ce0 con 0x7fa1b80c0670 2023-11-27T17:53:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.252+0000 7fa1b57fa640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa19c066820 0x7fa19c068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.252+0000 7fa1b57fa640 1 -- 172.21.15.31:0/1791277864 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1b011f7a0 con 0x7fa1b80c0670 2023-11-27T17:53:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.252+0000 7fa1bcd44640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa19c066820 0x7fa19c068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.252+0000 7fa1bcd44640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa19c066820 0x7fa19c068ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4006fd0 tx=0x7fa1a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:54.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.256+0000 7fa1b57fa640 1 -- 172.21.15.31:0/1791277864 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa1b00ecbc0 con 0x7fa1b80c0670 2023-11-27T17:53:54.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.412+0000 7fa1befa8640 1 -- 172.21.15.31:0/1791277864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1b804e850 con 0x7fa1b80c0670 2023-11-27T17:53:54.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.412+0000 7fa1b57fa640 1 -- 172.21.15.31:0/1791277864 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1b00f01e0 con 0x7fa1b80c0670 2023-11-27T17:53:54.418 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-11-27T17:53:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.416+0000 7fa1befa8640 1 -- 172.21.15.31:0/1791277864 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa19c066820 msgr2=0x7fa19c068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.416+0000 7fa1befa8640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa19c066820 0x7fa19c068ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4006fd0 tx=0x7fa1a4008040 comp rx=0 tx=0).stop 2023-11-27T17:53:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.416+0000 7fa1befa8640 1 -- 172.21.15.31:0/1791277864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1b80c0670 msgr2=0x7fa1b813f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.416+0000 7fa1befa8640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1b80c0670 0x7fa1b813f4d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00af040 tx=0x7fa1b0019770 comp rx=0 tx=0).stop 2023-11-27T17:53:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.416+0000 7fa1befa8640 1 -- 172.21.15.31:0/1791277864 shutdown_connections 2023-11-27T17:53:54.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.416+0000 7fa1befa8640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa19c066820 0x7fa19c068ce0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.416+0000 7fa1befa8640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa1b80c0670 0x7fa1b813f4d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.416+0000 7fa1befa8640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa1b80b6da0 0x7fa1b814a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.416+0000 7fa1befa8640 1 --2- 172.21.15.31:0/1791277864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1b806ab90 0x7fa1b8149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.416+0000 7fa1befa8640 1 -- 172.21.15.31:0/1791277864 >> 172.21.15.31:0/1791277864 conn(0x7fa1b80a28f0 msgr2=0x7fa1b80b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.416+0000 7fa1befa8640 1 -- 172.21.15.31:0/1791277864 shutdown_connections 2023-11-27T17:53:54.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.416+0000 7fa1befa8640 1 -- 172.21.15.31:0/1791277864 wait complete. 2023-11-27T17:53:54.438 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-27T17:53:54.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda4003f640 1 Processor -- start 2023-11-27T17:53:54.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda4003f640 1 -- start start 2023-11-27T17:53:54.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda4003f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fda38143560 0x7fda380bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda4003f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda3806f1d0 0x7fda381494f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda4003f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda38071260 con 0x7fda38149a30 2023-11-27T17:53:54.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda4003f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda38143940 con 0x7fda38143560 2023-11-27T17:53:54.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda4003f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda38149ec0 con 0x7fda3806f1d0 2023-11-27T17:53:54.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda3dddb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fda38143560 0x7fda380bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda3dddb640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fda38143560 0x7fda380bd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36758/0 (socket says 172.21.15.31:36758) 2023-11-27T17:53:54.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda3dddb640 1 -- 172.21.15.31:0/2549575004 learned_addr learned my addr 172.21.15.31:0/2549575004 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:54.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda3d5da640 1 --2- 172.21.15.31:0/2549575004 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda3806f1d0 0x7fda381494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda3dddb640 1 -- 172.21.15.31:0/2549575004 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda3806f1d0 msgr2=0x7fda381494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:54.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda3dddb640 1 --2- 172.21.15.31:0/2549575004 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda3806f1d0 0x7fda381494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda3dddb640 1 -- 172.21.15.31:0/2549575004 >> v1:172.21.15.31:6789/0 conn(0x7fda38149a30 legacy=0x7fda3814c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda3cdd9640 1 -- 172.21.15.31:0/2549575004 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789114066 0 0) 0x7fda38071260 con 0x7fda38149a30 2023-11-27T17:53:54.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.564+0000 7fda3dddb640 1 -- 172.21.15.31:0/2549575004 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3806f800 con 0x7fda38143560 2023-11-27T17:53:54.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3dddb640 1 --2- 172.21.15.31:0/2549575004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda38143560 0x7fda380bd240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fda30009e50 tx=0x7fda3001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfda8a3eea2810c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:54.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3cdd9640 1 -- 172.21.15.31:0/2549575004 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300a57c0 con 0x7fda38143560 2023-11-27T17:53:54.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3cdd9640 1 -- 172.21.15.31:0/2549575004 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda300a5920 con 0x7fda38143560 2023-11-27T17:53:54.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3cdd9640 1 -- 172.21.15.31:0/2549575004 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300a5cb0 con 0x7fda38143560 2023-11-27T17:53:54.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 -- 172.21.15.31:0/2549575004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda38143560 msgr2=0x7fda380bd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 --2- 172.21.15.31:0/2549575004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda38143560 0x7fda380bd240 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fda30009e50 tx=0x7fda3001c9e0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 -- 172.21.15.31:0/2549575004 shutdown_connections 2023-11-27T17:53:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 --2- 172.21.15.31:0/2549575004 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda3806f1d0 0x7fda381494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 --2- 172.21.15.31:0/2549575004 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda38143560 0x7fda380bd240 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 -- 172.21.15.31:0/2549575004 >> 172.21.15.31:0/2549575004 conn(0x7fda3806ab60 msgr2=0x7fda380bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 -- 172.21.15.31:0/2549575004 shutdown_connections 2023-11-27T17:53:54.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 -- 172.21.15.31:0/2549575004 wait complete. 2023-11-27T17:53:54.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 Processor -- start 2023-11-27T17:53:54.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 -- start start 2023-11-27T17:53:54.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda3806f1d0 0x7fda381392e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda38143560 0x7fda381486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda38149a30 0x7fda38147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda38139820 con 0x7fda38143560 2023-11-27T17:53:54.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda380bb4d0 con 0x7fda3806f1d0 2023-11-27T17:53:54.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda4003f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda381416d0 con 0x7fda38149a30 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3d5da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda38143560 0x7fda381486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3d5da640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda38143560 0x7fda381486e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36772/0 (socket says 172.21.15.31:36772) 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3d5da640 1 -- 172.21.15.31:0/2986432100 learned_addr learned my addr 172.21.15.31:0/2986432100 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3dddb640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda3806f1d0 0x7fda381392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3e5dc640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda38149a30 0x7fda38147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3d5da640 1 -- 172.21.15.31:0/2986432100 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda38149a30 msgr2=0x7fda38147010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3d5da640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda38149a30 0x7fda38147010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3d5da640 1 -- 172.21.15.31:0/2986432100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda3806f1d0 msgr2=0x7fda381392e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3d5da640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda3806f1d0 0x7fda381392e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.568+0000 7fda3d5da640 1 -- 172.21.15.31:0/2986432100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30009b30 con 0x7fda38143560 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.572+0000 7fda3d5da640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda38143560 0x7fda381486e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fda3400e930 tx=0x7fda3400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.572+0000 7fda2a7fc640 1 -- 172.21.15.31:0/2986432100 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34009690 con 0x7fda38143560 2023-11-27T17:53:54.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.572+0000 7fda2a7fc640 1 -- 172.21.15.31:0/2986432100 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3400ca00 con 0x7fda38143560 2023-11-27T17:53:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.572+0000 7fda4003f640 1 -- 172.21.15.31:0/2986432100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda380bb1f0 con 0x7fda38143560 2023-11-27T17:53:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.572+0000 7fda2a7fc640 1 -- 172.21.15.31:0/2986432100 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3400cd70 con 0x7fda38143560 2023-11-27T17:53:54.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.572+0000 7fda4003f640 1 -- 172.21.15.31:0/2986432100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda380bbb80 con 0x7fda38143560 2023-11-27T17:53:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.572+0000 7fda4003f640 1 -- 172.21.15.31:0/2986432100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3804e850 con 0x7fda38143560 2023-11-27T17:53:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.572+0000 7fda2a7fc640 1 -- 172.21.15.31:0/2986432100 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fda34013470 con 0x7fda38143560 2023-11-27T17:53:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.572+0000 7fda2a7fc640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fda1c0667f0 0x7fda1c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.572+0000 7fda2a7fc640 1 -- 172.21.15.31:0/2986432100 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda34084430 con 0x7fda38143560 2023-11-27T17:53:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.572+0000 7fda3dddb640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fda1c0667f0 0x7fda1c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.572+0000 7fda3dddb640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fda1c0667f0 0x7fda1c068cb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fda300ae000 tx=0x7fda300a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:54.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.576+0000 7fda2a7fc640 1 -- 172.21.15.31:0/2986432100 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fda34051680 con 0x7fda38143560 2023-11-27T17:53:54.736 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 -- 172.21.15.31:0/2986432100 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda380b6e00 con 0x7fda38143560 2023-11-27T17:53:54.737 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda2a7fc640 1 -- 172.21.15.31:0/2986432100 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda34054ca0 con 0x7fda38143560 2023-11-27T17:53:54.737 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2023-11-27T17:53:54.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 -- 172.21.15.31:0/2986432100 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fda1c0667f0 msgr2=0x7fda1c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fda1c0667f0 0x7fda1c068cb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fda300ae000 tx=0x7fda300a7070 comp rx=0 tx=0).stop 2023-11-27T17:53:54.739 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 -- 172.21.15.31:0/2986432100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda38143560 msgr2=0x7fda381486e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda38143560 0x7fda381486e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fda3400e930 tx=0x7fda3400edf0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 -- 172.21.15.31:0/2986432100 shutdown_connections 2023-11-27T17:53:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fda1c0667f0 0x7fda1c068cb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fda38149a30 0x7fda38147010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fda38143560 0x7fda381486e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 --2- 172.21.15.31:0/2986432100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda3806f1d0 0x7fda381392e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 -- 172.21.15.31:0/2986432100 >> 172.21.15.31:0/2986432100 conn(0x7fda3806ab60 msgr2=0x7fda380b9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 -- 172.21.15.31:0/2986432100 shutdown_connections 2023-11-27T17:53:54.740 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.732+0000 7fda4003f640 1 -- 172.21.15.31:0/2986432100 wait complete. 2023-11-27T17:53:54.756 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-27T17:53:54.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe7845e640 1 Processor -- start 2023-11-27T17:53:54.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe7845e640 1 -- start start 2023-11-27T17:53:54.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe7845e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fbe7006ab90 0x7fbe7006af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe7845e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe700b6da0 0x7fbe70155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe7845e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7006b4b0 con 0x7fbe700c0670 2023-11-27T17:53:54.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe7845e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe700bfbd0 con 0x7fbe7006ab90 2023-11-27T17:53:54.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe7845e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700b7ce0 con 0x7fbe700b6da0 2023-11-27T17:53:54.880 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe759f9640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbe700c0670 0x7fbe7014b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48874/0 (socket says 172.21.15.31:48874) 2023-11-27T17:53:54.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe759f9640 1 -- 172.21.15.31:0/1686779721 learned_addr learned my addr 172.21.15.31:0/1686779721 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:54.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe761fa640 1 --2- 172.21.15.31:0/1686779721 >> v2:172.21.15.81:3300/0 conn(0x7fbe7006ab90 0x7fbe7006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe769fb640 1 --2- 172.21.15.31:0/1686779721 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe700b6da0 0x7fbe70155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269836777 0 0) 0x7fbe7006b4b0 con 0x7fbe700c0670 2023-11-27T17:53:54.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe58003530 con 0x7fbe700c0670 2023-11-27T17:53:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2947401709 0 0) 0x7fbe58003530 con 0x7fbe700c0670 2023-11-27T17:53:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe700b6da0 msgr2=0x7fbe70155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 --2- 172.21.15.31:0/1686779721 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe700b6da0 0x7fbe70155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 >> v2:172.21.15.81:3300/0 conn(0x7fbe7006ab90 msgr2=0x7fbe7006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:54.882 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 --2- 172.21.15.31:0/1686779721 >> v2:172.21.15.81:3300/0 conn(0x7fbe7006ab90 0x7fbe7006af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe700bfe70 con 0x7fbe700c0670 2023-11-27T17:53:54.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7fbe6c001680 con 0x7fbe700c0670 2023-11-27T17:53:54.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 >> v1:172.21.15.31:6789/0 conn(0x7fbe700c0670 legacy=0x7fbe7014b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.883 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 --2- 172.21.15.31:0/1686779721 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe700b6da0 0x7fbe580039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 --2- 172.21.15.31:0/1686779721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe58003f70 0x7fbe580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 --2- 172.21.15.31:0/1686779721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe58004d10 0x7fbe58005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700bfbd0 con 0x7fbe58004d10 2023-11-27T17:53:54.884 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700b7ce0 con 0x7fbe58003f70 2023-11-27T17:53:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5800b9c0 con 0x7fbe700b6da0 2023-11-27T17:53:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe769fb640 1 --2- 172.21.15.31:0/1686779721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe58004d10 0x7fbe58005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe761fa640 1 --2- 172.21.15.31:0/1686779721 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe700b6da0 0x7fbe580039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe769fb640 1 -- 172.21.15.31:0/1686779721 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe700b6da0 msgr2=0x7fbe580039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe769fb640 1 --2- 172.21.15.31:0/1686779721 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe700b6da0 0x7fbe580039f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe769fb640 1 -- 172.21.15.31:0/1686779721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe58003f70 msgr2=0x7fbe580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe769fb640 1 --2- 172.21.15.31:0/1686779721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe58003f70 0x7fbe580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.872+0000 7fbe769fb640 1 -- 172.21.15.31:0/1686779721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe58003530 con 0x7fbe58004d10 2023-11-27T17:53:54.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe769fb640 1 --2- 172.21.15.31:0/1686779721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe58004d10 0x7fbe58005190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009ae0 tx=0x7fbe6001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1642c5441a3f2a24 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:54.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe600a5640 con 0x7fbe58004d10 2023-11-27T17:53:54.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe600a57a0 con 0x7fbe58004d10 2023-11-27T17:53:54.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe751f8640 1 -- 172.21.15.31:0/1686779721 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe600a5b50 con 0x7fbe58004d10 2023-11-27T17:53:54.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe7845e640 1 -- 172.21.15.31:0/1686779721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe58004d10 msgr2=0x7fbe58005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe7845e640 1 --2- 172.21.15.31:0/1686779721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe58004d10 0x7fbe58005190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbe60009ae0 tx=0x7fbe6001ca50 comp rx=0 tx=0).stop 2023-11-27T17:53:54.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe769fb640 1 -- 172.21.15.31:0/1686779721 reap_dead start 2023-11-27T17:53:54.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe7845e640 1 -- 172.21.15.31:0/1686779721 shutdown_connections 2023-11-27T17:53:54.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe7845e640 1 -- 172.21.15.31:0/1686779721 >> 172.21.15.31:0/1686779721 conn(0x7fbe700a28f0 msgr2=0x7fbe700a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:54.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe7845e640 1 -- 172.21.15.31:0/1686779721 shutdown_connections 2023-11-27T17:53:54.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe7845e640 1 -- 172.21.15.31:0/1686779721 wait complete. 2023-11-27T17:53:54.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe7845e640 1 Processor -- start 2023-11-27T17:53:54.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.876+0000 7fbe7845e640 1 -- start start 2023-11-27T17:53:54.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe7845e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe58004d10 0x7fbe700a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe7845e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe701465c0 0x7fbe701e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe7845e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe701e1080 0x7fbe701da8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe7845e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe701e4c10 con 0x7fbe701465c0 2023-11-27T17:53:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe7845e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700a68b0 con 0x7fbe58004d10 2023-11-27T17:53:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe7845e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7014ae00 con 0x7fbe701e1080 2023-11-27T17:53:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe759f9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe701465c0 0x7fbe701e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe759f9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe701465c0 0x7fbe701e0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36788/0 (socket says 172.21.15.31:36788) 2023-11-27T17:53:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe759f9640 1 -- 172.21.15.31:0/2248506885 learned_addr learned my addr 172.21.15.31:0/2248506885 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:54.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe769fb640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe701e1080 0x7fbe701da8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe759f9640 1 -- 172.21.15.31:0/2248506885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe701e1080 msgr2=0x7fbe701da8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe759f9640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe701e1080 0x7fbe701da8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe759f9640 1 -- 172.21.15.31:0/2248506885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe58004d10 msgr2=0x7fbe700a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe761fa640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe58004d10 0x7fbe700a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe759f9640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe58004d10 0x7fbe700a6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe759f9640 1 -- 172.21.15.31:0/2248506885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe701e42b0 con 0x7fbe701465c0 2023-11-27T17:53:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe759f9640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe701465c0 0x7fbe701e0b40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c770 tx=0x7fbe6c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:54.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe66ffd640 1 -- 172.21.15.31:0/2248506885 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0074e0 con 0x7fbe701465c0 2023-11-27T17:53:54.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe66ffd640 1 -- 172.21.15.31:0/2248506885 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c007640 con 0x7fbe701465c0 2023-11-27T17:53:54.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe7845e640 1 -- 172.21.15.31:0/2248506885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe701e5030 con 0x7fbe701465c0 2023-11-27T17:53:54.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe66ffd640 1 -- 172.21.15.31:0/2248506885 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c004a30 con 0x7fbe701465c0 2023-11-27T17:53:54.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe7845e640 1 -- 172.21.15.31:0/2248506885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe701e4830 con 0x7fbe701465c0 2023-11-27T17:53:54.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe7845e640 1 -- 172.21.15.31:0/2248506885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe701e4d50 con 0x7fbe701465c0 2023-11-27T17:53:54.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe66ffd640 1 -- 172.21.15.31:0/2248506885 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fbe6c004b90 con 0x7fbe701465c0 2023-11-27T17:53:54.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe66ffd640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbe5c0667f0 0x7fbe5c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:54.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe761fa640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbe5c0667f0 0x7fbe5c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:54.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe66ffd640 1 -- 172.21.15.31:0/2248506885 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe6c0839f0 con 0x7fbe701465c0 2023-11-27T17:53:54.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.880+0000 7fbe761fa640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbe5c0667f0 0x7fbe5c068cb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbe68003a60 tx=0x7fbe6800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:54.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:54.884+0000 7fbe66ffd640 1 -- 172.21.15.31:0/2248506885 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fbe6c050ae0 con 0x7fbe701465c0 2023-11-27T17:53:55.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.036+0000 7fbe7845e640 1 -- 172.21.15.31:0/2248506885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe7004e850 con 0x7fbe701465c0 2023-11-27T17:53:55.042 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.036+0000 7fbe66ffd640 1 -- 172.21.15.31:0/2248506885 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe6c018020 con 0x7fbe701465c0 2023-11-27T17:53:55.043 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2023-11-27T17:53:55.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.040+0000 7fbe7845e640 1 -- 172.21.15.31:0/2248506885 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbe5c0667f0 msgr2=0x7fbe5c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.040+0000 7fbe7845e640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbe5c0667f0 0x7fbe5c068cb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbe68003a60 tx=0x7fbe6800b040 comp rx=0 tx=0).stop 2023-11-27T17:53:55.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.040+0000 7fbe7845e640 1 -- 172.21.15.31:0/2248506885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe701465c0 msgr2=0x7fbe701e0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.040+0000 7fbe7845e640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe701465c0 0x7fbe701e0b40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c770 tx=0x7fbe6c00cc30 comp rx=0 tx=0).stop 2023-11-27T17:53:55.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.040+0000 7fbe7845e640 1 -- 172.21.15.31:0/2248506885 shutdown_connections 2023-11-27T17:53:55.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.040+0000 7fbe7845e640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fbe5c0667f0 0x7fbe5c068cb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.040+0000 7fbe7845e640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fbe701e1080 0x7fbe701da8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.040+0000 7fbe7845e640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbe701465c0 0x7fbe701e0b40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.040+0000 7fbe7845e640 1 --2- 172.21.15.31:0/2248506885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe58004d10 0x7fbe700a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.040+0000 7fbe7845e640 1 -- 172.21.15.31:0/2248506885 >> 172.21.15.31:0/2248506885 conn(0x7fbe700a28f0 msgr2=0x7fbe700a1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:55.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.040+0000 7fbe7845e640 1 -- 172.21.15.31:0/2248506885 shutdown_connections 2023-11-27T17:53:55.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.040+0000 7fbe7845e640 1 -- 172.21.15.31:0/2248506885 wait complete. 2023-11-27T17:53:55.060 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:53:55.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f995a640 1 Processor -- start 2023-11-27T17:53:55.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f995a640 1 -- start start 2023-11-27T17:53:55.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f995a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f22f41430a0 0x7f22f40b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f995a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22f40bd240 0x7f22f4149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f995a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f40b5d00 con 0x7f22f40bd680 2023-11-27T17:53:55.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f995a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f4143750 con 0x7f22f41430a0 2023-11-27T17:53:55.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f995a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f4143480 con 0x7f22f40bd240 2023-11-27T17:53:55.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f2ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f22f41430a0 0x7f22f40b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f2ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f22f41430a0 0x7f22f40b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36802/0 (socket says 172.21.15.31:36802) 2023-11-27T17:53:55.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f2ffd640 1 -- 172.21.15.31:0/1652858311 learned_addr learned my addr 172.21.15.31:0/1652858311 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:55.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f27fc640 1 --2- 172.21.15.31:0/1652858311 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22f40bd240 0x7f22f4149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f2ffd640 1 -- 172.21.15.31:0/1652858311 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22f40bd240 msgr2=0x7f22f4149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:55.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f2ffd640 1 --2- 172.21.15.31:0/1652858311 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22f40bd240 0x7f22f4149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f2ffd640 1 -- 172.21.15.31:0/1652858311 >> v1:172.21.15.81:6789/0 conn(0x7f22f40bd680 legacy=0x7f22f414c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.168+0000 7f22f2ffd640 1 -- 172.21.15.31:0/1652858311 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f40b4f40 con 0x7f22f41430a0 2023-11-27T17:53:55.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f2ffd640 1 --2- 172.21.15.31:0/1652858311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22f41430a0 0x7f22f40b4030 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009870 tx=0x7f22e801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ade435360f2515 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:55.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f1ffb640 1 -- 172.21.15.31:0/1652858311 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e80a8a30 con 0x7f22f41430a0 2023-11-27T17:53:55.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f1ffb640 1 -- 172.21.15.31:0/1652858311 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e80a8b90 con 0x7f22f41430a0 2023-11-27T17:53:55.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f1ffb640 1 -- 172.21.15.31:0/1652858311 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e80b0440 con 0x7f22f41430a0 2023-11-27T17:53:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 -- 172.21.15.31:0/1652858311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22f41430a0 msgr2=0x7f22f40b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 --2- 172.21.15.31:0/1652858311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22f41430a0 0x7f22f40b4030 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009870 tx=0x7f22e801ed30 comp rx=0 tx=0).stop 2023-11-27T17:53:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 -- 172.21.15.31:0/1652858311 shutdown_connections 2023-11-27T17:53:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 --2- 172.21.15.31:0/1652858311 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22f40bd240 0x7f22f4149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 --2- 172.21.15.31:0/1652858311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22f41430a0 0x7f22f40b4030 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 -- 172.21.15.31:0/1652858311 >> 172.21.15.31:0/1652858311 conn(0x7f22f406ab60 msgr2=0x7f22f40bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 -- 172.21.15.31:0/1652858311 shutdown_connections 2023-11-27T17:53:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 -- 172.21.15.31:0/1652858311 wait complete. 2023-11-27T17:53:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 Processor -- start 2023-11-27T17:53:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 -- start start 2023-11-27T17:53:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22f40bd240 0x7f22f41d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f40bd680 0x7f22f414c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22f41430a0 0x7f22f41dea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f414cd40 con 0x7f22f40bd240 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f414d2a0 con 0x7f22f40bd680 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f995a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f4072160 con 0x7f22f41430a0 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f2ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22f40bd240 0x7f22f41d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f2ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22f40bd240 0x7f22f41d2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36812/0 (socket says 172.21.15.31:36812) 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f2ffd640 1 -- 172.21.15.31:0/2918596635 learned_addr learned my addr 172.21.15.31:0/2918596635 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f27fc640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f40bd680 0x7f22f414c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f37fe640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22f41430a0 0x7f22f41dea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f2ffd640 1 -- 172.21.15.31:0/2918596635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22f41430a0 msgr2=0x7f22f41dea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f2ffd640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22f41430a0 0x7f22f41dea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f2ffd640 1 -- 172.21.15.31:0/2918596635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f40bd680 msgr2=0x7f22f414c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f2ffd640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f40bd680 0x7f22f414c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f2ffd640 1 -- 172.21.15.31:0/2918596635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e80094d0 con 0x7f22f40bd240 2023-11-27T17:53:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f37fe640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22f41430a0 0x7f22f41dea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f27fc640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f40bd680 0x7f22f414c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.172+0000 7f22f2ffd640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22f40bd240 0x7f22f41d2e20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f22e80b3040 tx=0x7f22e801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.176+0000 7f22dbfff640 1 -- 172.21.15.31:0/2918596635 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e80b0dd0 con 0x7f22f40bd240 2023-11-27T17:53:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.176+0000 7f22dbfff640 1 -- 172.21.15.31:0/2918596635 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e80bb460 con 0x7f22f40bd240 2023-11-27T17:53:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.176+0000 7f22f995a640 1 -- 172.21.15.31:0/2918596635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f40bbb00 con 0x7f22f40bd240 2023-11-27T17:53:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.176+0000 7f22dbfff640 1 -- 172.21.15.31:0/2918596635 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e80bb810 con 0x7f22f40bd240 2023-11-27T17:53:55.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.176+0000 7f22f995a640 1 -- 172.21.15.31:0/2918596635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f4071b10 con 0x7f22f40bd240 2023-11-27T17:53:55.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.176+0000 7f22f995a640 1 -- 172.21.15.31:0/2918596635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f404e850 con 0x7f22f40bd240 2023-11-27T17:53:55.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.176+0000 7f22dbfff640 1 -- 172.21.15.31:0/2918596635 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f22e80b83f0 con 0x7f22f40bd240 2023-11-27T17:53:55.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.176+0000 7f22dbfff640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f22e00667f0 0x7f22e0068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.176+0000 7f22dbfff640 1 -- 172.21.15.31:0/2918596635 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22e8121b60 con 0x7f22f40bd240 2023-11-27T17:53:55.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.176+0000 7f22f27fc640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f22e00667f0 0x7f22e0068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.183 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.176+0000 7f22f27fc640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f22e00667f0 0x7f22e0068cb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f22f40bc980 tx=0x7f22ec00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:55.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.180+0000 7f22dbfff640 1 -- 172.21.15.31:0/2918596635 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f22e80eecf0 con 0x7f22f40bd240 2023-11-27T17:53:55.370 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.364+0000 7f22f995a640 1 -- 172.21.15.31:0/2918596635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22f40b6d00 con 0x7f22f40bd240 2023-11-27T17:53:55.371 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.364+0000 7f22dbfff640 1 -- 172.21.15.31:0/2918596635 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4111 (secure 0 0 0) 0x7f22e80b5090 con 0x7f22f40bd240 2023-11-27T17:53:55.371 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:55.371 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/1250401972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1250401972},{"type":"v1","addr":"172.21.15.31:6836","nonce":1250401972}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1133939246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1133939246},{"type":"v1","addr":"172.21.15.31:6837","nonce":1133939246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:53:23.383311+0000","modified":"2023-11-27T17:53:25.372630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6833/88283146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":88283146},{"type":"v1","addr":"172.21.15.81:6833","nonce":88283146}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:53:55.372 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2023-11-27T17:53:55.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.368+0000 7f22f995a640 1 -- 172.21.15.31:0/2918596635 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f22e00667f0 msgr2=0x7f22e0068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.368+0000 7f22f995a640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f22e00667f0 0x7f22e0068cb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f22f40bc980 tx=0x7f22ec00b040 comp rx=0 tx=0).stop 2023-11-27T17:53:55.373 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.368+0000 7f22f995a640 1 -- 172.21.15.31:0/2918596635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22f40bd240 msgr2=0x7f22f41d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.368+0000 7f22f995a640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22f40bd240 0x7f22f41d2e20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f22e80b3040 tx=0x7f22e801bad0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.368+0000 7f22f995a640 1 -- 172.21.15.31:0/2918596635 shutdown_connections 2023-11-27T17:53:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.368+0000 7f22f995a640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f22e00667f0 0x7f22e0068cb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.368+0000 7f22f995a640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22f41430a0 0x7f22f41dea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.368+0000 7f22f995a640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22f40bd680 0x7f22f414c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.368+0000 7f22f995a640 1 --2- 172.21.15.31:0/2918596635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22f40bd240 0x7f22f41d2e20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.368+0000 7f22f995a640 1 -- 172.21.15.31:0/2918596635 >> 172.21.15.31:0/2918596635 conn(0x7f22f406ab60 msgr2=0x7f22f40b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.368+0000 7f22f995a640 1 -- 172.21.15.31:0/2918596635 shutdown_connections 2023-11-27T17:53:55.374 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.368+0000 7f22f995a640 1 -- 172.21.15.31:0/2918596635 wait complete. 2023-11-27T17:53:55.389 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.504+0000 7f1ca54f1640 1 Processor -- start 2023-11-27T17:53:55.511 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.504+0000 7f1ca54f1640 1 -- start start 2023-11-27T17:53:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1ca54f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ca014e880 0x7f1ca00b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.513 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1ca54f1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca0144dd0 0x7f1ca0145260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1ca54f1640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca00b8d90 con 0x7f1ca00b8440 2023-11-27T17:53:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1ca54f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca00ba130 con 0x7f1ca014e880 2023-11-27T17:53:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1ca54f1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca006bc10 con 0x7f1ca0144dd0 2023-11-27T17:53:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9effd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1ca00b8440 0x7f1ca00bcf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48878/0 (socket says 172.21.15.31:48878) 2023-11-27T17:53:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9effd640 1 -- 172.21.15.31:0/482991270 learned_addr learned my addr 172.21.15.31:0/482991270 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9f7fe640 1 --2- 172.21.15.31:0/482991270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca0144dd0 0x7f1ca0145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.514 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9e7fc640 1 --2- 172.21.15.31:0/482991270 >> v2:172.21.15.81:3300/0 conn(0x7f1ca014e880 0x7f1ca00b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022323002 0 0) 0x7f1ca00b8d90 con 0x7f1ca00b8440 2023-11-27T17:53:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c88003530 con 0x7f1ca00b8440 2023-11-27T17:53:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 938234369 0 0) 0x7f1c88003530 con 0x7f1ca00b8440 2023-11-27T17:53:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca0144dd0 msgr2=0x7f1ca0145260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 --2- 172.21.15.31:0/482991270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca0144dd0 0x7f1ca0145260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.515 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 >> v2:172.21.15.81:3300/0 conn(0x7f1ca014e880 msgr2=0x7f1ca00b9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 --2- 172.21.15.31:0/482991270 >> v2:172.21.15.81:3300/0 conn(0x7f1ca014e880 0x7f1ca00b9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca01457a0 con 0x7f1ca00b8440 2023-11-27T17:53:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f1c98001a00 con 0x7f1ca00b8440 2023-11-27T17:53:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 >> v1:172.21.15.31:6789/0 conn(0x7f1ca00b8440 legacy=0x7f1ca00bcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 --2- 172.21.15.31:0/482991270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca0144dd0 0x7f1c880039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 --2- 172.21.15.31:0/482991270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c88003f70 0x7f1c880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 --2- 172.21.15.31:0/482991270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c88004d10 0x7f1c88005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca006bc10 con 0x7f1c88003f70 2023-11-27T17:53:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8800b9c0 con 0x7f1c88004d10 2023-11-27T17:53:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8800bb80 con 0x7f1ca0144dd0 2023-11-27T17:53:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9e7fc640 1 --2- 172.21.15.31:0/482991270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c88003f70 0x7f1c880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9e7fc640 1 -- 172.21.15.31:0/482991270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca0144dd0 msgr2=0x7f1c880039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9f7fe640 1 --2- 172.21.15.31:0/482991270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c88004d10 0x7f1c88005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9e7fc640 1 --2- 172.21.15.31:0/482991270 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca0144dd0 0x7f1c880039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9e7fc640 1 -- 172.21.15.31:0/482991270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c88004d10 msgr2=0x7f1c88005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9e7fc640 1 --2- 172.21.15.31:0/482991270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c88004d10 0x7f1c88005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.508+0000 7f1c9e7fc640 1 -- 172.21.15.31:0/482991270 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c88003530 con 0x7f1c88003f70 2023-11-27T17:53:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9e7fc640 1 --2- 172.21.15.31:0/482991270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c88003f70 0x7f1c880047d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009ae0 tx=0x7f1c9401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61a8fd75b4bf4d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c940a5680 con 0x7f1c88003f70 2023-11-27T17:53:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c940a57e0 con 0x7f1c88003f70 2023-11-27T17:53:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9dffb640 1 -- 172.21.15.31:0/482991270 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c940a5b90 con 0x7f1c88003f70 2023-11-27T17:53:55.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 -- 172.21.15.31:0/482991270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c88003f70 msgr2=0x7f1c880047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 --2- 172.21.15.31:0/482991270 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c88003f70 0x7f1c880047d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009ae0 tx=0x7f1c9401ca90 comp rx=0 tx=0).stop 2023-11-27T17:53:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9f7fe640 1 -- 172.21.15.31:0/482991270 reap_dead start 2023-11-27T17:53:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 -- 172.21.15.31:0/482991270 shutdown_connections 2023-11-27T17:53:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 -- 172.21.15.31:0/482991270 >> 172.21.15.31:0/482991270 conn(0x7f1ca00c0ce0 msgr2=0x7f1ca00c10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 -- 172.21.15.31:0/482991270 shutdown_connections 2023-11-27T17:53:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 -- 172.21.15.31:0/482991270 wait complete. 2023-11-27T17:53:55.523 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 Processor -- start 2023-11-27T17:53:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 -- start start 2023-11-27T17:53:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0145de0 0x7f1ca013a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca013aa60 0x7f1ca01e0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca01e0fc0 0x7f1ca01e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0147520 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca013aec0 con 0x7f1ca0145de0 2023-11-27T17:53:55.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca01e1440 con 0x7f1ca013aa60 2023-11-27T17:53:55.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca01e0fc0 0x7f1ca01e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0145de0 0x7f1ca013a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9e7fc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca013aa60 0x7f1ca01e0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0145de0 0x7f1ca013a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:49060/0 (socket says 172.21.15.31:49060) 2023-11-27T17:53:55.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9effd640 1 -- 172.21.15.31:0/2758276861 learned_addr learned my addr 172.21.15.31:0/2758276861 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:55.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9e7fc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca013aa60 0x7f1ca01e0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:46380/0 (socket says 172.21.15.31:46380) 2023-11-27T17:53:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca01e0fc0 0x7f1ca01e3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36834/0 (socket says 172.21.15.31:36834) 2023-11-27T17:53:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9f7fe640 1 -- 172.21.15.31:0/2758276861 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca013aa60 msgr2=0x7f1ca01e0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9f7fe640 1 --2- 172.21.15.31:0/2758276861 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca013aa60 0x7f1ca01e0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9f7fe640 1 -- 172.21.15.31:0/2758276861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0145de0 msgr2=0x7f1ca013a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9f7fe640 1 --2- 172.21.15.31:0/2758276861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0145de0 0x7f1ca013a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9f7fe640 1 -- 172.21.15.31:0/2758276861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0147c20 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c9f7fe640 1 --2- 172.21.15.31:0/2758276861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca01e0fc0 0x7f1ca01e3b00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1ca006bd50 tx=0x7f1c90010930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c877fe640 1 -- 172.21.15.31:0/2758276861 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900148c0 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c877fe640 1 -- 172.21.15.31:0/2758276861 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c90014a40 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 -- 172.21.15.31:0/2758276861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca0147f00 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1c877fe640 1 -- 172.21.15.31:0/2758276861 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90014df0 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.512+0000 7f1ca54f1640 1 -- 172.21.15.31:0/2758276861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca01e0550 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.516+0000 7f1ca54f1640 1 -- 172.21.15.31:0/2758276861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca01e07a0 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.516+0000 7f1c877fe640 1 -- 172.21.15.31:0/2758276861 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1c90020460 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.516+0000 7f1c877fe640 1 --2- 172.21.15.31:0/2758276861 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1c8c066820 0x7f1c8c068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.516+0000 7f1c877fe640 1 -- 172.21.15.31:0/2758276861 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c900840d0 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.516+0000 7f1c9effd640 1 --2- 172.21.15.31:0/2758276861 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1c8c066820 0x7f1c8c068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.516+0000 7f1c9effd640 1 --2- 172.21.15.31:0/2758276861 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1c8c066820 0x7f1c8c068ce0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1c98001dd0 tx=0x7f1c98002200 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:55.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.520+0000 7f1c877fe640 1 -- 172.21.15.31:0/2758276861 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1c900512d0 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.672+0000 7f1ca54f1640 1 -- 172.21.15.31:0/2758276861 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ca01e07a0 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.681 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.676+0000 7f1c877fe640 1 -- 172.21.15.31:0/2758276861 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7f1ca01e07a0 con 0x7f1ca01e0fc0 2023-11-27T17:53:55.681 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:55.681 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.676+0000 7f1ca54f1640 1 -- 172.21.15.31:0/2758276861 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1c8c066820 msgr2=0x7f1c8c068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.676+0000 7f1ca54f1640 1 --2- 172.21.15.31:0/2758276861 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1c8c066820 0x7f1c8c068ce0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1c98001dd0 tx=0x7f1c98002200 comp rx=0 tx=0).stop 2023-11-27T17:53:55.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.676+0000 7f1ca54f1640 1 -- 172.21.15.31:0/2758276861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca01e0fc0 msgr2=0x7f1ca01e3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.676+0000 7f1ca54f1640 1 --2- 172.21.15.31:0/2758276861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca01e0fc0 0x7f1ca01e3b00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1ca006bd50 tx=0x7f1c90010930 comp rx=0 tx=0).stop 2023-11-27T17:53:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.676+0000 7f1ca54f1640 1 -- 172.21.15.31:0/2758276861 shutdown_connections 2023-11-27T17:53:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.676+0000 7f1ca54f1640 1 --2- 172.21.15.31:0/2758276861 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1c8c066820 0x7f1c8c068ce0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.676+0000 7f1ca54f1640 1 --2- 172.21.15.31:0/2758276861 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ca01e0fc0 0x7f1ca01e3b00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.676+0000 7f1ca54f1640 1 --2- 172.21.15.31:0/2758276861 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1ca013aa60 0x7f1ca01e0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.676+0000 7f1ca54f1640 1 --2- 172.21.15.31:0/2758276861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca0145de0 0x7f1ca013a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.680+0000 7f1ca54f1640 1 -- 172.21.15.31:0/2758276861 >> 172.21.15.31:0/2758276861 conn(0x7f1ca00c0ce0 msgr2=0x7f1ca01424b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.680+0000 7f1ca54f1640 1 -- 172.21.15.31:0/2758276861 shutdown_connections 2023-11-27T17:53:55.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.680+0000 7f1ca54f1640 1 -- 172.21.15.31:0/2758276861 wait complete. 2023-11-27T17:53:55.700 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-27T17:53:55.701 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:53:55.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb664cc6640 1 Processor -- start 2023-11-27T17:53:55.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb664cc6640 1 -- start start 2023-11-27T17:53:55.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb664cc6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 0x7fb660149070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb664cc6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6600bd680 0x7fb6601495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb664cc6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6600b5d00 con 0x7fb6601430a0 2023-11-27T17:53:55.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb664cc6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb660143750 con 0x7fb6600bd680 2023-11-27T17:53:55.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb664cc6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb660143480 con 0x7fb6600bd240 2023-11-27T17:53:55.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb65dd9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 0x7fb660149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb65ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6600bd680 0x7fb6601495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb65dd9b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 0x7fb660149070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:46382/0 (socket says 172.21.15.31:46382) 2023-11-27T17:53:55.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb65ed9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb6600bd680 0x7fb6601495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:49070/0 (socket says 172.21.15.31:49070) 2023-11-27T17:53:55.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb65dd9b640 1 -- 172.21.15.31:0/749512673 learned_addr learned my addr 172.21.15.31:0/749512673 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:55.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb65dd9b640 1 -- 172.21.15.31:0/749512673 >> v2:172.21.15.81:3300/0 conn(0x7fb6600bd680 msgr2=0x7fb6601495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:55.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb65dd9b640 1 --2- 172.21.15.31:0/749512673 >> v2:172.21.15.81:3300/0 conn(0x7fb6600bd680 0x7fb6601495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb65dd9b640 1 -- 172.21.15.31:0/749512673 >> v1:172.21.15.81:6789/0 conn(0x7fb6601430a0 legacy=0x7fb6600b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.815 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.808+0000 7fb65dd9b640 1 -- 172.21.15.31:0/749512673 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6600b4740 con 0x7fb6600bd240 2023-11-27T17:53:55.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb65dd9b640 1 --2- 172.21.15.31:0/749512673 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 0x7fb660149070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb654009e50 tx=0x7fb65401f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba05023b5599e3b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:55.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb65d59a640 1 -- 172.21.15.31:0/749512673 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540af400 con 0x7fb6600bd240 2023-11-27T17:53:55.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb65d59a640 1 -- 172.21.15.31:0/749512673 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6540ab050 con 0x7fb6600bd240 2023-11-27T17:53:55.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb65d59a640 1 -- 172.21.15.31:0/749512673 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540af780 con 0x7fb6600bd240 2023-11-27T17:53:55.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 -- 172.21.15.31:0/749512673 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 msgr2=0x7fb660149070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 --2- 172.21.15.31:0/749512673 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 0x7fb660149070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb654009e50 tx=0x7fb65401f1f0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 -- 172.21.15.31:0/749512673 shutdown_connections 2023-11-27T17:53:55.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 --2- 172.21.15.31:0/749512673 >> v2:172.21.15.81:3300/0 conn(0x7fb6600bd680 0x7fb6601495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 --2- 172.21.15.31:0/749512673 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 0x7fb660149070 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 -- 172.21.15.31:0/749512673 >> 172.21.15.31:0/749512673 conn(0x7fb66006ab60 msgr2=0x7fb6600bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:55.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 -- 172.21.15.31:0/749512673 shutdown_connections 2023-11-27T17:53:55.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 -- 172.21.15.31:0/749512673 wait complete. 2023-11-27T17:53:55.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 Processor -- start 2023-11-27T17:53:55.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 -- start start 2023-11-27T17:53:55.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 0x7fb660071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6600bd680 0x7fb6601e0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6601430a0 0x7fb66013fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb660072080 con 0x7fb6600bd680 2023-11-27T17:53:55.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66006fca0 con 0x7fb6601430a0 2023-11-27T17:53:55.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb664cc6640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb660072270 con 0x7fb6600bd240 2023-11-27T17:53:55.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.812+0000 7fb65dd9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6600bd680 0x7fb6601e0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65dd9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6600bd680 0x7fb6601e0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36836/0 (socket says 172.21.15.31:36836) 2023-11-27T17:53:55.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65dd9b640 1 -- 172.21.15.31:0/4232642348 learned_addr learned my addr 172.21.15.31:0/4232642348 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:55.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65ed9d640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6601430a0 0x7fb66013fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65e59c640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 0x7fb660071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65dd9b640 1 -- 172.21.15.31:0/4232642348 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 msgr2=0x7fb660071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65dd9b640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 0x7fb660071b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65dd9b640 1 -- 172.21.15.31:0/4232642348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6601430a0 msgr2=0x7fb66013fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:55.822 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65dd9b640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6601430a0 0x7fb66013fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:55.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65dd9b640 1 -- 172.21.15.31:0/4232642348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb654009b30 con 0x7fb6600bd680 2023-11-27T17:53:55.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65e59c640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 0x7fb660071b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:55.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65dd9b640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6600bd680 0x7fb6601e0950 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb65401ce20 tx=0x7fb65401bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:55.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb64effd640 1 -- 172.21.15.31:0/4232642348 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540afdb0 con 0x7fb6600bd680 2023-11-27T17:53:55.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb64effd640 1 -- 172.21.15.31:0/4232642348 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb654009510 con 0x7fb6600bd680 2023-11-27T17:53:55.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb664cc6640 1 -- 172.21.15.31:0/4232642348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66006f670 con 0x7fb6600bd680 2023-11-27T17:53:55.823 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb64effd640 1 -- 172.21.15.31:0/4232642348 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6540b9610 con 0x7fb6600bd680 2023-11-27T17:53:55.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb664cc6640 1 -- 172.21.15.31:0/4232642348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb660070130 con 0x7fb6600bd680 2023-11-27T17:53:55.824 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb664cc6640 1 -- 172.21.15.31:0/4232642348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66004e850 con 0x7fb6600bd680 2023-11-27T17:53:55.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb64effd640 1 -- 172.21.15.31:0/4232642348 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb6540b6070 con 0x7fb6600bd680 2023-11-27T17:53:55.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb64effd640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb6400667f0 0x7fb640068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:55.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb64effd640 1 -- 172.21.15.31:0/4232642348 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb654122250 con 0x7fb6600bd680 2023-11-27T17:53:55.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65e59c640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb6400667f0 0x7fb640068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:55.825 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.816+0000 7fb65e59c640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb6400667f0 0x7fb640068cb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb650001670 tx=0x7fb650009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:55.826 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:55.820+0000 7fb64effd640 1 -- 172.21.15.31:0/4232642348 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb6540ef3e0 con 0x7fb6600bd680 2023-11-27T17:53:56.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.004+0000 7fb664cc6640 1 -- 172.21.15.31:0/4232642348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6600bae60 con 0x7fb6600bd680 2023-11-27T17:53:56.009 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.004+0000 7fb64effd640 1 -- 172.21.15.31:0/4232642348 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4111 (secure 0 0 0) 0x7fb6540f2a00 con 0x7fb6600bd680 2023-11-27T17:53:56.010 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:56.010 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/1250401972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1250401972},{"type":"v1","addr":"172.21.15.31:6836","nonce":1250401972}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1133939246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1133939246},{"type":"v1","addr":"172.21.15.31:6837","nonce":1133939246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:53:23.383311+0000","modified":"2023-11-27T17:53:25.372630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6833/88283146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":88283146},{"type":"v1","addr":"172.21.15.81:6833","nonce":88283146}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:53:56.010 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2023-11-27T17:53:56.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.008+0000 7fb664cc6640 1 -- 172.21.15.31:0/4232642348 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb6400667f0 msgr2=0x7fb640068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.008+0000 7fb664cc6640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb6400667f0 0x7fb640068cb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb650001670 tx=0x7fb650009040 comp rx=0 tx=0).stop 2023-11-27T17:53:56.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.008+0000 7fb664cc6640 1 -- 172.21.15.31:0/4232642348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6600bd680 msgr2=0x7fb6601e0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.008+0000 7fb664cc6640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6600bd680 0x7fb6601e0950 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb65401ce20 tx=0x7fb65401bf90 comp rx=0 tx=0).stop 2023-11-27T17:53:56.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.008+0000 7fb664cc6640 1 -- 172.21.15.31:0/4232642348 shutdown_connections 2023-11-27T17:53:56.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.008+0000 7fb664cc6640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb6400667f0 0x7fb640068cb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.008+0000 7fb664cc6640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6601430a0 0x7fb66013fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.008+0000 7fb664cc6640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb6600bd680 0x7fb6601e0950 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.008+0000 7fb664cc6640 1 --2- 172.21.15.31:0/4232642348 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb6600bd240 0x7fb660071b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.008+0000 7fb664cc6640 1 -- 172.21.15.31:0/4232642348 >> 172.21.15.31:0/4232642348 conn(0x7fb66006ab60 msgr2=0x7fb660142060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:56.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.008+0000 7fb664cc6640 1 -- 172.21.15.31:0/4232642348 shutdown_connections 2023-11-27T17:53:56.013 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.008+0000 7fb664cc6640 1 -- 172.21.15.31:0/4232642348 wait complete. 2023-11-27T17:53:56.027 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:53:56.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f3691d4f640 1 Processor -- start 2023-11-27T17:53:56.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f3691d4f640 1 -- start start 2023-11-27T17:53:56.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f3691d4f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f368c152a50 0x7f368c154e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f3691d4f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368c0706d0 con 0x7f368c0b9a30 2023-11-27T17:53:56.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f3691d4f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368c070b50 con 0x7f368c071e80 2023-11-27T17:53:56.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f3691d4f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f368c0b46d0 con 0x7f368c152a50 2023-11-27T17:53:56.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f368bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f368c152a50 0x7f368c154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f368bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f368c152a50 0x7f368c154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36838/0 (socket says 172.21.15.31:36838) 2023-11-27T17:53:56.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f368bfff640 1 -- 172.21.15.31:0/2619399514 learned_addr learned my addr 172.21.15.31:0/2619399514 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:56.145 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f368b7fe640 1 --1- 172.21.15.31:0/2619399514 >> v1:172.21.15.31:6789/0 conn(0x7f368c0b9a30 0x7f368c070fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48892/0 (socket says 172.21.15.31:48892) 2023-11-27T17:53:56.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f368bfff640 1 -- 172.21.15.31:0/2619399514 >> v1:172.21.15.81:6789/0 conn(0x7f368c071e80 legacy=0x7f368c143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:56.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f368bfff640 1 -- 172.21.15.31:0/2619399514 >> v1:172.21.15.31:6789/0 conn(0x7f368c0b9a30 legacy=0x7f368c070fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f368bfff640 1 -- 172.21.15.31:0/2619399514 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368c0b4950 con 0x7f368c152a50 2023-11-27T17:53:56.146 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f368a7fc640 1 -- 172.21.15.31:0/2619399514 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617688131 0 0) 0x7f368c0706d0 con 0x7f368c0b9a30 2023-11-27T17:53:56.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f368bfff640 1 --2- 172.21.15.31:0/2619399514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368c152a50 0x7f368c154e40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3684009e50 tx=0x7f368401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf981a3a37943e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:56.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.140+0000 7f368a7fc640 1 -- 172.21.15.31:0/2619399514 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36840af400 con 0x7f368c152a50 2023-11-27T17:53:56.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368a7fc640 1 -- 172.21.15.31:0/2619399514 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36840ab050 con 0x7f368c152a50 2023-11-27T17:53:56.147 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368a7fc640 1 -- 172.21.15.31:0/2619399514 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36840af780 con 0x7f368c152a50 2023-11-27T17:53:56.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 -- 172.21.15.31:0/2619399514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368c152a50 msgr2=0x7f368c154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 --2- 172.21.15.31:0/2619399514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368c152a50 0x7f368c154e40 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3684009e50 tx=0x7f368401f1c0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 -- 172.21.15.31:0/2619399514 shutdown_connections 2023-11-27T17:53:56.148 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 --2- 172.21.15.31:0/2619399514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368c152a50 0x7f368c154e40 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 -- 172.21.15.31:0/2619399514 >> 172.21.15.31:0/2619399514 conn(0x7f368c0ba8c0 msgr2=0x7f368c0bacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:56.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 -- 172.21.15.31:0/2619399514 shutdown_connections 2023-11-27T17:53:56.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 -- 172.21.15.31:0/2619399514 wait complete. 2023-11-27T17:53:56.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 Processor -- start 2023-11-27T17:53:56.149 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 -- start start 2023-11-27T17:53:56.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368c071e80 0x7f368c146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f368c0b9a30 0x7f368c1e2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368c152a50 0x7f368c13b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c145620 con 0x7f368c152a50 2023-11-27T17:53:56.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368c146cd0 con 0x7f368c071e80 2023-11-27T17:53:56.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368c147860 con 0x7f368c0b9a30 2023-11-27T17:53:56.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368c152a50 0x7f368c13b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.151 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368bfff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368c152a50 0x7f368c13b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36844/0 (socket says 172.21.15.31:36844) 2023-11-27T17:53:56.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368bfff640 1 -- 172.21.15.31:0/857712743 learned_addr learned my addr 172.21.15.31:0/857712743 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:56.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368b7fe640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368c071e80 0x7f368c146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368affd640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f368c0b9a30 0x7f368c1e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368bfff640 1 -- 172.21.15.31:0/857712743 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f368c0b9a30 msgr2=0x7f368c1e2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368bfff640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f368c0b9a30 0x7f368c1e2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368bfff640 1 -- 172.21.15.31:0/857712743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368c071e80 msgr2=0x7f368c146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368bfff640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368c071e80 0x7f368c146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368bfff640 1 -- 172.21.15.31:0/857712743 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3684009b30 con 0x7f368c152a50 2023-11-27T17:53:56.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368b7fe640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368c071e80 0x7f368c146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:56.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368affd640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f368c0b9a30 0x7f368c1e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:56.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f368bfff640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368c152a50 0x7f368c13b040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f368401bdd0 tx=0x7f368401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:56.152 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3673fff640 1 -- 172.21.15.31:0/857712743 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36840afdc0 con 0x7f368c152a50 2023-11-27T17:53:56.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3673fff640 1 -- 172.21.15.31:0/857712743 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36840b8400 con 0x7f368c152a50 2023-11-27T17:53:56.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3673fff640 1 -- 172.21.15.31:0/857712743 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36840b87b0 con 0x7f368c152a50 2023-11-27T17:53:56.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 -- 172.21.15.31:0/857712743 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368c140720 con 0x7f368c152a50 2023-11-27T17:53:56.153 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.144+0000 7f3691d4f640 1 -- 172.21.15.31:0/857712743 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368c140ce0 con 0x7f368c152a50 2023-11-27T17:53:56.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.148+0000 7f3691d4f640 1 -- 172.21.15.31:0/857712743 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368c140ed0 con 0x7f368c152a50 2023-11-27T17:53:56.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.148+0000 7f3673fff640 1 -- 172.21.15.31:0/857712743 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f36840b6040 con 0x7f368c152a50 2023-11-27T17:53:56.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.148+0000 7f3673fff640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f36780667f0 0x7f3678068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.148+0000 7f3673fff640 1 -- 172.21.15.31:0/857712743 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36841223b0 con 0x7f368c152a50 2023-11-27T17:53:56.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.148+0000 7f368b7fe640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f36780667f0 0x7f3678068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.154 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.148+0000 7f368b7fe640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f36780667f0 0x7f3678068cb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f367c000f70 tx=0x7f367c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:56.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.152+0000 7f3673fff640 1 -- 172.21.15.31:0/857712743 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f36840ef4d0 con 0x7f368c152a50 2023-11-27T17:53:56.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.344+0000 7f3691d4f640 1 -- 172.21.15.31:0/857712743 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f368c0717c0 con 0x7f368c152a50 2023-11-27T17:53:56.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.344+0000 7f3673fff640 1 -- 172.21.15.31:0/857712743 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4111 (secure 0 0 0) 0x7f36840f2af0 con 0x7f368c152a50 2023-11-27T17:53:56.351 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:56.351 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6836/1250401972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6835","nonce":1250401972},{"type":"v1","addr":"172.21.15.31:6836","nonce":1250401972}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4264,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6837/1133939246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":1133939246},{"type":"v1","addr":"172.21.15.31:6837","nonce":1133939246}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:53:23.383311+0000","modified":"2023-11-27T17:53:25.372630+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6833/88283146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":88283146},{"type":"v1","addr":"172.21.15.81:6833","nonce":88283146}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-27T17:53:56.351 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2023-11-27T17:53:56.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.348+0000 7f3691d4f640 1 -- 172.21.15.31:0/857712743 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f36780667f0 msgr2=0x7f3678068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.348+0000 7f3691d4f640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f36780667f0 0x7f3678068cb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f367c000f70 tx=0x7f367c009040 comp rx=0 tx=0).stop 2023-11-27T17:53:56.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.348+0000 7f3691d4f640 1 -- 172.21.15.31:0/857712743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368c152a50 msgr2=0x7f368c13b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.348+0000 7f3691d4f640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368c152a50 0x7f368c13b040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f368401bdd0 tx=0x7f368401bf60 comp rx=0 tx=0).stop 2023-11-27T17:53:56.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.348+0000 7f3691d4f640 1 -- 172.21.15.31:0/857712743 shutdown_connections 2023-11-27T17:53:56.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.348+0000 7f3691d4f640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f36780667f0 0x7f3678068cb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.348+0000 7f3691d4f640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f368c152a50 0x7f368c13b040 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.348+0000 7f3691d4f640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f368c0b9a30 0x7f368c1e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.348+0000 7f3691d4f640 1 --2- 172.21.15.31:0/857712743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f368c071e80 0x7f368c146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.348+0000 7f3691d4f640 1 -- 172.21.15.31:0/857712743 >> 172.21.15.31:0/857712743 conn(0x7f368c0ba8c0 msgr2=0x7f368c1415c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:56.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.348+0000 7f3691d4f640 1 -- 172.21.15.31:0/857712743 shutdown_connections 2023-11-27T17:53:56.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.348+0000 7f3691d4f640 1 -- 172.21.15.31:0/857712743 wait complete. 2023-11-27T17:53:56.371 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:53:56.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.488+0000 7f1d84074640 1 Processor -- start 2023-11-27T17:53:56.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.488+0000 7f1d84074640 1 -- start start 2023-11-27T17:53:56.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1d7c0b3a60 0x7f1d7c0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d7c0bd240 0x7f1d7c152960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c148930 con 0x7f1d7c0b30b0 2023-11-27T17:53:56.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7c0b52c0 con 0x7f1d7c0b3a60 2023-11-27T17:53:56.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0b7060 con 0x7f1d7c0bd240 2023-11-27T17:53:56.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d8160f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1d7c0b3a60 0x7f1d7c0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d81e10640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1d7c0b30b0 0x7f1d7c14b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48902/0 (socket says 172.21.15.31:48902) 2023-11-27T17:53:56.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d8160f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1d7c0b3a60 0x7f1d7c0b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36856/0 (socket says 172.21.15.31:36856) 2023-11-27T17:53:56.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d81e10640 1 -- 172.21.15.31:0/23580960 learned_addr learned my addr 172.21.15.31:0/23580960 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:56.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d82611640 1 --2- 172.21.15.31:0/23580960 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d7c0bd240 0x7f1d7c152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d8160f640 1 -- 172.21.15.31:0/23580960 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d7c0bd240 msgr2=0x7f1d7c152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:56.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d8160f640 1 --2- 172.21.15.31:0/23580960 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d7c0bd240 0x7f1d7c152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d8160f640 1 -- 172.21.15.31:0/23580960 >> v1:172.21.15.31:6789/0 conn(0x7f1d7c0b30b0 legacy=0x7f1d7c14b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d80e0e640 1 -- 172.21.15.31:0/23580960 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162441636 0 0) 0x7f1d7c148930 con 0x7f1d7c0b30b0 2023-11-27T17:53:56.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d8160f640 1 -- 172.21.15.31:0/23580960 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0b3490 con 0x7f1d7c0b3a60 2023-11-27T17:53:56.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d8160f640 1 --2- 172.21.15.31:0/23580960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7c0b3a60 0x7f1d7c0b46a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1d780097c0 tx=0x7f1d7801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432c8c61b6b7c42f server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:56.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d80e0e640 1 -- 172.21.15.31:0/23580960 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d780ab600 con 0x7f1d7c0b3a60 2023-11-27T17:53:56.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d80e0e640 1 -- 172.21.15.31:0/23580960 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d780a7050 con 0x7f1d7c0b3a60 2023-11-27T17:53:56.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d80e0e640 1 -- 172.21.15.31:0/23580960 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d780ab980 con 0x7f1d7c0b3a60 2023-11-27T17:53:56.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 -- 172.21.15.31:0/23580960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7c0b3a60 msgr2=0x7f1d7c0b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 --2- 172.21.15.31:0/23580960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7c0b3a60 0x7f1d7c0b46a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1d780097c0 tx=0x7f1d7801c480 comp rx=0 tx=0).stop 2023-11-27T17:53:56.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 -- 172.21.15.31:0/23580960 shutdown_connections 2023-11-27T17:53:56.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 --2- 172.21.15.31:0/23580960 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d7c0bd240 0x7f1d7c152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 --2- 172.21.15.31:0/23580960 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7c0b3a60 0x7f1d7c0b46a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 -- 172.21.15.31:0/23580960 >> 172.21.15.31:0/23580960 conn(0x7f1d7c06ab60 msgr2=0x7f1d7c0bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:56.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 -- 172.21.15.31:0/23580960 shutdown_connections 2023-11-27T17:53:56.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.492+0000 7f1d84074640 1 -- 172.21.15.31:0/23580960 wait complete. 2023-11-27T17:53:56.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d84074640 1 Processor -- start 2023-11-27T17:53:56.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d84074640 1 -- start start 2023-11-27T17:53:56.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d84074640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c0b30b0 0x7f1d7c0705a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d84074640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d7c0b3a60 0x7f1d7c151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d84074640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7c0bd240 0x7f1d7c072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d84074640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c06f2e0 con 0x7f1d7c0bd240 2023-11-27T17:53:56.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d84074640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c070ae0 con 0x7f1d7c0b30b0 2023-11-27T17:53:56.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d84074640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c071910 con 0x7f1d7c0b3a60 2023-11-27T17:53:56.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d82611640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7c0bd240 0x7f1d7c072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d82611640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7c0bd240 0x7f1d7c072080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36872/0 (socket says 172.21.15.31:36872) 2023-11-27T17:53:56.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d82611640 1 -- 172.21.15.31:0/2967735718 learned_addr learned my addr 172.21.15.31:0/2967735718 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:56.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d81e10640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c0b30b0 0x7f1d7c0705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d8160f640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d7c0b3a60 0x7f1d7c151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d82611640 1 -- 172.21.15.31:0/2967735718 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d7c0b3a60 msgr2=0x7f1d7c151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d82611640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d7c0b3a60 0x7f1d7c151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d82611640 1 -- 172.21.15.31:0/2967735718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c0b30b0 msgr2=0x7f1d7c0705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d82611640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c0b30b0 0x7f1d7c0705a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d82611640 1 -- 172.21.15.31:0/2967735718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78009420 con 0x7f1d7c0bd240 2023-11-27T17:53:56.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d81e10640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c0b30b0 0x7f1d7c0705a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:56.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d8160f640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d7c0b3a60 0x7f1d7c151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:56.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d82611640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7c0bd240 0x7f1d7c072080 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1d74007e40 tx=0x7f1d7400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:56.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d727fc640 1 -- 172.21.15.31:0/2967735718 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74014620 con 0x7f1d7c0bd240 2023-11-27T17:53:56.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d727fc640 1 -- 172.21.15.31:0/2967735718 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7400ee90 con 0x7f1d7c0bd240 2023-11-27T17:53:56.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d727fc640 1 -- 172.21.15.31:0/2967735718 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740149e0 con 0x7f1d7c0bd240 2023-11-27T17:53:56.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d84074640 1 -- 172.21.15.31:0/2967735718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c06f580 con 0x7f1d7c0bd240 2023-11-27T17:53:56.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d84074640 1 -- 172.21.15.31:0/2967735718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c151980 con 0x7f1d7c0bd240 2023-11-27T17:53:56.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.496+0000 7f1d84074640 1 -- 172.21.15.31:0/2967735718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c06f770 con 0x7f1d7c0bd240 2023-11-27T17:53:56.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.500+0000 7f1d727fc640 1 -- 172.21.15.31:0/2967735718 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f1d74014b40 con 0x7f1d7c0bd240 2023-11-27T17:53:56.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.500+0000 7f1d727fc640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1d600667f0 0x7f1d60068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.500+0000 7f1d727fc640 1 -- 172.21.15.31:0/2967735718 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d74085b50 con 0x7f1d7c0bd240 2023-11-27T17:53:56.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.500+0000 7f1d81e10640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1d600667f0 0x7f1d60068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.506 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.500+0000 7f1d81e10640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1d600667f0 0x7f1d60068cb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c007fd0 tx=0x7f1d6c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:56.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.504+0000 7f1d727fc640 1 -- 172.21.15.31:0/2967735718 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f1d74052cc0 con 0x7f1d7c0bd240 2023-11-27T17:53:56.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.656+0000 7f1d84074640 1 -- 172.21.15.31:0/2967735718 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d7c04e850 con 0x7f1d7c0bd240 2023-11-27T17:53:56.662 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.656+0000 7f1d727fc640 1 -- 172.21.15.31:0/2967735718 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16434 (secure 0 0 0) 0x7f1d74085070 con 0x7f1d7c0bd240 2023-11-27T17:53:56.662 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:53:56.663 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":20,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:53:25.004232+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:53:21.543531+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-27T17:53:22.362977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:53:56.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.660+0000 7f1d84074640 1 -- 172.21.15.31:0/2967735718 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1d600667f0 msgr2=0x7f1d60068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.660+0000 7f1d84074640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1d600667f0 0x7f1d60068cb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c007fd0 tx=0x7f1d6c009040 comp rx=0 tx=0).stop 2023-11-27T17:53:56.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.660+0000 7f1d84074640 1 -- 172.21.15.31:0/2967735718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7c0bd240 msgr2=0x7f1d7c072080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.660+0000 7f1d84074640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7c0bd240 0x7f1d7c072080 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1d74007e40 tx=0x7f1d7400e4b0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.660+0000 7f1d84074640 1 -- 172.21.15.31:0/2967735718 shutdown_connections 2023-11-27T17:53:56.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.660+0000 7f1d84074640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f1d600667f0 0x7f1d60068cb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.660+0000 7f1d84074640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d7c0bd240 0x7f1d7c072080 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.660+0000 7f1d84074640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f1d7c0b3a60 0x7f1d7c151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.660+0000 7f1d84074640 1 --2- 172.21.15.31:0/2967735718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d7c0b30b0 0x7f1d7c0705a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.660+0000 7f1d84074640 1 -- 172.21.15.31:0/2967735718 >> 172.21.15.31:0/2967735718 conn(0x7f1d7c06ab60 msgr2=0x7f1d7c146090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:56.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.660+0000 7f1d84074640 1 -- 172.21.15.31:0/2967735718 shutdown_connections 2023-11-27T17:53:56.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.660+0000 7f1d84074640 1 -- 172.21.15.31:0/2967735718 wait complete. 2023-11-27T17:53:56.680 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-27T17:53:56.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08ea644640 1 Processor -- start 2023-11-27T17:53:56.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08ea644640 1 -- start start 2023-11-27T17:53:56.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08ea644640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08e4143560 0x7f08e40bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08ea644640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08e4149c00 0x7f08e4153a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08ea644640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e4071260 con 0x7f08e406f1d0 2023-11-27T17:53:56.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08ea644640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e4143940 con 0x7f08e4143560 2023-11-27T17:53:56.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08ea644640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e406f800 con 0x7f08e4149c00 2023-11-27T17:53:56.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08e3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08e4143560 0x7f08e40bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08e3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08e4143560 0x7f08e40bd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36884/0 (socket says 172.21.15.31:36884) 2023-11-27T17:53:56.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08e3fff640 1 -- 172.21.15.31:0/73268571 learned_addr learned my addr 172.21.15.31:0/73268571 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:56.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08e8be1640 1 --2- 172.21.15.31:0/73268571 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08e4149c00 0x7f08e4153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08e3fff640 1 -- 172.21.15.31:0/73268571 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08e4149c00 msgr2=0x7f08e4153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:56.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08e3fff640 1 --2- 172.21.15.31:0/73268571 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08e4149c00 0x7f08e4153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08e3fff640 1 -- 172.21.15.31:0/73268571 >> v1:172.21.15.81:6789/0 conn(0x7f08e406f1d0 legacy=0x7f08e41494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:56.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.792+0000 7f08e3fff640 1 -- 172.21.15.31:0/73268571 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e406fae0 con 0x7f08e4143560 2023-11-27T17:53:56.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08e3fff640 1 --2- 172.21.15.31:0/73268571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e4143560 0x7f08e40bd240 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f08d4009e50 tx=0x7f08d401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa51fd4db0549ccc server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:56.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08e2ffd640 1 -- 172.21.15.31:0/73268571 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d40a5780 con 0x7f08e4143560 2023-11-27T17:53:56.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08e2ffd640 1 -- 172.21.15.31:0/73268571 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d40a58e0 con 0x7f08e4143560 2023-11-27T17:53:56.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08e2ffd640 1 -- 172.21.15.31:0/73268571 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d40a5c70 con 0x7f08e4143560 2023-11-27T17:53:56.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 -- 172.21.15.31:0/73268571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e4143560 msgr2=0x7f08e40bd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 --2- 172.21.15.31:0/73268571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e4143560 0x7f08e40bd240 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f08d4009e50 tx=0x7f08d401c9a0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 -- 172.21.15.31:0/73268571 shutdown_connections 2023-11-27T17:53:56.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 --2- 172.21.15.31:0/73268571 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08e4149c00 0x7f08e4153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 --2- 172.21.15.31:0/73268571 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e4143560 0x7f08e40bd240 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 -- 172.21.15.31:0/73268571 >> 172.21.15.31:0/73268571 conn(0x7f08e406ab60 msgr2=0x7f08e40bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:56.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 -- 172.21.15.31:0/73268571 shutdown_connections 2023-11-27T17:53:56.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 -- 172.21.15.31:0/73268571 wait complete. 2023-11-27T17:53:56.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 Processor -- start 2023-11-27T17:53:56.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 -- start start 2023-11-27T17:53:56.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e406f1d0 0x7f08e4136080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08e4143560 0x7f08e413c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e4149c00 0x7f08e41e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e413c210 con 0x7f08e4149c00 2023-11-27T17:53:56.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e40bc850 con 0x7f08e406f1d0 2023-11-27T17:53:56.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.796+0000 7f08ea644640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4140d30 con 0x7f08e4143560 2023-11-27T17:53:56.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e8be1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e4149c00 0x7f08e41e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e8be1640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e4149c00 0x7f08e41e48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36896/0 (socket says 172.21.15.31:36896) 2023-11-27T17:53:56.805 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e8be1640 1 -- 172.21.15.31:0/1328755851 learned_addr learned my addr 172.21.15.31:0/1328755851 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:56.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e3fff640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e406f1d0 0x7f08e4136080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.806 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e37fe640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08e4143560 0x7f08e413c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e8be1640 1 -- 172.21.15.31:0/1328755851 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08e4143560 msgr2=0x7f08e413c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e8be1640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08e4143560 0x7f08e413c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e8be1640 1 -- 172.21.15.31:0/1328755851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e406f1d0 msgr2=0x7f08e4136080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:56.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e8be1640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e406f1d0 0x7f08e4136080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:56.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e8be1640 1 -- 172.21.15.31:0/1328755851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d4009b30 con 0x7f08e4149c00 2023-11-27T17:53:56.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e37fe640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08e4143560 0x7f08e413c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:53:56.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e8be1640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e4149c00 0x7f08e41e48c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00d830 tx=0x7f08dc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:56.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e0ff9640 1 -- 172.21.15.31:0/1328755851 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc00b6c0 con 0x7f08e4149c00 2023-11-27T17:53:56.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e0ff9640 1 -- 172.21.15.31:0/1328755851 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc00b820 con 0x7f08e4149c00 2023-11-27T17:53:56.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08ea644640 1 -- 172.21.15.31:0/1328755851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e413bbc0 con 0x7f08e4149c00 2023-11-27T17:53:56.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e0ff9640 1 -- 172.21.15.31:0/1328755851 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc00bbd0 con 0x7f08e4149c00 2023-11-27T17:53:56.807 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08ea644640 1 -- 172.21.15.31:0/1328755851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e4142910 con 0x7f08e4149c00 2023-11-27T17:53:56.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08ea644640 1 -- 172.21.15.31:0/1328755851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e413bfe0 con 0x7f08e4149c00 2023-11-27T17:53:56.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e0ff9640 1 -- 172.21.15.31:0/1328755851 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f08dc01e460 con 0x7f08e4149c00 2023-11-27T17:53:56.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e0ff9640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f08d00667f0 0x7f08d0068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:56.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e3fff640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f08d00667f0 0x7f08d0068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:56.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e0ff9640 1 -- 172.21.15.31:0/1328755851 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08dc084960 con 0x7f08e4149c00 2023-11-27T17:53:56.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.800+0000 7f08e3fff640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f08d00667f0 0x7f08d0068cb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f08d40ae000 tx=0x7f08d40a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:56.812 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:56.808+0000 7f08e0ff9640 1 -- 172.21.15.31:0/1328755851 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f08e413bfe0 con 0x7f08e4149c00 2023-11-27T17:53:57.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.000+0000 7f08ea644640 1 -- 172.21.15.31:0/1328755851 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f08e413bfe0 con 0x7f08e4149c00 2023-11-27T17:53:57.005 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-11-27T17:53:57.000+0000 7f29069bb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-27T17:53:57.008 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08e0ff9640 1 -- 172.21.15.31:0/1328755851 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7f08e413bfe0 con 0x7f08e4149c00 2023-11-27T17:53:57.008 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-27T17:53:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08ea644640 1 -- 172.21.15.31:0/1328755851 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f08d00667f0 msgr2=0x7f08d0068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08ea644640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f08d00667f0 0x7f08d0068cb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f08d40ae000 tx=0x7f08d40a7070 comp rx=0 tx=0).stop 2023-11-27T17:53:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08ea644640 1 -- 172.21.15.31:0/1328755851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e4149c00 msgr2=0x7f08e41e48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08ea644640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e4149c00 0x7f08e41e48c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00d830 tx=0x7f08dc00dcf0 comp rx=0 tx=0).stop 2023-11-27T17:53:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08ea644640 1 -- 172.21.15.31:0/1328755851 shutdown_connections 2023-11-27T17:53:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08ea644640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f08d00667f0 0x7f08d0068cb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08ea644640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08e4149c00 0x7f08e41e48c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08ea644640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f08e4143560 0x7f08e413c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08ea644640 1 --2- 172.21.15.31:0/1328755851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08e406f1d0 0x7f08e4136080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:57.011 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08ea644640 1 -- 172.21.15.31:0/1328755851 >> 172.21.15.31:0/1328755851 conn(0x7f08e406ab60 msgr2=0x7f08e413e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:57.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08ea644640 1 -- 172.21.15.31:0/1328755851 shutdown_connections 2023-11-27T17:53:57.012 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.004+0000 7f08ea644640 1 -- 172.21.15.31:0/1328755851 wait complete. 2023-11-27T17:53:57.023 INFO:tasks.ceph.mds.b.smithi081.stderr: -4865> 2023-11-27T17:53:27.970+0000 7fe24ed9d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T17:53:57.029 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-27T17:53:57.088 INFO:tasks.ceph.mds.b.smithi081.stdout:starting mds.b at 2023-11-27T17:53:57.155 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.148+0000 7f0a12a7d640 1 Processor -- start 2023-11-27T17:53:57.156 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a12a7d640 1 -- start start 2023-11-27T17:53:57.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a12a7d640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0a0c0a42b0 0x7f0a0c0b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:57.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a12a7d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0a0c14c7b0 0x7f0a0c0b5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:57.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a12a7d640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c0b4360 con 0x7f0a0c06ef70 2023-11-27T17:53:57.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a12a7d640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c06e7a0 con 0x7f0a0c0a42b0 2023-11-27T17:53:57.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a12a7d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0b4d30 con 0x7f0a0c14c7b0 2023-11-27T17:53:57.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a10819640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0a0c0a42b0 0x7f0a0c0b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:57.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a1101a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0a0c06ef70 0x7f0a0c149290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48908/0 (socket says 172.21.15.31:48908) 2023-11-27T17:53:57.157 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a1101a640 1 -- 172.21.15.31:0/1120003896 learned_addr learned my addr 172.21.15.31:0/1120003896 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:57.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a0bfff640 1 --2- 172.21.15.31:0/1120003896 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0a0c14c7b0 0x7f0a0c0b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:57.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a10819640 1 -- 172.21.15.31:0/1120003896 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0a0c14c7b0 msgr2=0x7f0a0c0b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:57.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a0b7fe640 1 -- 172.21.15.31:0/1120003896 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346179275 0 0) 0x7f0a0c0b4360 con 0x7f0a0c06ef70 2023-11-27T17:53:57.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a10819640 1 --2- 172.21.15.31:0/1120003896 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0a0c14c7b0 0x7f0a0c0b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:57.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a10819640 1 -- 172.21.15.31:0/1120003896 >> v1:172.21.15.31:6789/0 conn(0x7f0a0c06ef70 legacy=0x7f0a0c149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:57.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a10819640 1 -- 172.21.15.31:0/1120003896 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c0b4030 con 0x7f0a0c0a42b0 2023-11-27T17:53:57.158 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a0bfff640 1 --2- 172.21.15.31:0/1120003896 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0a0c14c7b0 0x7f0a0c0b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:53:57.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a10819640 1 --2- 172.21.15.31:0/1120003896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a0c0a42b0 0x7f0a0c0b47f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0097c0 tx=0x7f09fc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8129171f5cecf14 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:57.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.152+0000 7f0a0b7fe640 1 -- 172.21.15.31:0/1120003896 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0a8970 con 0x7f0a0c0a42b0 2023-11-27T17:53:57.159 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a0b7fe640 1 -- 172.21.15.31:0/1120003896 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc0a8ad0 con 0x7f0a0c0a42b0 2023-11-27T17:53:57.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a0b7fe640 1 -- 172.21.15.31:0/1120003896 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0a8e60 con 0x7f0a0c0a42b0 2023-11-27T17:53:57.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 -- 172.21.15.31:0/1120003896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a0c0a42b0 msgr2=0x7f0a0c0b47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:57.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 --2- 172.21.15.31:0/1120003896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a0c0a42b0 0x7f0a0c0b47f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f09fc0097c0 tx=0x7f09fc01ec70 comp rx=0 tx=0).stop 2023-11-27T17:53:57.160 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 -- 172.21.15.31:0/1120003896 shutdown_connections 2023-11-27T17:53:57.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 --2- 172.21.15.31:0/1120003896 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0a0c14c7b0 0x7f0a0c0b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:57.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 --2- 172.21.15.31:0/1120003896 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a0c0a42b0 0x7f0a0c0b47f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:57.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 -- 172.21.15.31:0/1120003896 >> 172.21.15.31:0/1120003896 conn(0x7f0a0c0bb7d0 msgr2=0x7f0a0c0bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:57.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 -- 172.21.15.31:0/1120003896 shutdown_connections 2023-11-27T17:53:57.161 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 -- 172.21.15.31:0/1120003896 wait complete. 2023-11-27T17:53:57.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 Processor -- start 2023-11-27T17:53:57.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 -- start start 2023-11-27T17:53:57.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a0c06ef70 0x7f0a0c1d2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:57.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0a42b0 0x7f0a0c149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:57.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0a0c14c7b0 0x7f0a0c1df9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:57.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0b9050 con 0x7f0a0c06ef70 2023-11-27T17:53:57.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c1dff30 con 0x7f0a0c0a42b0 2023-11-27T17:53:57.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c1e2560 con 0x7f0a0c14c7b0 2023-11-27T17:53:57.163 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a10819640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a0c06ef70 0x7f0a0c1d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a10819640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a0c06ef70 0x7f0a0c1d2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36904/0 (socket says 172.21.15.31:36904) 2023-11-27T17:53:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a10819640 1 -- 172.21.15.31:0/2926360204 learned_addr learned my addr 172.21.15.31:0/2926360204 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a1101a640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0a0c14c7b0 0x7f0a0c1df9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a0bfff640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0a42b0 0x7f0a0c149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a10819640 1 -- 172.21.15.31:0/2926360204 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0a0c14c7b0 msgr2=0x7f0a0c1df9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a10819640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0a0c14c7b0 0x7f0a0c1df9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a10819640 1 -- 172.21.15.31:0/2926360204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0a42b0 msgr2=0x7f0a0c149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a10819640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0a42b0 0x7f0a0c149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a10819640 1 -- 172.21.15.31:0/2926360204 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc009420 con 0x7f0a0c06ef70 2023-11-27T17:53:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a10819640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a0c06ef70 0x7f0a0c1d2860 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f09fc01c8a0 tx=0x7f09fc01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a097fa640 1 -- 172.21.15.31:0/2926360204 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0a8970 con 0x7f0a0c06ef70 2023-11-27T17:53:57.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a097fa640 1 -- 172.21.15.31:0/2926360204 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc0b9410 con 0x7f0a0c06ef70 2023-11-27T17:53:57.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 -- 172.21.15.31:0/2926360204 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c1e2840 con 0x7f0a0c06ef70 2023-11-27T17:53:57.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a097fa640 1 -- 172.21.15.31:0/2926360204 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0b97a0 con 0x7f0a0c06ef70 2023-11-27T17:53:57.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.156+0000 7f0a12a7d640 1 -- 172.21.15.31:0/2926360204 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c0b8570 con 0x7f0a0c06ef70 2023-11-27T17:53:57.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.160+0000 7f0a12a7d640 1 -- 172.21.15.31:0/2926360204 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c04e850 con 0x7f0a0c06ef70 2023-11-27T17:53:57.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.160+0000 7f0a097fa640 1 -- 172.21.15.31:0/2926360204 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f09fc0b7040 con 0x7f0a0c06ef70 2023-11-27T17:53:57.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.160+0000 7f0a097fa640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f09f80667f0 0x7f09f8068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:57.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.160+0000 7f0a097fa640 1 -- 172.21.15.31:0/2926360204 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f09fc122200 con 0x7f0a0c06ef70 2023-11-27T17:53:57.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.160+0000 7f0a0bfff640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f09f80667f0 0x7f09f8068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:57.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.160+0000 7f0a0bfff640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f09f80667f0 0x7f09f8068cb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0a00006fd0 tx=0x7f0a00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:57.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.164+0000 7f0a097fa640 1 -- 172.21.15.31:0/2926360204 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f09fc0ef330 con 0x7f0a0c06ef70 2023-11-27T17:53:57.362 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:57.356+0000 7f0a12a7d640 1 -- 172.21.15.31:0/2926360204 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0a0c0a5170 con 0x7f0a0c06ef70 2023-11-27T17:53:58.019 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.012+0000 7f0a097fa640 1 -- 172.21.15.31:0/2926360204 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0a0c0a5170 con 0x7f0a0c06ef70 2023-11-27T17:53:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.016+0000 7f0a12a7d640 1 -- 172.21.15.31:0/2926360204 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f09f80667f0 msgr2=0x7f09f8068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.016+0000 7f0a12a7d640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f09f80667f0 0x7f09f8068cb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0a00006fd0 tx=0x7f0a00008040 comp rx=0 tx=0).stop 2023-11-27T17:53:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.016+0000 7f0a12a7d640 1 -- 172.21.15.31:0/2926360204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a0c06ef70 msgr2=0x7f0a0c1d2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.016+0000 7f0a12a7d640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a0c06ef70 0x7f0a0c1d2860 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f09fc01c8a0 tx=0x7f09fc01ba10 comp rx=0 tx=0).stop 2023-11-27T17:53:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.016+0000 7f0a12a7d640 1 -- 172.21.15.31:0/2926360204 shutdown_connections 2023-11-27T17:53:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.016+0000 7f0a12a7d640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f09f80667f0 0x7f09f8068cb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.016+0000 7f0a12a7d640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f0a0c14c7b0 0x7f0a0c1df9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.016+0000 7f0a12a7d640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a0c0a42b0 0x7f0a0c149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:58.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.016+0000 7f0a12a7d640 1 --2- 172.21.15.31:0/2926360204 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0a0c06ef70 0x7f0a0c1d2860 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:58.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.016+0000 7f0a12a7d640 1 -- 172.21.15.31:0/2926360204 >> 172.21.15.31:0/2926360204 conn(0x7f0a0c0bb7d0 msgr2=0x7f0a0c0bbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:58.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.016+0000 7f0a12a7d640 1 -- 172.21.15.31:0/2926360204 shutdown_connections 2023-11-27T17:53:58.023 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.016+0000 7f0a12a7d640 1 -- 172.21.15.31:0/2926360204 wait complete. 2023-11-27T17:53:58.042 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-27T17:53:58.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.168+0000 7f8e5874a640 1 Processor -- start 2023-11-27T17:53:58.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.168+0000 7f8e5874a640 1 -- start start 2023-11-27T17:53:58.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.168+0000 7f8e5874a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e500b3480 0x7f8e501418e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:58.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.168+0000 7f8e5874a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8e500b21a0 0x7f8e50152290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:58.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.168+0000 7f8e5874a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e50147980 con 0x7f8e50141e20 2023-11-27T17:53:58.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.168+0000 7f8e5874a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e50148500 con 0x7f8e500b21a0 2023-11-27T17:53:58.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.168+0000 7f8e5874a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e500b5030 con 0x7f8e500b3480 2023-11-27T17:53:58.176 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.168+0000 7f8e564e6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e500b3480 0x7f8e501418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:58.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.168+0000 7f8e564e6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e500b3480 0x7f8e501418e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:46452/0 (socket says 172.21.15.31:46452) 2023-11-27T17:53:58.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.168+0000 7f8e564e6640 1 -- 172.21.15.31:0/878374989 learned_addr learned my addr 172.21.15.31:0/878374989 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:58.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.172+0000 7f8e56ce7640 1 --2- 172.21.15.31:0/878374989 >> v2:172.21.15.81:3300/0 conn(0x7f8e500b21a0 0x7f8e50152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:58.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.172+0000 7f8e564e6640 1 -- 172.21.15.31:0/878374989 >> v2:172.21.15.81:3300/0 conn(0x7f8e500b21a0 msgr2=0x7f8e50152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:58.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.172+0000 7f8e564e6640 1 --2- 172.21.15.31:0/878374989 >> v2:172.21.15.81:3300/0 conn(0x7f8e500b21a0 0x7f8e50152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:58.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.172+0000 7f8e564e6640 1 -- 172.21.15.31:0/878374989 >> v1:172.21.15.81:6789/0 conn(0x7f8e50141e20 legacy=0x7f8e500b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:58.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.172+0000 7f8e564e6640 1 -- 172.21.15.31:0/878374989 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e500b4dc0 con 0x7f8e500b3480 2023-11-27T17:53:58.179 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.172+0000 7f8e564e6640 1 --2- 172.21.15.31:0/878374989 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e500b3480 0x7f8e501418e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800d150 tx=0x7f8e48021400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77e7a231b0f63bb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:58.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.172+0000 7f8e554e4640 1 -- 172.21.15.31:0/878374989 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480b3410 con 0x7f8e500b3480 2023-11-27T17:53:58.180 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.172+0000 7f8e554e4640 1 -- 172.21.15.31:0/878374989 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e480ad030 con 0x7f8e500b3480 2023-11-27T17:53:58.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.172+0000 7f8e554e4640 1 -- 172.21.15.31:0/878374989 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480b3790 con 0x7f8e500b3480 2023-11-27T17:53:58.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 -- 172.21.15.31:0/878374989 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e500b3480 msgr2=0x7f8e501418e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:58.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 --2- 172.21.15.31:0/878374989 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e500b3480 0x7f8e501418e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800d150 tx=0x7f8e48021400 comp rx=0 tx=0).stop 2023-11-27T17:53:58.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 -- 172.21.15.31:0/878374989 shutdown_connections 2023-11-27T17:53:58.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 --2- 172.21.15.31:0/878374989 >> v2:172.21.15.81:3300/0 conn(0x7f8e500b21a0 0x7f8e50152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:58.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 --2- 172.21.15.31:0/878374989 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e500b3480 0x7f8e501418e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:58.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 -- 172.21.15.31:0/878374989 >> 172.21.15.31:0/878374989 conn(0x7f8e5006a730 msgr2=0x7f8e5006ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 -- 172.21.15.31:0/878374989 shutdown_connections 2023-11-27T17:53:58.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 -- 172.21.15.31:0/878374989 wait complete. 2023-11-27T17:53:58.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 Processor -- start 2023-11-27T17:53:58.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 -- start start 2023-11-27T17:53:58.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e500b21a0 0x7f8e501d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:58.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e500b3480 0x7f8e501e40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:58.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e50141e20 0x7f8e501446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:58.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e501d33c0 con 0x7f8e500b21a0 2023-11-27T17:53:58.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e501e1540 con 0x7f8e500b3480 2023-11-27T17:53:58.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50072350 con 0x7f8e50141e20 2023-11-27T17:53:58.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e564e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e500b21a0 0x7f8e501d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:58.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e564e6640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e500b21a0 0x7f8e501d2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36912/0 (socket says 172.21.15.31:36912) 2023-11-27T17:53:58.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e564e6640 1 -- 172.21.15.31:0/2132299342 learned_addr learned my addr 172.21.15.31:0/2132299342 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:58.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e56ce7640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e50141e20 0x7f8e501446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:58.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e55ce5640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e500b3480 0x7f8e501e40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:58.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e564e6640 1 -- 172.21.15.31:0/2132299342 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e50141e20 msgr2=0x7f8e501446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:58.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e564e6640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e50141e20 0x7f8e501446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:58.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e564e6640 1 -- 172.21.15.31:0/2132299342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e500b3480 msgr2=0x7f8e501e40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:58.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e564e6640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e500b3480 0x7f8e501e40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:58.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e564e6640 1 -- 172.21.15.31:0/2132299342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4800bd40 con 0x7f8e500b21a0 2023-11-27T17:53:58.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e564e6640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e500b21a0 0x7f8e501d2e80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8e4801f030 tx=0x7f8e4801e1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:58.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e46ffd640 1 -- 172.21.15.31:0/2132299342 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480bc850 con 0x7f8e500b21a0 2023-11-27T17:53:58.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e46ffd640 1 -- 172.21.15.31:0/2132299342 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e480bc9b0 con 0x7f8e500b21a0 2023-11-27T17:53:58.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 -- 172.21.15.31:0/2132299342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e501d39d0 con 0x7f8e500b21a0 2023-11-27T17:53:58.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e46ffd640 1 -- 172.21.15.31:0/2132299342 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480bcd40 con 0x7f8e500b21a0 2023-11-27T17:53:58.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 -- 172.21.15.31:0/2132299342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e501e11d0 con 0x7f8e500b21a0 2023-11-27T17:53:58.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.176+0000 7f8e5874a640 1 -- 172.21.15.31:0/2132299342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5004e850 con 0x7f8e500b21a0 2023-11-27T17:53:58.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.180+0000 7f8e46ffd640 1 -- 172.21.15.31:0/2132299342 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f8e480ba070 con 0x7f8e500b21a0 2023-11-27T17:53:58.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.180+0000 7f8e46ffd640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8e340667f0 0x7f8e34068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:58.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.180+0000 7f8e46ffd640 1 -- 172.21.15.31:0/2132299342 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8e48122cd0 con 0x7f8e500b21a0 2023-11-27T17:53:58.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.180+0000 7f8e55ce5640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8e340667f0 0x7f8e34068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:58.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.180+0000 7f8e55ce5640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8e340667f0 0x7f8e34068cb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8e50072920 tx=0x7f8e40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:58.189 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.184+0000 7f8e46ffd640 1 -- 172.21.15.31:0/2132299342 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f8e480f0000 con 0x7f8e500b21a0 2023-11-27T17:53:58.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:58.344+0000 7f8e5874a640 1 -- 172.21.15.31:0/2132299342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e5006acc0 con 0x7f8e500b21a0 2023-11-27T17:53:59.225 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.220+0000 7f8e46ffd640 1 -- 172.21.15.31:0/2132299342 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8e480f3620 con 0x7f8e500b21a0 2023-11-27T17:53:59.226 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2023-11-27T17:53:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.224+0000 7f8e5874a640 1 -- 172.21.15.31:0/2132299342 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8e340667f0 msgr2=0x7f8e34068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.224+0000 7f8e5874a640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8e340667f0 0x7f8e34068cb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8e50072920 tx=0x7f8e40009040 comp rx=0 tx=0).stop 2023-11-27T17:53:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.224+0000 7f8e5874a640 1 -- 172.21.15.31:0/2132299342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e500b21a0 msgr2=0x7f8e501d2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.224+0000 7f8e5874a640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e500b21a0 0x7f8e501d2e80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8e4801f030 tx=0x7f8e4801e1a0 comp rx=0 tx=0).stop 2023-11-27T17:53:59.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.224+0000 7f8e5874a640 1 -- 172.21.15.31:0/2132299342 shutdown_connections 2023-11-27T17:53:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.224+0000 7f8e5874a640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f8e340667f0 0x7f8e34068cb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.224+0000 7f8e5874a640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f8e50141e20 0x7f8e501446f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.224+0000 7f8e5874a640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e500b3480 0x7f8e501e40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.224+0000 7f8e5874a640 1 --2- 172.21.15.31:0/2132299342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e500b21a0 0x7f8e501d2e80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.224+0000 7f8e5874a640 1 -- 172.21.15.31:0/2132299342 >> 172.21.15.31:0/2132299342 conn(0x7f8e5006a730 msgr2=0x7f8e500b5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.224+0000 7f8e5874a640 1 -- 172.21.15.31:0/2132299342 shutdown_connections 2023-11-27T17:53:59.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.224+0000 7f8e5874a640 1 -- 172.21.15.31:0/2132299342 wait complete. 2023-11-27T17:53:59.256 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-27T17:53:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5e4e42640 1 Processor -- start 2023-11-27T17:53:59.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5e4e42640 1 -- start start 2023-11-27T17:53:59.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5e4e42640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa5e00b4290 0x7fa5e00b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:59.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5e4e42640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5e00b5d10 0x7fa5e00b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:59.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5e4e42640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e00b9e20 con 0x7fa5e00b3b40 2023-11-27T17:53:59.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5e4e42640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e00b4f70 con 0x7fa5e00b4290 2023-11-27T17:53:59.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5e4e42640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00b91c0 con 0x7fa5e00b5d10 2023-11-27T17:53:59.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5de59c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa5e00b4290 0x7fa5e00b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:59.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5ddd9b640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa5e00b3b40 0x7fa5e0142060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48918/0 (socket says 172.21.15.31:48918) 2023-11-27T17:53:59.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5ddd9b640 1 -- 172.21.15.31:0/3621885182 learned_addr learned my addr 172.21.15.31:0/3621885182 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:53:59.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5ded9d640 1 --2- 172.21.15.31:0/3621885182 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5e00b5d10 0x7fa5e00b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:59.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5de59c640 1 -- 172.21.15.31:0/3621885182 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5e00b5d10 msgr2=0x7fa5e00b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:53:59.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5de59c640 1 --2- 172.21.15.31:0/3621885182 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5e00b5d10 0x7fa5e00b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:59.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5de59c640 1 -- 172.21.15.31:0/3621885182 >> v1:172.21.15.31:6789/0 conn(0x7fa5e00b3b40 legacy=0x7fa5e0142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:59.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5de59c640 1 -- 172.21.15.31:0/3621885182 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e00b9ab0 con 0x7fa5e00b4290 2023-11-27T17:53:59.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.380+0000 7fa5dd59a640 1 -- 172.21.15.31:0/3621885182 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972632426 0 0) 0x7fa5e00b9e20 con 0x7fa5e00b3b40 2023-11-27T17:53:59.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5de59c640 1 --2- 172.21.15.31:0/3621885182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5e00b4290 0x7fa5e00b6bc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40097c0 tx=0x7fa5d401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e195911cbe9ae62 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:59.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5dd59a640 1 -- 172.21.15.31:0/3621885182 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d40a6040 con 0x7fa5e00b4290 2023-11-27T17:53:59.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5dd59a640 1 -- 172.21.15.31:0/3621885182 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d40aa600 con 0x7fa5e00b4290 2023-11-27T17:53:59.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5dd59a640 1 -- 172.21.15.31:0/3621885182 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d40aa990 con 0x7fa5e00b4290 2023-11-27T17:53:59.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5e4e42640 1 -- 172.21.15.31:0/3621885182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5e00b4290 msgr2=0x7fa5e00b6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:59.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5e4e42640 1 --2- 172.21.15.31:0/3621885182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5e00b4290 0x7fa5e00b6bc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40097c0 tx=0x7fa5d401c480 comp rx=0 tx=0).stop 2023-11-27T17:53:59.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5e4e42640 1 -- 172.21.15.31:0/3621885182 shutdown_connections 2023-11-27T17:53:59.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5e4e42640 1 --2- 172.21.15.31:0/3621885182 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5e00b5d10 0x7fa5e00b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5e4e42640 1 --2- 172.21.15.31:0/3621885182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5e00b4290 0x7fa5e00b6bc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5e4e42640 1 -- 172.21.15.31:0/3621885182 >> 172.21.15.31:0/3621885182 conn(0x7fa5e006a730 msgr2=0x7fa5e006ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:53:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5e4e42640 1 -- 172.21.15.31:0/3621885182 shutdown_connections 2023-11-27T17:53:59.391 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5e4e42640 1 -- 172.21.15.31:0/3621885182 wait complete. 2023-11-27T17:53:59.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5e4e42640 1 Processor -- start 2023-11-27T17:53:59.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.384+0000 7fa5e4e42640 1 -- start start 2023-11-27T17:53:59.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5e4e42640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e00b4290 0x7fa5e00bb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5e4e42640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5e00b5d10 0x7fa5e014b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5e4e42640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5e014be70 0x7fa5e01e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5e4e42640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e0145870 con 0x7fa5e014be70 2023-11-27T17:53:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5e4e42640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e00bbb50 con 0x7fa5e00b4290 2023-11-27T17:53:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5e4e42640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e01416f0 con 0x7fa5e00b5d10 2023-11-27T17:53:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ded9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5e014be70 0x7fa5e01e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:59.394 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ded9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5e014be70 0x7fa5e01e4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36930/0 (socket says 172.21.15.31:36930) 2023-11-27T17:53:59.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ded9d640 1 -- 172.21.15.31:0/1881421749 learned_addr learned my addr 172.21.15.31:0/1881421749 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:53:59.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ddd9b640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5e00b5d10 0x7fa5e014b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:59.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5de59c640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e00b4290 0x7fa5e00bb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:59.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ded9d640 1 -- 172.21.15.31:0/1881421749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5e00b5d10 msgr2=0x7fa5e014b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:59.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ded9d640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5e00b5d10 0x7fa5e014b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:59.395 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ded9d640 1 -- 172.21.15.31:0/1881421749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e00b4290 msgr2=0x7fa5e00bb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:53:59.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ded9d640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e00b4290 0x7fa5e00bb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:53:59.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ded9d640 1 -- 172.21.15.31:0/1881421749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d4009420 con 0x7fa5e014be70 2023-11-27T17:53:59.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ded9d640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5e014be70 0x7fa5e01e4f00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8007e90 tx=0x7fa5d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:59.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ceffd640 1 -- 172.21.15.31:0/1881421749 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8014420 con 0x7fa5e014be70 2023-11-27T17:53:59.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ceffd640 1 -- 172.21.15.31:0/1881421749 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d8014580 con 0x7fa5e014be70 2023-11-27T17:53:59.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ceffd640 1 -- 172.21.15.31:0/1881421749 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8014930 con 0x7fa5e014be70 2023-11-27T17:53:59.396 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5e4e42640 1 -- 172.21.15.31:0/1881421749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e0143d90 con 0x7fa5e014be70 2023-11-27T17:53:59.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5e4e42640 1 -- 172.21.15.31:0/1881421749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e0145a50 con 0x7fa5e014be70 2023-11-27T17:53:59.397 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5e4e42640 1 -- 172.21.15.31:0/1881421749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e0144470 con 0x7fa5e014be70 2023-11-27T17:53:59.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ceffd640 1 -- 172.21.15.31:0/1881421749 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa5d8014a90 con 0x7fa5e014be70 2023-11-27T17:53:59.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ceffd640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa5c0066820 0x7fa5c0068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:53:59.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5ceffd640 1 -- 172.21.15.31:0/1881421749 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fa5d8084a70 con 0x7fa5e014be70 2023-11-27T17:53:59.398 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5de59c640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa5c0066820 0x7fa5c0068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:53:59.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.388+0000 7fa5de59c640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa5c0066820 0x7fa5c0068ce0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40ae000 tx=0x7fa5d40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:53:59.399 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.392+0000 7fa5ceffd640 1 -- 172.21.15.31:0/1881421749 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa5d8051c30 con 0x7fa5e014be70 2023-11-27T17:53:59.554 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:53:59.548+0000 7fa5e4e42640 1 -- 172.21.15.31:0/1881421749 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa5e004e850 con 0x7fa5e014be70 2023-11-27T17:54:00.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5ceffd640 1 -- 172.21.15.31:0/1881421749 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa5d8055250 con 0x7fa5e014be70 2023-11-27T17:54:00.228 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2023-11-27T17:54:00.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5e4e42640 1 -- 172.21.15.31:0/1881421749 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa5c0066820 msgr2=0x7fa5c0068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:00.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5e4e42640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa5c0066820 0x7fa5c0068ce0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40ae000 tx=0x7fa5d40a7000 comp rx=0 tx=0).stop 2023-11-27T17:54:00.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5e4e42640 1 -- 172.21.15.31:0/1881421749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5e014be70 msgr2=0x7fa5e01e4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:00.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5e4e42640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5e014be70 0x7fa5e01e4f00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8007e90 tx=0x7fa5d800e4b0 comp rx=0 tx=0).stop 2023-11-27T17:54:00.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5e4e42640 1 -- 172.21.15.31:0/1881421749 shutdown_connections 2023-11-27T17:54:00.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5e4e42640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa5c0066820 0x7fa5c0068ce0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:00.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5e4e42640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5e014be70 0x7fa5e01e4f00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:00.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5e4e42640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa5e00b5d10 0x7fa5e014b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:00.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5e4e42640 1 --2- 172.21.15.31:0/1881421749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e00b4290 0x7fa5e00bb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:00.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5e4e42640 1 -- 172.21.15.31:0/1881421749 >> 172.21.15.31:0/1881421749 conn(0x7fa5e006a730 msgr2=0x7fa5e0147ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:00.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5e4e42640 1 -- 172.21.15.31:0/1881421749 shutdown_connections 2023-11-27T17:54:00.232 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.224+0000 7fa5e4e42640 1 -- 172.21.15.31:0/1881421749 wait complete. 2023-11-27T17:54:00.262 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-27T17:54:00.262 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-27T17:54:00.263 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-27T17:54:00.263 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T17:54:00.263 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-27T17:54:00.263 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-27T17:54:00.263 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-27T17:54:00.264 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T17:54:00.264 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-27T17:54:00.264 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-27T17:54:00.264 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-27T17:54:00.264 INFO:teuthology.orchestra.run:waiting for 300 2023-11-27T17:54:00.277 INFO:tasks.ceph.mds.c:Stopped 2023-11-27T17:54:00.277 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-27T17:54:00.278 INFO:tasks.ceph.mds.a:Stopped 2023-11-27T17:54:00.278 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-27T17:54:00.279 INFO:tasks.ceph.mds.b:Stopped 2023-11-27T17:54:00.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-27T17:54:00.320 INFO:tasks.ceph.mds.c:Started 2023-11-27T17:54:00.321 DEBUG:teuthology.parallel:result is None 2023-11-27T17:54:00.322 INFO:tasks.ceph.mds.a:Started 2023-11-27T17:54:00.322 DEBUG:teuthology.parallel:result is None 2023-11-27T17:54:00.323 INFO:tasks.ceph.mds.b:Started 2023-11-27T17:54:00.323 DEBUG:teuthology.parallel:result is None 2023-11-27T17:54:00.323 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-27T17:54:00.381 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2023-11-27T17:54:00.382 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2023-11-27T17:54:00.391 INFO:tasks.ceph.mds.b.smithi081.stdout:starting mds.b at 2023-11-27T17:54:00.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.436+0000 7fb90dfb5640 1 Processor -- start 2023-11-27T17:54:00.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.436+0000 7fb90dfb5640 1 -- start start 2023-11-27T17:54:00.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.436+0000 7fb90dfb5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb90814c7b0 0x7fb9080b5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:00.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.436+0000 7fb90dfb5640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb90806ef70 0x7fb90806f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:00.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.436+0000 7fb90dfb5640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9080b4360 con 0x7fb9080a42b0 2023-11-27T17:54:00.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.436+0000 7fb90dfb5640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90806e7a0 con 0x7fb90806ef70 2023-11-27T17:54:00.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.436+0000 7fb90dfb5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9080b4030 con 0x7fb90814c7b0 2023-11-27T17:54:00.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.436+0000 7fb907fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb90806ef70 0x7fb90806f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:00.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.436+0000 7fb9077fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb9080a42b0 0x7fb9080b47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48946/0 (socket says 172.21.15.31:48946) 2023-11-27T17:54:00.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.436+0000 7fb9077fe640 1 -- 172.21.15.31:0/1350790685 learned_addr learned my addr 172.21.15.31:0/1350790685 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:00.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.436+0000 7fb906ffd640 1 --2- 172.21.15.31:0/1350790685 >> v2:172.21.15.81:3300/0 conn(0x7fb90814c7b0 0x7fb9080b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:00.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.440+0000 7fb907fff640 1 -- 172.21.15.31:0/1350790685 >> v2:172.21.15.81:3300/0 conn(0x7fb90814c7b0 msgr2=0x7fb9080b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:00.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.440+0000 7fb907fff640 1 --2- 172.21.15.31:0/1350790685 >> v2:172.21.15.81:3300/0 conn(0x7fb90814c7b0 0x7fb9080b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:00.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.440+0000 7fb907fff640 1 -- 172.21.15.31:0/1350790685 >> v1:172.21.15.31:6789/0 conn(0x7fb9080a42b0 legacy=0x7fb9080b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:00.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.440+0000 7fb907fff640 1 -- 172.21.15.31:0/1350790685 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90806f9e0 con 0x7fb90806ef70 2023-11-27T17:54:00.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.440+0000 7fb9067fc640 1 -- 172.21.15.31:0/1350790685 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216230068 0 0) 0x7fb9080b4360 con 0x7fb9080a42b0 2023-11-27T17:54:00.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.440+0000 7fb907fff640 1 --2- 172.21.15.31:0/1350790685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb90806ef70 0x7fb90806f3c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb90806b220 tx=0x7fb90001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20ccbce84005904 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:00.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.440+0000 7fb9067fc640 1 -- 172.21.15.31:0/1350790685 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9000b0440 con 0x7fb90806ef70 2023-11-27T17:54:00.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.440+0000 7fb9067fc640 1 -- 172.21.15.31:0/1350790685 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9000b05a0 con 0x7fb90806ef70 2023-11-27T17:54:00.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.440+0000 7fb9067fc640 1 -- 172.21.15.31:0/1350790685 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9000b0930 con 0x7fb90806ef70 2023-11-27T17:54:00.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 -- 172.21.15.31:0/1350790685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb90806ef70 msgr2=0x7fb90806f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:00.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 --2- 172.21.15.31:0/1350790685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb90806ef70 0x7fb90806f3c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb90806b220 tx=0x7fb90001f0f0 comp rx=0 tx=0).stop 2023-11-27T17:54:00.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 -- 172.21.15.31:0/1350790685 shutdown_connections 2023-11-27T17:54:00.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 --2- 172.21.15.31:0/1350790685 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb90806ef70 0x7fb90806f3c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:00.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 --2- 172.21.15.31:0/1350790685 >> v2:172.21.15.81:3300/0 conn(0x7fb90814c7b0 0x7fb9080b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:00.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 -- 172.21.15.31:0/1350790685 >> 172.21.15.31:0/1350790685 conn(0x7fb9080bb7d0 msgr2=0x7fb9080bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:00.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 -- 172.21.15.31:0/1350790685 shutdown_connections 2023-11-27T17:54:00.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 -- 172.21.15.31:0/1350790685 wait complete. 2023-11-27T17:54:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 Processor -- start 2023-11-27T17:54:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 -- start start 2023-11-27T17:54:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb90806ef70 0x7fb9080b8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9080a42b0 0x7fb9080b6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90814c7b0 0x7fb9080b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080b64c0 con 0x7fb9080a42b0 2023-11-27T17:54:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080b8830 con 0x7fb90814c7b0 2023-11-27T17:54:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9080b8560 con 0x7fb90806ef70 2023-11-27T17:54:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb906ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9080a42b0 0x7fb9080b6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb906ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9080a42b0 0x7fb9080b6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36978/0 (socket says 172.21.15.31:36978) 2023-11-27T17:54:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb906ffd640 1 -- 172.21.15.31:0/3056717071 learned_addr learned my addr 172.21.15.31:0/3056717071 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:00.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb9077fe640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb90806ef70 0x7fb9080b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:00.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb907fff640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90814c7b0 0x7fb9080b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:00.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb906ffd640 1 -- 172.21.15.31:0/3056717071 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb90806ef70 msgr2=0x7fb9080b8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:00.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb906ffd640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb90806ef70 0x7fb9080b8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:00.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb906ffd640 1 -- 172.21.15.31:0/3056717071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90814c7b0 msgr2=0x7fb9080b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:00.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb906ffd640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90814c7b0 0x7fb9080b6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:00.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb906ffd640 1 -- 172.21.15.31:0/3056717071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb900009a70 con 0x7fb9080a42b0 2023-11-27T17:54:00.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb9077fe640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb90806ef70 0x7fb9080b8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:54:00.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb906ffd640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9080a42b0 0x7fb9080b6950 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00e840 tx=0x7fb8fc00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:00.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb8effff640 1 -- 172.21.15.31:0/3056717071 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc009510 con 0x7fb9080a42b0 2023-11-27T17:54:00.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb8effff640 1 -- 172.21.15.31:0/3056717071 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc00ee90 con 0x7fb9080a42b0 2023-11-27T17:54:00.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 -- 172.21.15.31:0/3056717071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90809e3d0 con 0x7fb9080a42b0 2023-11-27T17:54:00.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb8effff640 1 -- 172.21.15.31:0/3056717071 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00cb80 con 0x7fb9080a42b0 2023-11-27T17:54:00.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 -- 172.21.15.31:0/3056717071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9080a2ae0 con 0x7fb9080a42b0 2023-11-27T17:54:00.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.444+0000 7fb90dfb5640 1 -- 172.21.15.31:0/3056717071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9080b6670 con 0x7fb9080a42b0 2023-11-27T17:54:00.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.448+0000 7fb8effff640 1 -- 172.21.15.31:0/3056717071 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb8fc00cce0 con 0x7fb9080a42b0 2023-11-27T17:54:00.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.448+0000 7fb8effff640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb8f4066820 0x7fb8f4068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.448+0000 7fb9077fe640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb8f4066820 0x7fb8f4068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.448+0000 7fb8effff640 1 -- 172.21.15.31:0/3056717071 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb8fc083fb0 con 0x7fb9080a42b0 2023-11-27T17:54:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.448+0000 7fb9077fe640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb8f4066820 0x7fb8f4068ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8007fd0 tx=0x7fb8f8007c20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:00.456 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.452+0000 7fb8effff640 1 -- 172.21.15.31:0/3056717071 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb8fc0b5280 con 0x7fb9080a42b0 2023-11-27T17:54:00.653 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:00.648+0000 7fb90dfb5640 1 -- 172.21.15.31:0/3056717071 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb90804e850 con 0x7fb9080a42b0 2023-11-27T17:54:01.252 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.248+0000 7fb8effff640 1 -- 172.21.15.31:0/3056717071 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb9080b6670 con 0x7fb9080a42b0 2023-11-27T17:54:01.253 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2023-11-27T17:54:01.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.252+0000 7fb90dfb5640 1 -- 172.21.15.31:0/3056717071 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb8f4066820 msgr2=0x7fb8f4068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.252+0000 7fb90dfb5640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb8f4066820 0x7fb8f4068ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8007fd0 tx=0x7fb8f8007c20 comp rx=0 tx=0).stop 2023-11-27T17:54:01.257 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.252+0000 7fb90dfb5640 1 -- 172.21.15.31:0/3056717071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9080a42b0 msgr2=0x7fb9080b6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.252+0000 7fb90dfb5640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9080a42b0 0x7fb9080b6950 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00e840 tx=0x7fb8fc00ec40 comp rx=0 tx=0).stop 2023-11-27T17:54:01.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.252+0000 7fb90dfb5640 1 -- 172.21.15.31:0/3056717071 shutdown_connections 2023-11-27T17:54:01.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.252+0000 7fb90dfb5640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb8f4066820 0x7fb8f4068ce0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.252+0000 7fb90dfb5640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90814c7b0 0x7fb9080b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.252+0000 7fb90dfb5640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9080a42b0 0x7fb9080b6950 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.252+0000 7fb90dfb5640 1 --2- 172.21.15.31:0/3056717071 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb90806ef70 0x7fb9080b8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.252+0000 7fb90dfb5640 1 -- 172.21.15.31:0/3056717071 >> 172.21.15.31:0/3056717071 conn(0x7fb9080bb7d0 msgr2=0x7fb9081d7710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:01.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.252+0000 7fb90dfb5640 1 -- 172.21.15.31:0/3056717071 shutdown_connections 2023-11-27T17:54:01.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.252+0000 7fb90dfb5640 1 -- 172.21.15.31:0/3056717071 wait complete. 2023-11-27T17:54:01.282 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-27T17:54:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54be2cc640 1 Processor -- start 2023-11-27T17:54:01.410 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54be2cc640 1 -- start start 2023-11-27T17:54:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54be2cc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f54b81430a0 0x7f54b80b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.412 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54be2cc640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b80b5d00 con 0x7f54b80bd6b0 2023-11-27T17:54:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54be2cc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b8143750 con 0x7f54b80bd240 2023-11-27T17:54:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54be2cc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b8143480 con 0x7f54b81430a0 2023-11-27T17:54:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54bc869640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f54b80bd6b0 0x7f54b8153980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48962/0 (socket says 172.21.15.31:48962) 2023-11-27T17:54:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54bc869640 1 -- 172.21.15.31:0/2606641486 learned_addr learned my addr 172.21.15.31:0/2606641486 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54b7fff640 1 --2- 172.21.15.31:0/2606641486 >> v2:172.21.15.81:3300/0 conn(0x7f54b81430a0 0x7f54b80b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261303890 0 0) 0x7f54b00014a0 con 0x7f54b80bd6b0 2023-11-27T17:54:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54a0003530 con 0x7f54b80bd6b0 2023-11-27T17:54:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3658544670 0 0) 0x7f54a0003530 con 0x7f54b80bd6b0 2023-11-27T17:54:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 >> v2:172.21.15.81:3300/0 conn(0x7f54b81430a0 msgr2=0x7f54b80b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.404+0000 7f54b6ffd640 1 --2- 172.21.15.31:0/2606641486 >> v2:172.21.15.81:3300/0 conn(0x7f54b81430a0 0x7f54b80b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 >> v1:172.21.15.81:6789/0 conn(0x7f54b80bd240 legacy=0x7f54b8149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.413 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80b4f40 con 0x7f54b80bd6b0 2023-11-27T17:54:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f54b0001b90 con 0x7f54b80bd6b0 2023-11-27T17:54:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 >> v1:172.21.15.31:6789/0 conn(0x7f54b80bd6b0 legacy=0x7f54b8153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 --2- 172.21.15.31:0/2606641486 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54a00039f0 0x7f54a0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 --2- 172.21.15.31:0/2606641486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a00047d0 0x7f54a0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 --2- 172.21.15.31:0/2606641486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 0x7f54a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b8143480 con 0x7f54a0005190 2023-11-27T17:54:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a000c0a0 con 0x7f54a00047d0 2023-11-27T17:54:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a000c260 con 0x7f54a00039f0 2023-11-27T17:54:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54bc869640 1 --2- 172.21.15.31:0/2606641486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 0x7f54a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b77fe640 1 --2- 172.21.15.31:0/2606641486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a00047d0 0x7f54a0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b7fff640 1 --2- 172.21.15.31:0/2606641486 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54a00039f0 0x7f54a0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54bc869640 1 -- 172.21.15.31:0/2606641486 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54a00039f0 msgr2=0x7f54a0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54bc869640 1 --2- 172.21.15.31:0/2606641486 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54a00039f0 0x7f54a0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54bc869640 1 -- 172.21.15.31:0/2606641486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a00047d0 msgr2=0x7f54a0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54bc869640 1 --2- 172.21.15.31:0/2606641486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54a00047d0 0x7f54a0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54bc869640 1 -- 172.21.15.31:0/2606641486 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0003530 con 0x7f54a0005190 2023-11-27T17:54:01.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b7fff640 1 --2- 172.21.15.31:0/2606641486 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54a00039f0 0x7f54a0003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:01.417 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54bc869640 1 -- 172.21.15.31:0/2606641486 reap_dead start 2023-11-27T17:54:01.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54bc869640 1 --2- 172.21.15.31:0/2606641486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 0x7f54a000b990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f54b000a830 tx=0x7f54b001d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad20fa1feba310e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:01.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b00ad630 con 0x7f54a0005190 2023-11-27T17:54:01.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b00a8070 con 0x7f54a0005190 2023-11-27T17:54:01.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54b6ffd640 1 -- 172.21.15.31:0/2606641486 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b00ad9f0 con 0x7f54a0005190 2023-11-27T17:54:01.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54be2cc640 1 -- 172.21.15.31:0/2606641486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 msgr2=0x7f54a000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54be2cc640 1 --2- 172.21.15.31:0/2606641486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 0x7f54a000b990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f54b000a830 tx=0x7f54b001d340 comp rx=0 tx=0).stop 2023-11-27T17:54:01.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54be2cc640 1 -- 172.21.15.31:0/2606641486 shutdown_connections 2023-11-27T17:54:01.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54be2cc640 1 --2- 172.21.15.31:0/2606641486 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 0x7f54a000b990 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54be2cc640 1 -- 172.21.15.31:0/2606641486 >> 172.21.15.31:0/2606641486 conn(0x7f54b806ab60 msgr2=0x7f54b80bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:01.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54be2cc640 1 -- 172.21.15.31:0/2606641486 shutdown_connections 2023-11-27T17:54:01.418 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.408+0000 7f54be2cc640 1 -- 172.21.15.31:0/2606641486 wait complete. 2023-11-27T17:54:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54be2cc640 1 Processor -- start 2023-11-27T17:54:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54be2cc640 1 -- start start 2023-11-27T17:54:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54be2cc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 0x7f54b8146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54be2cc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b814cd40 0x7f54b813eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54be2cc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54b813f3e0 0x7f54b81de6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54be2cc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b814b0d0 con 0x7f54a0005190 2023-11-27T17:54:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54be2cc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b8146770 con 0x7f54b814cd40 2023-11-27T17:54:01.419 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54be2cc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b814a7a0 con 0x7f54b813f3e0 2023-11-27T17:54:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b7fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 0x7f54b8146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b7fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 0x7f54b8146230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37000/0 (socket says 172.21.15.31:37000) 2023-11-27T17:54:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b7fff640 1 -- 172.21.15.31:0/339374730 learned_addr learned my addr 172.21.15.31:0/339374730 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54bc869640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54b813f3e0 0x7f54b81de6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b77fe640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b814cd40 0x7f54b813eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b7fff640 1 -- 172.21.15.31:0/339374730 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54b813f3e0 msgr2=0x7f54b81de6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b7fff640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54b813f3e0 0x7f54b81de6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b7fff640 1 -- 172.21.15.31:0/339374730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b814cd40 msgr2=0x7f54b813eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b7fff640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b814cd40 0x7f54b813eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b7fff640 1 -- 172.21.15.31:0/339374730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b814aa80 con 0x7f54a0005190 2023-11-27T17:54:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54bc869640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54b813f3e0 0x7f54b81de6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:01.420 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b7fff640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 0x7f54b8146230 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f54a80108d0 tx=0x7f54a8010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:01.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b4ff9640 1 -- 172.21.15.31:0/339374730 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8004220 con 0x7f54a0005190 2023-11-27T17:54:01.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b4ff9640 1 -- 172.21.15.31:0/339374730 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a8004380 con 0x7f54a0005190 2023-11-27T17:54:01.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54be2cc640 1 -- 172.21.15.31:0/339374730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b814ad60 con 0x7f54a0005190 2023-11-27T17:54:01.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b4ff9640 1 -- 172.21.15.31:0/339374730 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a800eba0 con 0x7f54a0005190 2023-11-27T17:54:01.421 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54be2cc640 1 -- 172.21.15.31:0/339374730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b814a1c0 con 0x7f54a0005190 2023-11-27T17:54:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54be2cc640 1 -- 172.21.15.31:0/339374730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b804e850 con 0x7f54a0005190 2023-11-27T17:54:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.412+0000 7f54b4ff9640 1 -- 172.21.15.31:0/339374730 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f54a800ed00 con 0x7f54a0005190 2023-11-27T17:54:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.416+0000 7f54b4ff9640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f54a4066820 0x7f54a4068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.416+0000 7f54b4ff9640 1 -- 172.21.15.31:0/339374730 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f54a8083dc0 con 0x7f54a0005190 2023-11-27T17:54:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.416+0000 7f54b77fe640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f54a4066820 0x7f54a4068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.422 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.416+0000 7f54b77fe640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f54a4066820 0x7f54a4068ce0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f54b8147ff0 tx=0x7f54ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:01.424 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.420+0000 7f54b4ff9640 1 -- 172.21.15.31:0/339374730 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f54a80512a0 con 0x7f54a0005190 2023-11-27T17:54:01.649 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.644+0000 7f54be2cc640 1 -- 172.21.15.31:0/339374730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f54b8148e00 con 0x7f54a0005190 2023-11-27T17:54:01.650 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.644+0000 7f54b4ff9640 1 -- 172.21.15.31:0/339374730 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+5491 (secure 0 0 0) 0x7f54a80548c0 con 0x7f54a0005190 2023-11-27T17:54:01.650 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:01.650 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-11-27T17:54:01.650 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2023-11-27T17:54:01.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.650 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2023-11-27T17:54:01.650 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBT12Rly+v0CBAAM1/AIv8HQjpX5HDSl1b5aQ==", 2023-11-27T17:54:01.650 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.650 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBT12RlJYDZFxAA76+y4pjIBvhxhaqN9e7/KA==", 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-11-27T17:54:01.651 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBT12RlhU2uERAAEsKnLYGy6SBf8Rrgio5XHg==", 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBW12RlwpfGIRAA4iV4+SIOGLXeRm/FVVKSKQ==", 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBZ12RlJRQLKRAAEn/WOttbKmZsXXpSBTh3Fg==", 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.653 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-11-27T17:54:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-11-27T17:54:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2023-11-27T17:54:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBc12Rly2ruLxAA/hU/YwL89WkWtNU0l0HYBQ==", 2023-11-27T17:54:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-11-27T17:54:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-11-27T17:54:01.654 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2023-11-27T17:54:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBf12Rlp8h4ORAAFCVFUQu5Xmjd8M4ejRESag==", 2023-11-27T17:54:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-11-27T17:54:01.655 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-11-27T17:54:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2023-11-27T17:54:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBl12Rl6jl4OBAAMCJZT4Kzp0Vu81xluM7ekA==", 2023-11-27T17:54:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-11-27T17:54:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-11-27T17:54:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.656 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2023-11-27T17:54:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBp12RlhvmSBBAATgLor3aHVPt1DcUEAhUKyg==", 2023-11-27T17:54:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-11-27T17:54:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-11-27T17:54:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2023-11-27T17:54:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBs12RlnUotDRAAfRVSLXdbzNWCofG8dSrcGQ==", 2023-11-27T17:54:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-11-27T17:54:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-11-27T17:54:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2023-11-27T17:54:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBv12Rlb8WJFBAANjZH+NgnUtcMhVfjgGhBNQ==", 2023-11-27T17:54:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2023-11-27T17:54:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2023-11-27T17:54:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2023-11-27T17:54:01.659 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBT12RlGScMHhAAuWSgPslHVjR+yfiMMPITUg==", 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBS12RlWiRfKBAARLbvO/ZW3NBv6Trdj6bXGw==", 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-11-27T17:54:01.660 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2023-11-27T17:54:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2023-11-27T17:54:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-mds", 2023-11-27T17:54:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB612Rl1dfmCRAAGg4aFOqNJ4m7csosroWYBQ==", 2023-11-27T17:54:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-mds" 2023-11-27T17:54:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-mgr", 2023-11-27T17:54:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB612RlKvrmCRAA8M9yV2AUtLa3hEV/4HAoRA==", 2023-11-27T17:54:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-27T17:54:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-osd", 2023-11-27T17:54:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB612RlIxPnCRAA04Z8muJUmcFu3xNI0WI5Jg==", 2023-11-27T17:54:01.662 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.663 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-osd" 2023-11-27T17:54:01.663 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.663 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rbd", 2023-11-27T17:54:01.663 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB612RlnivnCRAAIEJUVKRYBE1+GvdoI729Mw==", 2023-11-27T17:54:01.663 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.663 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-27T17:54:01.664 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.664 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-27T17:54:01.664 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB612RlSkPnCRAA4KDlMIBL7qy1Nptyd7GtiQ==", 2023-11-27T17:54:01.664 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.664 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-27T17:54:01.664 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.665 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rgw", 2023-11-27T17:54:01.665 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB612RlGFznCRAA2CJ0uqB6YHXPjBGUS86YiA==", 2023-11-27T17:54:01.665 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.665 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-27T17:54:01.665 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.666 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2023-11-27T17:54:01.666 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBT12RlknjZBRAA24DxLaIYU53VOgXm7SG38w==", 2023-11-27T17:54:01.666 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.666 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-11-27T17:54:01.666 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-11-27T17:54:01.666 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.666 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-11-27T17:54:01.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:01.666 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2023-11-27T17:54:01.666 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBT12RlNz8LAxAADE0KfL29q+wE20sBf3nsNQ==", 2023-11-27T17:54:01.666 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2023-11-27T17:54:01.667 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2023-11-27T17:54:01.667 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2023-11-27T17:54:01.667 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2023-11-27T17:54:01.667 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.667 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:01.667 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-11-27T17:54:01.667 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-11-27T17:54:01.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.648+0000 7f54be2cc640 1 -- 172.21.15.31:0/339374730 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f54a4066820 msgr2=0x7f54a4068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.648+0000 7f54be2cc640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f54a4066820 0x7f54a4068ce0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f54b8147ff0 tx=0x7f54ac009040 comp rx=0 tx=0).stop 2023-11-27T17:54:01.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.648+0000 7f54be2cc640 1 -- 172.21.15.31:0/339374730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 msgr2=0x7f54b8146230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.668 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.648+0000 7f54be2cc640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 0x7f54b8146230 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f54a80108d0 tx=0x7f54a8010d90 comp rx=0 tx=0).stop 2023-11-27T17:54:01.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.648+0000 7f54be2cc640 1 -- 172.21.15.31:0/339374730 shutdown_connections 2023-11-27T17:54:01.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.648+0000 7f54be2cc640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f54a4066820 0x7f54a4068ce0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.648+0000 7f54be2cc640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f54b813f3e0 0x7f54b81de6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.648+0000 7f54be2cc640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f54b814cd40 0x7f54b813eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.648+0000 7f54be2cc640 1 --2- 172.21.15.31:0/339374730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54a0005190 0x7f54b8146230 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.648+0000 7f54be2cc640 1 -- 172.21.15.31:0/339374730 >> 172.21.15.31:0/339374730 conn(0x7f54b806ab60 msgr2=0x7f54b80bb640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:01.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.648+0000 7f54be2cc640 1 -- 172.21.15.31:0/339374730 shutdown_connections 2023-11-27T17:54:01.669 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.648+0000 7f54be2cc640 1 -- 172.21.15.31:0/339374730 wait complete. 2023-11-27T17:54:01.670 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-27T17:54:01.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb36476c640 1 Processor -- start 2023-11-27T17:54:01.790 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb36476c640 1 -- start start 2023-11-27T17:54:01.791 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb36476c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb35c0a42b0 0x7fb35c0b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb36476c640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb35c06ef70 0x7fb35c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb36476c640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35c0b4360 con 0x7fb35c14c7b0 2023-11-27T17:54:01.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb36476c640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c06e7a0 con 0x7fb35c06ef70 2023-11-27T17:54:01.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb36476c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c0b5c10 con 0x7fb35c0a42b0 2023-11-27T17:54:01.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb362d09640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb35c06ef70 0x7fb35c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb361d07640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb35c14c7b0 0x7fb35c0b5500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48970/0 (socket says 172.21.15.31:48970) 2023-11-27T17:54:01.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb362d09640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb35c06ef70 0x7fb35c153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37016/0 (socket says 172.21.15.31:37016) 2023-11-27T17:54:01.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb361d07640 1 -- 172.21.15.31:0/3443327346 learned_addr learned my addr 172.21.15.31:0/3443327346 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:01.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb362508640 1 --2- 172.21.15.31:0/3443327346 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb35c0a42b0 0x7fb35c0b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb362d09640 1 -- 172.21.15.31:0/3443327346 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb35c0a42b0 msgr2=0x7fb35c0b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:01.792 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb362d09640 1 --2- 172.21.15.31:0/3443327346 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb35c0a42b0 0x7fb35c0b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb361506640 1 -- 172.21.15.31:0/3443327346 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873547763 0 0) 0x7fb35c0b4360 con 0x7fb35c14c7b0 2023-11-27T17:54:01.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb362d09640 1 -- 172.21.15.31:0/3443327346 >> v1:172.21.15.31:6789/0 conn(0x7fb35c14c7b0 legacy=0x7fb35c0b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb362d09640 1 -- 172.21.15.31:0/3443327346 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c0b4d30 con 0x7fb35c06ef70 2023-11-27T17:54:01.793 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.784+0000 7fb362508640 1 --2- 172.21.15.31:0/3443327346 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb35c0a42b0 0x7fb35c0b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:01.794 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.788+0000 7fb362d09640 1 --2- 172.21.15.31:0/3443327346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb35c06ef70 0x7fb35c153b40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb354009d90 tx=0x7fb35401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4393acce1a1ea976 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.788+0000 7fb361506640 1 -- 172.21.15.31:0/3443327346 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3540af600 con 0x7fb35c06ef70 2023-11-27T17:54:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.788+0000 7fb361506640 1 -- 172.21.15.31:0/3443327346 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3540ab050 con 0x7fb35c06ef70 2023-11-27T17:54:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.788+0000 7fb361506640 1 -- 172.21.15.31:0/3443327346 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3540af980 con 0x7fb35c06ef70 2023-11-27T17:54:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.788+0000 7fb36476c640 1 -- 172.21.15.31:0/3443327346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb35c06ef70 msgr2=0x7fb35c153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.788+0000 7fb36476c640 1 --2- 172.21.15.31:0/3443327346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb35c06ef70 0x7fb35c153b40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb354009d90 tx=0x7fb35401f130 comp rx=0 tx=0).stop 2023-11-27T17:54:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.788+0000 7fb36476c640 1 -- 172.21.15.31:0/3443327346 shutdown_connections 2023-11-27T17:54:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.788+0000 7fb36476c640 1 --2- 172.21.15.31:0/3443327346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb35c06ef70 0x7fb35c153b40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.788+0000 7fb36476c640 1 --2- 172.21.15.31:0/3443327346 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb35c0a42b0 0x7fb35c0b47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.788+0000 7fb36476c640 1 -- 172.21.15.31:0/3443327346 >> 172.21.15.31:0/3443327346 conn(0x7fb35c0bb7d0 msgr2=0x7fb35c0bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:01.795 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.788+0000 7fb36476c640 1 -- 172.21.15.31:0/3443327346 shutdown_connections 2023-11-27T17:54:01.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.788+0000 7fb36476c640 1 -- 172.21.15.31:0/3443327346 wait complete. 2023-11-27T17:54:01.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb36476c640 1 Processor -- start 2023-11-27T17:54:01.796 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb36476c640 1 -- start start 2023-11-27T17:54:01.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb36476c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c06ef70 0x7fb35c148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb36476c640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb35c0a42b0 0x7fb35c1476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb36476c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb35c14c7b0 0x7fb35c1e0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb36476c640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c14a450 con 0x7fb35c14c7b0 2023-11-27T17:54:01.798 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb36476c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c149c80 con 0x7fb35c06ef70 2023-11-27T17:54:01.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb36476c640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c148ca0 con 0x7fb35c0a42b0 2023-11-27T17:54:01.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb362d09640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb35c14c7b0 0x7fb35c1e0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb362d09640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb35c14c7b0 0x7fb35c1e0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37028/0 (socket says 172.21.15.31:37028) 2023-11-27T17:54:01.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb362d09640 1 -- 172.21.15.31:0/3227941945 learned_addr learned my addr 172.21.15.31:0/3227941945 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:01.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb361d07640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb35c0a42b0 0x7fb35c1476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb362508640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c06ef70 0x7fb35c148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb362d09640 1 -- 172.21.15.31:0/3227941945 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb35c0a42b0 msgr2=0x7fb35c1476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb362d09640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb35c0a42b0 0x7fb35c1476e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.799 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb362d09640 1 -- 172.21.15.31:0/3227941945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c06ef70 msgr2=0x7fb35c148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:01.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb362d09640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c06ef70 0x7fb35c148760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:01.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb362d09640 1 -- 172.21.15.31:0/3227941945 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354009a70 con 0x7fb35c14c7b0 2023-11-27T17:54:01.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb362d09640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb35c14c7b0 0x7fb35c1e0ce0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb3540b2040 tx=0x7fb35401bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:01.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb352ffd640 1 -- 172.21.15.31:0/3227941945 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3540ba480 con 0x7fb35c14c7b0 2023-11-27T17:54:01.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb352ffd640 1 -- 172.21.15.31:0/3227941945 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3540ba5e0 con 0x7fb35c14c7b0 2023-11-27T17:54:01.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb352ffd640 1 -- 172.21.15.31:0/3227941945 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3540ba990 con 0x7fb35c14c7b0 2023-11-27T17:54:01.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb36476c640 1 -- 172.21.15.31:0/3227941945 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35c149320 con 0x7fb35c14c7b0 2023-11-27T17:54:01.800 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb36476c640 1 -- 172.21.15.31:0/3227941945 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35c1495c0 con 0x7fb35c14c7b0 2023-11-27T17:54:01.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb36476c640 1 -- 172.21.15.31:0/3227941945 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35c149dc0 con 0x7fb35c14c7b0 2023-11-27T17:54:01.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.792+0000 7fb352ffd640 1 -- 172.21.15.31:0/3227941945 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fb3540b6040 con 0x7fb35c14c7b0 2023-11-27T17:54:01.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.796+0000 7fb352ffd640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb340066820 0x7fb340068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:01.801 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.796+0000 7fb352ffd640 1 -- 172.21.15.31:0/3227941945 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb354122920 con 0x7fb35c14c7b0 2023-11-27T17:54:01.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.796+0000 7fb362508640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb340066820 0x7fb340068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:01.802 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.796+0000 7fb362508640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb340066820 0x7fb340068ce0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb358006fd0 tx=0x7fb358008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:01.804 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:01.800+0000 7fb352ffd640 1 -- 172.21.15.31:0/3227941945 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fb35c149dc0 con 0x7fb35c14c7b0 2023-11-27T17:54:02.014 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.008+0000 7fb36476c640 1 -- 172.21.15.31:0/3227941945 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fb35c146c20 con 0x7fb35c14c7b0 2023-11-27T17:54:02.018 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.012+0000 7fb352ffd640 1 -- 172.21.15.31:0/3227941945 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb3540b4020 con 0x7fb35c14c7b0 2023-11-27T17:54:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.016+0000 7fb36476c640 1 -- 172.21.15.31:0/3227941945 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb340066820 msgr2=0x7fb340068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.016+0000 7fb36476c640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb340066820 0x7fb340068ce0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb358006fd0 tx=0x7fb358008040 comp rx=0 tx=0).stop 2023-11-27T17:54:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.016+0000 7fb36476c640 1 -- 172.21.15.31:0/3227941945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb35c14c7b0 msgr2=0x7fb35c1e0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.016+0000 7fb36476c640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb35c14c7b0 0x7fb35c1e0ce0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb3540b2040 tx=0x7fb35401bed0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.016+0000 7fb36476c640 1 -- 172.21.15.31:0/3227941945 shutdown_connections 2023-11-27T17:54:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.016+0000 7fb36476c640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fb340066820 0x7fb340068ce0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.016+0000 7fb36476c640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb35c14c7b0 0x7fb35c1e0ce0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.016+0000 7fb36476c640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fb35c0a42b0 0x7fb35c1476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.016+0000 7fb36476c640 1 --2- 172.21.15.31:0/3227941945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb35c06ef70 0x7fb35c148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.016+0000 7fb36476c640 1 -- 172.21.15.31:0/3227941945 >> 172.21.15.31:0/3227941945 conn(0x7fb35c0bb7d0 msgr2=0x7fb35c14cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:02.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.016+0000 7fb36476c640 1 -- 172.21.15.31:0/3227941945 shutdown_connections 2023-11-27T17:54:02.022 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.016+0000 7fb36476c640 1 -- 172.21.15.31:0/3227941945 wait complete. 2023-11-27T17:54:02.037 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-27T17:54:02.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f063cef8640 1 Processor -- start 2023-11-27T17:54:02.162 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f063cef8640 1 -- start start 2023-11-27T17:54:02.164 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f063cef8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f063806ab90 0x7f063806af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f063cef8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380c0670 0x7f063814b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f063cef8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063806b4b0 con 0x7f06380b6da0 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f063cef8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06380bfbd0 con 0x7f063806ab90 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f063cef8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06380b7ce0 con 0x7f06380c0670 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f0636d9d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f06380b6da0 0x7f063814eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48974/0 (socket says 172.21.15.31:48974) 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f0636d9d640 1 -- 172.21.15.31:0/539709148 learned_addr learned my addr 172.21.15.31:0/539709148 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f063659c640 1 --2- 172.21.15.31:0/539709148 >> v2:172.21.15.81:3300/0 conn(0x7f063806ab90 0x7f063806af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f0635d9b640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380c0670 0x7f063814b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003444452 0 0) 0x7f063806b4b0 con 0x7f06380b6da0 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.156+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0620003530 con 0x7f06380b6da0 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2077500728 0 0) 0x7f0620003530 con 0x7f06380b6da0 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380c0670 msgr2=0x7f063814b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:02.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380c0670 0x7f063814b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 >> v2:172.21.15.81:3300/0 conn(0x7f063806ab90 msgr2=0x7f063806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 --2- 172.21.15.31:0/539709148 >> v2:172.21.15.81:3300/0 conn(0x7f063806ab90 0x7f063806af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06380bfe70 con 0x7f06380b6da0 2023-11-27T17:54:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f0630001a00 con 0x7f06380b6da0 2023-11-27T17:54:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 >> v1:172.21.15.31:6789/0 conn(0x7f06380b6da0 legacy=0x7f063814eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06200039f0 0x7f0620003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06200047d0 0x7f0620004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380c0670 0x7f0620005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06380bfbd0 con 0x7f06200047d0 2023-11-27T17:54:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06380b7ce0 con 0x7f06200039f0 2023-11-27T17:54:02.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062000b990 con 0x7f06380c0670 2023-11-27T17:54:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f0635d9b640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06200047d0 0x7f0620004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f0636d9d640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380c0670 0x7f0620005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f0635d9b640 1 -- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380c0670 msgr2=0x7f0620005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063659c640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06200039f0 0x7f0620003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f0635d9b640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380c0670 0x7f0620005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f0635d9b640 1 -- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06200039f0 msgr2=0x7f0620003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f0635d9b640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06200039f0 0x7f0620003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f0635d9b640 1 -- 172.21.15.31:0/539709148 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620003530 con 0x7f06200047d0 2023-11-27T17:54:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f0636d9d640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380c0670 0x7f0620005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:02.167 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063659c640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06200039f0 0x7f0620003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:02.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f0635d9b640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06200047d0 0x7f0620004c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f062c009b10 tx=0x7f062c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb258e3830d80c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:02.168 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0a5560 con 0x7f06200047d0 2023-11-27T17:54:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c0a56c0 con 0x7f06200047d0 2023-11-27T17:54:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063559a640 1 -- 172.21.15.31:0/539709148 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0a5a70 con 0x7f06200047d0 2023-11-27T17:54:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063cef8640 1 -- 172.21.15.31:0/539709148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06200047d0 msgr2=0x7f0620004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063cef8640 1 --2- 172.21.15.31:0/539709148 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06200047d0 0x7f0620004c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f062c009b10 tx=0x7f062c01ca50 comp rx=0 tx=0).stop 2023-11-27T17:54:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f0636d9d640 1 -- 172.21.15.31:0/539709148 reap_dead start 2023-11-27T17:54:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063cef8640 1 -- 172.21.15.31:0/539709148 shutdown_connections 2023-11-27T17:54:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063cef8640 1 -- 172.21.15.31:0/539709148 >> 172.21.15.31:0/539709148 conn(0x7f06380a28f0 msgr2=0x7f06380a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063cef8640 1 -- 172.21.15.31:0/539709148 shutdown_connections 2023-11-27T17:54:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.160+0000 7f063cef8640 1 -- 172.21.15.31:0/539709148 wait complete. 2023-11-27T17:54:02.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063cef8640 1 Processor -- start 2023-11-27T17:54:02.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063cef8640 1 -- start start 2023-11-27T17:54:02.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063cef8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06200047d0 0x7f06380b9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063cef8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380a6940 0x7f063814af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063cef8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06380b91a0 0x7f06380b9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063cef8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063814b480 con 0x7f06380b91a0 2023-11-27T17:54:02.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063cef8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06380b9b60 con 0x7f06200047d0 2023-11-27T17:54:02.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063cef8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06380a5400 con 0x7f06380a6940 2023-11-27T17:54:02.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0636d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06380b91a0 0x7f06380b9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0636d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06380b91a0 0x7f06380b9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37042/0 (socket says 172.21.15.31:37042) 2023-11-27T17:54:02.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0636d9d640 1 -- 172.21.15.31:0/2432057324 learned_addr learned my addr 172.21.15.31:0/2432057324 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:02.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0635d9b640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380a6940 0x7f063814af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063659c640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06200047d0 0x7f06380b9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.172 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0636d9d640 1 -- 172.21.15.31:0/2432057324 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380a6940 msgr2=0x7f063814af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0636d9d640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380a6940 0x7f063814af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0636d9d640 1 -- 172.21.15.31:0/2432057324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06200047d0 msgr2=0x7f06380b9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0636d9d640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06200047d0 0x7f06380b9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0636d9d640 1 -- 172.21.15.31:0/2432057324 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06380a56e0 con 0x7f06380b91a0 2023-11-27T17:54:02.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0635d9b640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380a6940 0x7f063814af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:02.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063659c640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06200047d0 0x7f06380b9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:02.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0636d9d640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06380b91a0 0x7f06380b9620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f06380a6e90 tx=0x7f0630010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:02.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0626ffd640 1 -- 172.21.15.31:0/2432057324 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063000eac0 con 0x7f06380b91a0 2023-11-27T17:54:02.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0626ffd640 1 -- 172.21.15.31:0/2432057324 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063000ec40 con 0x7f06380b91a0 2023-11-27T17:54:02.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f0626ffd640 1 -- 172.21.15.31:0/2432057324 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630010e80 con 0x7f06380b91a0 2023-11-27T17:54:02.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063cef8640 1 -- 172.21.15.31:0/2432057324 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06380a59c0 con 0x7f06380b91a0 2023-11-27T17:54:02.173 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063cef8640 1 -- 172.21.15.31:0/2432057324 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06380babf0 con 0x7f06380b91a0 2023-11-27T17:54:02.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.164+0000 7f063cef8640 1 -- 172.21.15.31:0/2432057324 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063804e850 con 0x7f06380b91a0 2023-11-27T17:54:02.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.168+0000 7f0626ffd640 1 -- 172.21.15.31:0/2432057324 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f063001e3b0 con 0x7f06380b91a0 2023-11-27T17:54:02.174 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.168+0000 7f0626ffd640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f06180667f0 0x7f0618068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.168+0000 7f0626ffd640 1 -- 172.21.15.31:0/2432057324 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0630086990 con 0x7f06380b91a0 2023-11-27T17:54:02.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.168+0000 7f063659c640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f06180667f0 0x7f0618068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.175 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.168+0000 7f063659c640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f06180667f0 0x7f0618068cb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0628009b40 tx=0x7f0628008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:02.177 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.172+0000 7f0626ffd640 1 -- 172.21.15.31:0/2432057324 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f0630053e70 con 0x7f06380b91a0 2023-11-27T17:54:02.384 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.380+0000 7f063cef8640 1 -- 172.21.15.31:0/2432057324 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f06380bce20 con 0x7f06380b91a0 2023-11-27T17:54:02.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.384+0000 7f0626ffd640 1 -- 172.21.15.31:0/2432057324 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f063001a070 con 0x7f06380b91a0 2023-11-27T17:54:02.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.388+0000 7f063cef8640 1 -- 172.21.15.31:0/2432057324 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f06180667f0 msgr2=0x7f0618068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.388+0000 7f063cef8640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f06180667f0 0x7f0618068cb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0628009b40 tx=0x7f0628008040 comp rx=0 tx=0).stop 2023-11-27T17:54:02.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.388+0000 7f063cef8640 1 -- 172.21.15.31:0/2432057324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06380b91a0 msgr2=0x7f06380b9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.388+0000 7f063cef8640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06380b91a0 0x7f06380b9620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f06380a6e90 tx=0x7f0630010c30 comp rx=0 tx=0).stop 2023-11-27T17:54:02.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.388+0000 7f063cef8640 1 -- 172.21.15.31:0/2432057324 shutdown_connections 2023-11-27T17:54:02.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.388+0000 7f063cef8640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f06180667f0 0x7f0618068cb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.388+0000 7f063cef8640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f06380b91a0 0x7f06380b9620 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.388+0000 7f063cef8640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f06380a6940 0x7f063814af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.388+0000 7f063cef8640 1 --2- 172.21.15.31:0/2432057324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06200047d0 0x7f06380b9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.388+0000 7f063cef8640 1 -- 172.21.15.31:0/2432057324 >> 172.21.15.31:0/2432057324 conn(0x7f06380a28f0 msgr2=0x7f06380bb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:02.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.388+0000 7f063cef8640 1 -- 172.21.15.31:0/2432057324 shutdown_connections 2023-11-27T17:54:02.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.388+0000 7f063cef8640 1 -- 172.21.15.31:0/2432057324 wait complete. 2023-11-27T17:54:02.407 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-27T17:54:02.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d4ea28640 1 Processor -- start 2023-11-27T17:54:02.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d4ea28640 1 -- start start 2023-11-27T17:54:02.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d4ea28640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d48143560 0x7f7d480bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d4ea28640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7d48149c00 0x7f7d48153a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d4ea28640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d48071260 con 0x7f7d4806f1d0 2023-11-27T17:54:02.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d4ea28640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d48143940 con 0x7f7d48149c00 2023-11-27T17:54:02.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d4ea28640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4806f800 con 0x7f7d48143560 2023-11-27T17:54:02.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d477fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7d4806f1d0 0x7f7d481494f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48982/0 (socket says 172.21.15.31:48982) 2023-11-27T17:54:02.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d477fe640 1 -- 172.21.15.31:0/2306745568 learned_addr learned my addr 172.21.15.31:0/2306745568 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:02.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d47fff640 1 --2- 172.21.15.31:0/2306745568 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d48143560 0x7f7d480bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d4cfc5640 1 --2- 172.21.15.31:0/2306745568 >> v2:172.21.15.81:3300/0 conn(0x7f7d48149c00 0x7f7d48153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d46ffd640 1 -- 172.21.15.31:0/2306745568 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098926597 0 0) 0x7f7d48071260 con 0x7f7d4806f1d0 2023-11-27T17:54:02.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d46ffd640 1 -- 172.21.15.31:0/2306745568 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d34003530 con 0x7f7d4806f1d0 2023-11-27T17:54:02.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d47fff640 1 -- 172.21.15.31:0/2306745568 >> v2:172.21.15.81:3300/0 conn(0x7f7d48149c00 msgr2=0x7f7d48153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:02.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d47fff640 1 --2- 172.21.15.31:0/2306745568 >> v2:172.21.15.81:3300/0 conn(0x7f7d48149c00 0x7f7d48153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d47fff640 1 -- 172.21.15.31:0/2306745568 >> v1:172.21.15.31:6789/0 conn(0x7f7d4806f1d0 legacy=0x7f7d481494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.528 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.520+0000 7f7d47fff640 1 -- 172.21.15.31:0/2306745568 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4806fae0 con 0x7f7d48143560 2023-11-27T17:54:02.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.524+0000 7f7d47fff640 1 --2- 172.21.15.31:0/2306745568 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d48143560 0x7f7d480bd240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7d380097c0 tx=0x7f7d3801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=217bfa7c1f04817d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:02.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.524+0000 7f7d46ffd640 1 -- 172.21.15.31:0/2306745568 <== mon.2 v2:172.21.15.81:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380ac410 con 0x7f7d48143560 2023-11-27T17:54:02.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.524+0000 7f7d46ffd640 1 -- 172.21.15.31:0/2306745568 <== mon.2 v2:172.21.15.81:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d380ac570 con 0x7f7d48143560 2023-11-27T17:54:02.529 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.524+0000 7f7d46ffd640 1 -- 172.21.15.31:0/2306745568 <== mon.2 v2:172.21.15.81:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d380ac8e0 con 0x7f7d48143560 2023-11-27T17:54:02.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.524+0000 7f7d4ea28640 1 -- 172.21.15.31:0/2306745568 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d48143560 msgr2=0x7f7d480bd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.524+0000 7f7d4ea28640 1 --2- 172.21.15.31:0/2306745568 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d48143560 0x7f7d480bd240 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7d380097c0 tx=0x7f7d3801c450 comp rx=0 tx=0).stop 2023-11-27T17:54:02.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.524+0000 7f7d4ea28640 1 -- 172.21.15.31:0/2306745568 shutdown_connections 2023-11-27T17:54:02.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.524+0000 7f7d4ea28640 1 --2- 172.21.15.31:0/2306745568 >> v2:172.21.15.81:3300/0 conn(0x7f7d48149c00 0x7f7d48153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.524+0000 7f7d4ea28640 1 --2- 172.21.15.31:0/2306745568 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d48143560 0x7f7d480bd240 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.524+0000 7f7d4ea28640 1 -- 172.21.15.31:0/2306745568 >> 172.21.15.31:0/2306745568 conn(0x7f7d4806ab60 msgr2=0x7f7d480bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:02.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.524+0000 7f7d4ea28640 1 -- 172.21.15.31:0/2306745568 shutdown_connections 2023-11-27T17:54:02.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.524+0000 7f7d4ea28640 1 -- 172.21.15.31:0/2306745568 wait complete. 2023-11-27T17:54:02.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4ea28640 1 Processor -- start 2023-11-27T17:54:02.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4ea28640 1 -- start start 2023-11-27T17:54:02.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4ea28640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d4806f1d0 0x7f7d481360c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4ea28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d48143560 0x7f7d481e47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.533 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4ea28640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d48149c00 0x7f7d48133890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4ea28640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d48136600 con 0x7f7d48149c00 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4ea28640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d48147540 con 0x7f7d48143560 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4ea28640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d48139580 con 0x7f7d4806f1d0 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4cfc5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d48149c00 0x7f7d48133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4cfc5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d48149c00 0x7f7d48133890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37058/0 (socket says 172.21.15.31:37058) 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4cfc5640 1 -- 172.21.15.31:0/1758673971 learned_addr learned my addr 172.21.15.31:0/1758673971 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d47fff640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d4806f1d0 0x7f7d481360c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d477fe640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d48143560 0x7f7d481e47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4cfc5640 1 -- 172.21.15.31:0/1758673971 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d4806f1d0 msgr2=0x7f7d481360c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4cfc5640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d4806f1d0 0x7f7d481360c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4cfc5640 1 -- 172.21.15.31:0/1758673971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d48143560 msgr2=0x7f7d481e47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4cfc5640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d48143560 0x7f7d481e47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4cfc5640 1 -- 172.21.15.31:0/1758673971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38009420 con 0x7f7d48149c00 2023-11-27T17:54:02.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d477fe640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d48143560 0x7f7d481e47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:02.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4cfc5640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d48149c00 0x7f7d48133890 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000e7f0 tx=0x7f7d4000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:02.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d44ff9640 1 -- 172.21.15.31:0/1758673971 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d40009530 con 0x7f7d48149c00 2023-11-27T17:54:02.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d44ff9640 1 -- 172.21.15.31:0/1758673971 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4000eea0 con 0x7f7d48149c00 2023-11-27T17:54:02.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4ea28640 1 -- 172.21.15.31:0/1758673971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d48139860 con 0x7f7d48149c00 2023-11-27T17:54:02.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d44ff9640 1 -- 172.21.15.31:0/1758673971 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000cb60 con 0x7f7d48149c00 2023-11-27T17:54:02.535 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4ea28640 1 -- 172.21.15.31:0/1758673971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d481e4d00 con 0x7f7d48149c00 2023-11-27T17:54:02.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d4ea28640 1 -- 172.21.15.31:0/1758673971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d48147f80 con 0x7f7d48149c00 2023-11-27T17:54:02.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d44ff9640 1 -- 172.21.15.31:0/1758673971 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f7d4000ccc0 con 0x7f7d48149c00 2023-11-27T17:54:02.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d44ff9640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7d280667f0 0x7f7d28068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d44ff9640 1 -- 172.21.15.31:0/1758673971 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7d40084040 con 0x7f7d48149c00 2023-11-27T17:54:02.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.528+0000 7f7d47fff640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7d280667f0 0x7f7d28068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.536 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.532+0000 7f7d47fff640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7d280667f0 0x7f7d28068cb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d380ae000 tx=0x7f7d380a6040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:02.543 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.536+0000 7f7d44ff9640 1 -- 172.21.15.31:0/1758673971 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f7d400514a0 con 0x7f7d48149c00 2023-11-27T17:54:02.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.744+0000 7f7d4ea28640 1 -- 172.21.15.31:0/1758673971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f7d480725f0 con 0x7f7d48149c00 2023-11-27T17:54:02.755 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.748+0000 7f7d44ff9640 1 -- 172.21.15.31:0/1758673971 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7d40054ac0 con 0x7f7d48149c00 2023-11-27T17:54:02.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.752+0000 7f7d4ea28640 1 -- 172.21.15.31:0/1758673971 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7d280667f0 msgr2=0x7f7d28068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.752+0000 7f7d4ea28640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7d280667f0 0x7f7d28068cb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d380ae000 tx=0x7f7d380a6040 comp rx=0 tx=0).stop 2023-11-27T17:54:02.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.752+0000 7f7d4ea28640 1 -- 172.21.15.31:0/1758673971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d48149c00 msgr2=0x7f7d48133890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.752+0000 7f7d4ea28640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d48149c00 0x7f7d48133890 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000e7f0 tx=0x7f7d4000ecb0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.752+0000 7f7d4ea28640 1 -- 172.21.15.31:0/1758673971 shutdown_connections 2023-11-27T17:54:02.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.752+0000 7f7d4ea28640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7d280667f0 0x7f7d28068cb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.758 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.752+0000 7f7d4ea28640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7d48149c00 0x7f7d48133890 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.752+0000 7f7d4ea28640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d48143560 0x7f7d481e47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.752+0000 7f7d4ea28640 1 --2- 172.21.15.31:0/1758673971 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7d4806f1d0 0x7f7d481360c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.752+0000 7f7d4ea28640 1 -- 172.21.15.31:0/1758673971 >> 172.21.15.31:0/1758673971 conn(0x7f7d4806ab60 msgr2=0x7f7d4813f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:02.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.752+0000 7f7d4ea28640 1 -- 172.21.15.31:0/1758673971 shutdown_connections 2023-11-27T17:54:02.759 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.752+0000 7f7d4ea28640 1 -- 172.21.15.31:0/1758673971 wait complete. 2023-11-27T17:54:02.774 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-27T17:54:02.885 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.880+0000 7fed28211640 1 Processor -- start 2023-11-27T17:54:02.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.880+0000 7fed28211640 1 -- start start 2023-11-27T17:54:02.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.880+0000 7fed28211640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fed200b5440 0x7fed20141300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.880+0000 7fed28211640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed201486d0 con 0x7fed200b6190 2023-11-27T17:54:02.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.880+0000 7fed28211640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed200b48a0 con 0x7fed200b3900 2023-11-27T17:54:02.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.880+0000 7fed28211640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed200b6920 con 0x7fed200b5440 2023-11-27T17:54:02.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.880+0000 7fed267ae640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fed200b5440 0x7fed20141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.880+0000 7fed25fad640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fed200b6190 0x7fed20147c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48984/0 (socket says 172.21.15.31:48984) 2023-11-27T17:54:02.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.880+0000 7fed25fad640 1 -- 172.21.15.31:0/1924260822 learned_addr learned my addr 172.21.15.31:0/1924260822 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:02.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.880+0000 7fed267ae640 1 -- 172.21.15.31:0/1924260822 >> v1:172.21.15.81:6789/0 conn(0x7fed200b3900 legacy=0x7fed200b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:02.887 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.880+0000 7fed267ae640 1 -- 172.21.15.31:0/1924260822 >> v1:172.21.15.31:6789/0 conn(0x7fed200b6190 legacy=0x7fed20147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.880+0000 7fed267ae640 1 -- 172.21.15.31:0/1924260822 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed201483f0 con 0x7fed200b5440 2023-11-27T17:54:02.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed267ae640 1 --2- 172.21.15.31:0/1924260822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed200b5440 0x7fed20141300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fed100097c0 tx=0x7fed1001d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd068bd1fd73afc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:02.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed24fab640 1 -- 172.21.15.31:0/1924260822 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100ab430 con 0x7fed200b5440 2023-11-27T17:54:02.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed24fab640 1 -- 172.21.15.31:0/1924260822 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed100ab590 con 0x7fed200b5440 2023-11-27T17:54:02.889 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed24fab640 1 -- 172.21.15.31:0/1924260822 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100ab920 con 0x7fed200b5440 2023-11-27T17:54:02.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed28211640 1 -- 172.21.15.31:0/1924260822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed200b5440 msgr2=0x7fed20141300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed28211640 1 --2- 172.21.15.31:0/1924260822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed200b5440 0x7fed20141300 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fed100097c0 tx=0x7fed1001d520 comp rx=0 tx=0).stop 2023-11-27T17:54:02.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed28211640 1 -- 172.21.15.31:0/1924260822 shutdown_connections 2023-11-27T17:54:02.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed28211640 1 --2- 172.21.15.31:0/1924260822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed200b5440 0x7fed20141300 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed28211640 1 -- 172.21.15.31:0/1924260822 >> 172.21.15.31:0/1924260822 conn(0x7fed2006ab60 msgr2=0x7fed200bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:02.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed28211640 1 -- 172.21.15.31:0/1924260822 shutdown_connections 2023-11-27T17:54:02.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed28211640 1 -- 172.21.15.31:0/1924260822 wait complete. 2023-11-27T17:54:02.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed28211640 1 Processor -- start 2023-11-27T17:54:02.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.884+0000 7fed28211640 1 -- start start 2023-11-27T17:54:02.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed28211640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed200b3900 0x7fed201e7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed28211640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fed200b5440 0x7fed20141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed28211640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed200b6190 0x7fed2014d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed28211640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed20143020 con 0x7fed200b6190 2023-11-27T17:54:02.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed28211640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2014d640 con 0x7fed200b3900 2023-11-27T17:54:02.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed28211640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed201e7910 con 0x7fed200b5440 2023-11-27T17:54:02.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed267ae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed200b6190 0x7fed2014d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed267ae640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed200b6190 0x7fed2014d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37076/0 (socket says 172.21.15.31:37076) 2023-11-27T17:54:02.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed267ae640 1 -- 172.21.15.31:0/1897041610 learned_addr learned my addr 172.21.15.31:0/1897041610 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:02.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed267ae640 1 -- 172.21.15.31:0/1897041610 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fed200b5440 msgr2=0x7fed20141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.893 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed257ac640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fed200b5440 0x7fed20141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed267ae640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fed200b5440 0x7fed20141f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed267ae640 1 -- 172.21.15.31:0/1897041610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed200b3900 msgr2=0x7fed201e7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:02.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed25fad640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed200b3900 0x7fed201e7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed267ae640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed200b3900 0x7fed201e7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:02.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed267ae640 1 -- 172.21.15.31:0/1897041610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009420 con 0x7fed200b6190 2023-11-27T17:54:02.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed267ae640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed200b6190 0x7fed2014d100 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fed1001a130 tx=0x7fed1001a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:02.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed1e7fc640 1 -- 172.21.15.31:0/1897041610 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100b4800 con 0x7fed200b6190 2023-11-27T17:54:02.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed1e7fc640 1 -- 172.21.15.31:0/1897041610 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed100b4960 con 0x7fed200b6190 2023-11-27T17:54:02.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed28211640 1 -- 172.21.15.31:0/1897041610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed201e72c0 con 0x7fed200b6190 2023-11-27T17:54:02.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed1e7fc640 1 -- 172.21.15.31:0/1897041610 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100b4cd0 con 0x7fed200b6190 2023-11-27T17:54:02.894 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed28211640 1 -- 172.21.15.31:0/1897041610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed201529f0 con 0x7fed200b6190 2023-11-27T17:54:02.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed28211640 1 -- 172.21.15.31:0/1897041610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2004e850 con 0x7fed200b6190 2023-11-27T17:54:02.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed1e7fc640 1 -- 172.21.15.31:0/1897041610 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fed100c2460 con 0x7fed200b6190 2023-11-27T17:54:02.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed1e7fc640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fed0c066840 0x7fed0c068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:02.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed1e7fc640 1 -- 172.21.15.31:0/1897041610 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fed1011e5d0 con 0x7fed200b6190 2023-11-27T17:54:02.895 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed25fad640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fed0c066840 0x7fed0c068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:02.896 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.888+0000 7fed25fad640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fed0c066840 0x7fed0c068d00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fed18005c10 tx=0x7fed18009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:02.899 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:02.892+0000 7fed1e7fc640 1 -- 172.21.15.31:0/1897041610 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fed100ebb20 con 0x7fed200b6190 2023-11-27T17:54:03.111 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.104+0000 7fed28211640 1 -- 172.21.15.31:0/1897041610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fed201e7a50 con 0x7fed200b6190 2023-11-27T17:54:03.116 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.112+0000 7fed1e7fc640 1 -- 172.21.15.31:0/1897041610 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fed10006e20 con 0x7fed200b6190 2023-11-27T17:54:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.112+0000 7fed28211640 1 -- 172.21.15.31:0/1897041610 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fed0c066840 msgr2=0x7fed0c068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.112+0000 7fed28211640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fed0c066840 0x7fed0c068d00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fed18005c10 tx=0x7fed18009040 comp rx=0 tx=0).stop 2023-11-27T17:54:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.112+0000 7fed28211640 1 -- 172.21.15.31:0/1897041610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed200b6190 msgr2=0x7fed2014d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.112+0000 7fed28211640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed200b6190 0x7fed2014d100 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fed1001a130 tx=0x7fed1001a2c0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.116+0000 7fed28211640 1 -- 172.21.15.31:0/1897041610 shutdown_connections 2023-11-27T17:54:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.116+0000 7fed28211640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fed0c066840 0x7fed0c068d00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.116+0000 7fed28211640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fed200b6190 0x7fed2014d100 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.116+0000 7fed28211640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fed200b5440 0x7fed20141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.120 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.116+0000 7fed28211640 1 --2- 172.21.15.31:0/1897041610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed200b3900 0x7fed201e7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.116+0000 7fed28211640 1 -- 172.21.15.31:0/1897041610 >> 172.21.15.31:0/1897041610 conn(0x7fed2006ab60 msgr2=0x7fed20147a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:03.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.116+0000 7fed28211640 1 -- 172.21.15.31:0/1897041610 shutdown_connections 2023-11-27T17:54:03.121 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.116+0000 7fed28211640 1 -- 172.21.15.31:0/1897041610 wait complete. 2023-11-27T17:54:03.136 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-27T17:54:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.256+0000 7f57bdb58640 1 Processor -- start 2023-11-27T17:54:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.256+0000 7f57bdb58640 1 -- start start 2023-11-27T17:54:03.262 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.256+0000 7f57bdb58640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f57b806ab90 0x7f57b806af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.256+0000 7f57bdb58640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57b80c0670 0x7f57b814b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.256+0000 7f57bdb58640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b806b4b0 con 0x7f57b80b6da0 2023-11-27T17:54:03.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.256+0000 7f57bdb58640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b80bfbd0 con 0x7f57b806ab90 2023-11-27T17:54:03.263 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.256+0000 7f57bdb58640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80b7ce0 con 0x7f57b80c0670 2023-11-27T17:54:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.256+0000 7f57affff640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57b80c0670 0x7f57b814b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.256+0000 7f57b7fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f57b80b6da0 0x7f57b814eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.31:35210/0 (socket says 172.21.15.31:35210) 2023-11-27T17:54:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.256+0000 7f57b7fff640 1 -- 172.21.15.31:0/4026262210 learned_addr learned my addr 172.21.15.31:0/4026262210 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.256+0000 7f57b77fe640 1 --2- 172.21.15.31:0/4026262210 >> v2:172.21.15.81:3300/0 conn(0x7f57b806ab90 0x7f57b806af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57b6ffd640 1 -- 172.21.15.31:0/4026262210 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89477003 0 0) 0x7f57b806b4b0 con 0x7f57b80b6da0 2023-11-27T17:54:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57b6ffd640 1 -- 172.21.15.31:0/4026262210 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a4003530 con 0x7f57b80b6da0 2023-11-27T17:54:03.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57b77fe640 1 -- 172.21.15.31:0/4026262210 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57b80c0670 msgr2=0x7f57b814b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57b77fe640 1 --2- 172.21.15.31:0/4026262210 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57b80c0670 0x7f57b814b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57b77fe640 1 -- 172.21.15.31:0/4026262210 >> v1:172.21.15.81:6789/0 conn(0x7f57b80b6da0 legacy=0x7f57b814eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57b77fe640 1 -- 172.21.15.31:0/4026262210 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b80bfe70 con 0x7f57b806ab90 2023-11-27T17:54:03.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57affff640 1 --2- 172.21.15.31:0/4026262210 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57b80c0670 0x7f57b814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:54:03.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57b77fe640 1 --2- 172.21.15.31:0/4026262210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b806ab90 0x7f57b806af70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f57a80097c0 tx=0x7f57a801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1106ab6555a2cef5 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:03.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57b6ffd640 1 -- 172.21.15.31:0/4026262210 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80ab600 con 0x7f57b806ab90 2023-11-27T17:54:03.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57b6ffd640 1 -- 172.21.15.31:0/4026262210 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a80a7050 con 0x7f57b806ab90 2023-11-27T17:54:03.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57b6ffd640 1 -- 172.21.15.31:0/4026262210 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80ab960 con 0x7f57b806ab90 2023-11-27T17:54:03.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57bdb58640 1 -- 172.21.15.31:0/4026262210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b806ab90 msgr2=0x7f57b806af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57bdb58640 1 --2- 172.21.15.31:0/4026262210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b806ab90 0x7f57b806af70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f57a80097c0 tx=0x7f57a801c480 comp rx=0 tx=0).stop 2023-11-27T17:54:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57bdb58640 1 -- 172.21.15.31:0/4026262210 shutdown_connections 2023-11-27T17:54:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57bdb58640 1 --2- 172.21.15.31:0/4026262210 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57b80c0670 0x7f57b814b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.260+0000 7f57bdb58640 1 --2- 172.21.15.31:0/4026262210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b806ab90 0x7f57b806af70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 -- 172.21.15.31:0/4026262210 >> 172.21.15.31:0/4026262210 conn(0x7f57b80a28f0 msgr2=0x7f57b80a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 -- 172.21.15.31:0/4026262210 shutdown_connections 2023-11-27T17:54:03.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 -- 172.21.15.31:0/4026262210 wait complete. 2023-11-27T17:54:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 Processor -- start 2023-11-27T17:54:03.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 -- start start 2023-11-27T17:54:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b806ab90 0x7f57b813cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57b80b6da0 0x7f57b80a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b80c0670 0x7f57b80a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80a4090 con 0x7f57b80c0670 2023-11-27T17:54:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80a53f0 con 0x7f57b806ab90 2023-11-27T17:54:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b813e970 con 0x7f57b80b6da0 2023-11-27T17:54:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b7fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b80c0670 0x7f57b80a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b7fff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b80c0670 0x7f57b80a6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37078/0 (socket says 172.21.15.31:37078) 2023-11-27T17:54:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b7fff640 1 -- 172.21.15.31:0/2350757372 learned_addr learned my addr 172.21.15.31:0/2350757372 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:03.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b77fe640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b806ab90 0x7f57b813cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57affff640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57b80b6da0 0x7f57b80a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b7fff640 1 -- 172.21.15.31:0/2350757372 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57b80b6da0 msgr2=0x7f57b80a5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b7fff640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57b80b6da0 0x7f57b80a5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b7fff640 1 -- 172.21.15.31:0/2350757372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b806ab90 msgr2=0x7f57b813cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b7fff640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b806ab90 0x7f57b813cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b7fff640 1 -- 172.21.15.31:0/2350757372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a0009420 con 0x7f57b80c0670 2023-11-27T17:54:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57affff640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57b80b6da0 0x7f57b80a5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:54:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b7fff640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b80c0670 0x7f57b80a6080 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f57b000cb40 tx=0x7f57b000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:03.272 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b4ff9640 1 -- 172.21.15.31:0/2350757372 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b000aca0 con 0x7f57b80c0670 2023-11-27T17:54:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b4ff9640 1 -- 172.21.15.31:0/2350757372 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b000ae00 con 0x7f57b80c0670 2023-11-27T17:54:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 -- 172.21.15.31:0/2350757372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a8009420 con 0x7f57b80c0670 2023-11-27T17:54:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57b4ff9640 1 -- 172.21.15.31:0/2350757372 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0012620 con 0x7f57b80c0670 2023-11-27T17:54:03.273 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.264+0000 7f57bdb58640 1 -- 172.21.15.31:0/2350757372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b813e690 con 0x7f57b80c0670 2023-11-27T17:54:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.268+0000 7f57bdb58640 1 -- 172.21.15.31:0/2350757372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b804e850 con 0x7f57b80c0670 2023-11-27T17:54:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.268+0000 7f57b4ff9640 1 -- 172.21.15.31:0/2350757372 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f57b0007070 con 0x7f57b80c0670 2023-11-27T17:54:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.268+0000 7f57b4ff9640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57980667f0 0x7f5798068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.268+0000 7f57b4ff9640 1 -- 172.21.15.31:0/2350757372 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f57b0084030 con 0x7f57b80c0670 2023-11-27T17:54:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.268+0000 7f57b77fe640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57980667f0 0x7f5798068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.268+0000 7f57b77fe640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57980667f0 0x7f5798068cb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f57a80ad000 tx=0x7f57a80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:03.277 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.272+0000 7f57b4ff9640 1 -- 172.21.15.31:0/2350757372 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f57b00513f0 con 0x7f57b80c0670 2023-11-27T17:54:03.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.480+0000 7f57bdb58640 1 -- 172.21.15.31:0/2350757372 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f57b80bce20 con 0x7f57b80c0670 2023-11-27T17:54:03.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57b4ff9640 1 -- 172.21.15.31:0/2350757372 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f57b0054a10 con 0x7f57b80c0670 2023-11-27T17:54:03.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57bdb58640 1 -- 172.21.15.31:0/2350757372 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57980667f0 msgr2=0x7f5798068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57bdb58640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57980667f0 0x7f5798068cb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f57a80ad000 tx=0x7f57a80a6000 comp rx=0 tx=0).stop 2023-11-27T17:54:03.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57bdb58640 1 -- 172.21.15.31:0/2350757372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b80c0670 msgr2=0x7f57b80a6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57bdb58640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b80c0670 0x7f57b80a6080 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f57b000cb40 tx=0x7f57b000a060 comp rx=0 tx=0).stop 2023-11-27T17:54:03.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57bdb58640 1 -- 172.21.15.31:0/2350757372 shutdown_connections 2023-11-27T17:54:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57bdb58640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f57980667f0 0x7f5798068cb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57bdb58640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f57b80c0670 0x7f57b80a6080 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57bdb58640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f57b80b6da0 0x7f57b80a5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57bdb58640 1 --2- 172.21.15.31:0/2350757372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f57b806ab90 0x7f57b813cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57bdb58640 1 -- 172.21.15.31:0/2350757372 >> 172.21.15.31:0/2350757372 conn(0x7f57b80a28f0 msgr2=0x7f57b80bb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57bdb58640 1 -- 172.21.15.31:0/2350757372 shutdown_connections 2023-11-27T17:54:03.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.484+0000 7f57bdb58640 1 -- 172.21.15.31:0/2350757372 wait complete. 2023-11-27T17:54:03.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-27T17:54:03.625 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b8c8a640 1 Processor -- start 2023-11-27T17:54:03.626 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b8c8a640 1 -- start start 2023-11-27T17:54:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b8c8a640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f42b406ab90 0x7f42b406af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.627 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b8c8a640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b406b4b0 con 0x7f42b40b6da0 2023-11-27T17:54:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b8c8a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b40bfbd0 con 0x7f42b40c0670 2023-11-27T17:54:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b8c8a640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b40b7ce0 con 0x7f42b406ab90 2023-11-27T17:54:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b2d9d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f42b40b6da0 0x7f42b4155e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48994/0 (socket says 172.21.15.31:48994) 2023-11-27T17:54:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b2d9d640 1 -- 172.21.15.31:0/226494275 learned_addr learned my addr 172.21.15.31:0/226494275 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b259c640 1 --2- 172.21.15.31:0/226494275 >> v2:172.21.15.31:3300/0 conn(0x7f42b406ab90 0x7f42b406af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b159a640 1 -- 172.21.15.31:0/226494275 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581282217 0 0) 0x7f42b406b4b0 con 0x7f42b40b6da0 2023-11-27T17:54:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b159a640 1 -- 172.21.15.31:0/226494275 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f429c003530 con 0x7f42b40b6da0 2023-11-27T17:54:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b259c640 1 -- 172.21.15.31:0/226494275 >> v1:172.21.15.81:6789/0 conn(0x7f42b40c0670 legacy=0x7f42b414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b259c640 1 -- 172.21.15.31:0/226494275 >> v1:172.21.15.31:6789/0 conn(0x7f42b40b6da0 legacy=0x7f42b4155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.628 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.620+0000 7f42b259c640 1 -- 172.21.15.31:0/226494275 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40bfe70 con 0x7f42b406ab90 2023-11-27T17:54:03.629 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b259c640 1 --2- 172.21.15.31:0/226494275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b406ab90 0x7f42b406af70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f42a40097c0 tx=0x7f42a401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c076763c40d21d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b159a640 1 -- 172.21.15.31:0/226494275 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a40ab600 con 0x7f42b406ab90 2023-11-27T17:54:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b159a640 1 -- 172.21.15.31:0/226494275 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a40a7050 con 0x7f42b406ab90 2023-11-27T17:54:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b159a640 1 -- 172.21.15.31:0/226494275 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a40ab980 con 0x7f42b406ab90 2023-11-27T17:54:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 -- 172.21.15.31:0/226494275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b406ab90 msgr2=0x7f42b406af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 --2- 172.21.15.31:0/226494275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b406ab90 0x7f42b406af70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f42a40097c0 tx=0x7f42a401c480 comp rx=0 tx=0).stop 2023-11-27T17:54:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 -- 172.21.15.31:0/226494275 shutdown_connections 2023-11-27T17:54:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 --2- 172.21.15.31:0/226494275 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b406ab90 0x7f42b406af70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 -- 172.21.15.31:0/226494275 >> 172.21.15.31:0/226494275 conn(0x7f42b40a28f0 msgr2=0x7f42b40a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 -- 172.21.15.31:0/226494275 shutdown_connections 2023-11-27T17:54:03.630 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 -- 172.21.15.31:0/226494275 wait complete. 2023-11-27T17:54:03.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 Processor -- start 2023-11-27T17:54:03.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 -- start start 2023-11-27T17:54:03.632 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42b406ab90 0x7f42b41e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40b6da0 0x7f42b40b8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40c0670 0x7f42b40ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40a6e20 con 0x7f42b40b6da0 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40a4a10 con 0x7f42b40c0670 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b8c8a640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40a4c80 con 0x7f42b406ab90 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b1d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40b6da0 0x7f42b40b8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b1d9b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40b6da0 0x7f42b40b8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37104/0 (socket says 172.21.15.31:37104) 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.624+0000 7f42b1d9b640 1 -- 172.21.15.31:0/2320683014 learned_addr learned my addr 172.21.15.31:0/2320683014 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b259c640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42b406ab90 0x7f42b41e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b1d9b640 1 -- 172.21.15.31:0/2320683014 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42b406ab90 msgr2=0x7f42b41e7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b1d9b640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42b406ab90 0x7f42b41e7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b1d9b640 1 -- 172.21.15.31:0/2320683014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40c0670 msgr2=0x7f42b40ba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.633 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b2d9d640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40c0670 0x7f42b40ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b1d9b640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40c0670 0x7f42b40ba7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b1d9b640 1 -- 172.21.15.31:0/2320683014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a4009420 con 0x7f42b40b6da0 2023-11-27T17:54:03.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b1d9b640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40b6da0 0x7f42b40b8d40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f42a800c3f0 tx=0x7f42a800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:03.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42a2ffd640 1 -- 172.21.15.31:0/2320683014 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a80052d0 con 0x7f42b40b6da0 2023-11-27T17:54:03.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42a2ffd640 1 -- 172.21.15.31:0/2320683014 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a8005430 con 0x7f42b40b6da0 2023-11-27T17:54:03.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b8c8a640 1 -- 172.21.15.31:0/2320683014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b41e7400 con 0x7f42b40b6da0 2023-11-27T17:54:03.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42a2ffd640 1 -- 172.21.15.31:0/2320683014 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a8003840 con 0x7f42b40b6da0 2023-11-27T17:54:03.634 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b8c8a640 1 -- 172.21.15.31:0/2320683014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b41e79c0 con 0x7f42b40b6da0 2023-11-27T17:54:03.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b8c8a640 1 -- 172.21.15.31:0/2320683014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b41e7be0 con 0x7f42b40b6da0 2023-11-27T17:54:03.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42a2ffd640 1 -- 172.21.15.31:0/2320683014 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f42a80039a0 con 0x7f42b40b6da0 2023-11-27T17:54:03.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42a2ffd640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f42940667f0 0x7f4294068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.635 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42a2ffd640 1 -- 172.21.15.31:0/2320683014 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f42a8083900 con 0x7f42b40b6da0 2023-11-27T17:54:03.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b259c640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f42940667f0 0x7f4294068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.636 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.628+0000 7f42b259c640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f42940667f0 0x7f4294068cb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42a40ad000 tx=0x7f42a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:03.637 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.632+0000 7f42a2ffd640 1 -- 172.21.15.31:0/2320683014 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f42a8050da0 con 0x7f42b40b6da0 2023-11-27T17:54:03.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.836+0000 7f42b8c8a640 1 -- 172.21.15.31:0/2320683014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f42b40a2120 con 0x7f42b40b6da0 2023-11-27T17:54:03.846 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.840+0000 7f42a2ffd640 1 -- 172.21.15.31:0/2320683014 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f42a8017020 con 0x7f42b40b6da0 2023-11-27T17:54:03.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.844+0000 7f42b8c8a640 1 -- 172.21.15.31:0/2320683014 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f42940667f0 msgr2=0x7f4294068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.844+0000 7f42b8c8a640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f42940667f0 0x7f4294068cb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42a40ad000 tx=0x7f42a4008040 comp rx=0 tx=0).stop 2023-11-27T17:54:03.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.844+0000 7f42b8c8a640 1 -- 172.21.15.31:0/2320683014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40b6da0 msgr2=0x7f42b40b8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.844+0000 7f42b8c8a640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40b6da0 0x7f42b40b8d40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f42a800c3f0 tx=0x7f42a800c8b0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.844+0000 7f42b8c8a640 1 -- 172.21.15.31:0/2320683014 shutdown_connections 2023-11-27T17:54:03.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.844+0000 7f42b8c8a640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f42940667f0 0x7f4294068cb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.844+0000 7f42b8c8a640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42b40c0670 0x7f42b40ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.844+0000 7f42b8c8a640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42b40b6da0 0x7f42b40b8d40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.849 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.844+0000 7f42b8c8a640 1 --2- 172.21.15.31:0/2320683014 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f42b406ab90 0x7f42b41e7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.844+0000 7f42b8c8a640 1 -- 172.21.15.31:0/2320683014 >> 172.21.15.31:0/2320683014 conn(0x7f42b40a28f0 msgr2=0x7f42b414baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:03.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.844+0000 7f42b8c8a640 1 -- 172.21.15.31:0/2320683014 shutdown_connections 2023-11-27T17:54:03.850 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.844+0000 7f42b8c8a640 1 -- 172.21.15.31:0/2320683014 wait complete. 2023-11-27T17:54:03.864 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:54:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f6057f43640 1 Processor -- start 2023-11-27T17:54:03.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f6057f43640 1 -- start start 2023-11-27T17:54:03.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f6057f43640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f60500b78f0 0x7f6050156d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f6057f43640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6050145c70 con 0x7f60500b4400 2023-11-27T17:54:03.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f6057f43640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605014b8f0 con 0x7f60500b70e0 2023-11-27T17:54:03.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f6057f43640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605014c490 con 0x7f60500b78f0 2023-11-27T17:54:03.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f60554de640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f60500b4400 0x7f60500b9450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:48998/0 (socket says 172.21.15.31:48998) 2023-11-27T17:54:03.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f60554de640 1 -- 172.21.15.31:0/3739513338 learned_addr learned my addr 172.21.15.31:0/3739513338 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:03.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f60564e0640 1 --2- 172.21.15.31:0/3739513338 >> v2:172.21.15.31:3300/0 conn(0x7f60500b78f0 0x7f6050156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f6054cdd640 1 -- 172.21.15.31:0/3739513338 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366524050 0 0) 0x7f6050145c70 con 0x7f60500b4400 2023-11-27T17:54:03.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f6054cdd640 1 -- 172.21.15.31:0/3739513338 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f603c003530 con 0x7f60500b4400 2023-11-27T17:54:03.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f60564e0640 1 -- 172.21.15.31:0/3739513338 >> v1:172.21.15.81:6789/0 conn(0x7f60500b70e0 legacy=0x7f605014bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f60564e0640 1 -- 172.21.15.31:0/3739513338 >> v1:172.21.15.31:6789/0 conn(0x7f60500b4400 legacy=0x7f60500b9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.987 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.980+0000 7f60564e0640 1 -- 172.21.15.31:0/3739513338 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605014b5c0 con 0x7f60500b78f0 2023-11-27T17:54:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f60564e0640 1 --2- 172.21.15.31:0/3739513338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500b78f0 0x7f6050156d60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6048009d90 tx=0x7f604801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6161e1bd3d628e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f6054cdd640 1 -- 172.21.15.31:0/3739513338 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480a5780 con 0x7f60500b78f0 2023-11-27T17:54:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f6054cdd640 1 -- 172.21.15.31:0/3739513338 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60480a58e0 con 0x7f60500b78f0 2023-11-27T17:54:03.989 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f6054cdd640 1 -- 172.21.15.31:0/3739513338 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480a5c50 con 0x7f60500b78f0 2023-11-27T17:54:03.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f6057f43640 1 -- 172.21.15.31:0/3739513338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500b78f0 msgr2=0x7f6050156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f6057f43640 1 --2- 172.21.15.31:0/3739513338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500b78f0 0x7f6050156d60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6048009d90 tx=0x7f604801c8c0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f6057f43640 1 -- 172.21.15.31:0/3739513338 shutdown_connections 2023-11-27T17:54:03.990 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f6057f43640 1 --2- 172.21.15.31:0/3739513338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500b78f0 0x7f6050156d60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f6057f43640 1 -- 172.21.15.31:0/3739513338 >> 172.21.15.31:0/3739513338 conn(0x7f60500c0cb0 msgr2=0x7f60500c1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:03.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f6057f43640 1 -- 172.21.15.31:0/3739513338 shutdown_connections 2023-11-27T17:54:03.991 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f6057f43640 1 -- 172.21.15.31:0/3739513338 wait complete. 2023-11-27T17:54:03.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f6057f43640 1 Processor -- start 2023-11-27T17:54:03.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.984+0000 7f6057f43640 1 -- start start 2023-11-27T17:54:03.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f6057f43640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60500b4400 0x7f6050151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.992 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f6057f43640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60500b70e0 0x7f6050152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f6057f43640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500b78f0 0x7f60501e78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f6057f43640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6050151850 con 0x7f60500b78f0 2023-11-27T17:54:03.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f6057f43640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60501527c0 con 0x7f60500b4400 2023-11-27T17:54:03.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f6057f43640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605014f690 con 0x7f60500b70e0 2023-11-27T17:54:03.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60564e0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500b78f0 0x7f60501e78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60564e0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500b78f0 0x7f60501e78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37120/0 (socket says 172.21.15.31:37120) 2023-11-27T17:54:03.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60564e0640 1 -- 172.21.15.31:0/3269391460 learned_addr learned my addr 172.21.15.31:0/3269391460 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:03.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60564e0640 1 -- 172.21.15.31:0/3269391460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60500b70e0 msgr2=0x7f6050152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60564e0640 1 --2- 172.21.15.31:0/3269391460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60500b70e0 0x7f6050152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60564e0640 1 -- 172.21.15.31:0/3269391460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60500b4400 msgr2=0x7f6050151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:03.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60564e0640 1 --2- 172.21.15.31:0/3269391460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60500b4400 0x7f6050151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:03.993 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60564e0640 1 -- 172.21.15.31:0/3269391460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6048009a70 con 0x7f60500b78f0 2023-11-27T17:54:03.994 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60564e0640 1 --2- 172.21.15.31:0/3269391460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500b78f0 0x7f60501e78c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f60480194d0 tx=0x7f6048019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:03.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60467fc640 1 -- 172.21.15.31:0/3269391460 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480ad650 con 0x7f60500b78f0 2023-11-27T17:54:03.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60467fc640 1 -- 172.21.15.31:0/3269391460 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60480ad7b0 con 0x7f60500b78f0 2023-11-27T17:54:03.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f6057f43640 1 -- 172.21.15.31:0/3269391460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605014caa0 con 0x7f60500b78f0 2023-11-27T17:54:03.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60467fc640 1 -- 172.21.15.31:0/3269391460 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480adb20 con 0x7f60500b78f0 2023-11-27T17:54:03.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f6057f43640 1 -- 172.21.15.31:0/3269391460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605014f9e0 con 0x7f60500b78f0 2023-11-27T17:54:03.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f6057f43640 1 -- 172.21.15.31:0/3269391460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605004e850 con 0x7f60500b78f0 2023-11-27T17:54:03.995 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60467fc640 1 -- 172.21.15.31:0/3269391460 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f60480b4070 con 0x7f60500b78f0 2023-11-27T17:54:03.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60467fc640 1 --2- 172.21.15.31:0/3269391460 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f60340667f0 0x7f6034068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:03.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f60467fc640 1 -- 172.21.15.31:0/3269391460 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f604811eb20 con 0x7f60500b78f0 2023-11-27T17:54:03.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.988+0000 7f6055cdf640 1 --2- 172.21.15.31:0/3269391460 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f60340667f0 0x7f6034068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:03.996 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.992+0000 7f6055cdf640 1 --2- 172.21.15.31:0/3269391460 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f60340667f0 0x7f6034068cb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f604c000f70 tx=0x7f604c0079e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:03.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:03.992+0000 7f60467fc640 1 -- 172.21.15.31:0/3269391460 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f60480ec000 con 0x7f60500b78f0 2023-11-27T17:54:04.165 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.160+0000 7f6057f43640 1 -- 172.21.15.31:0/3269391460 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60501529d0 con 0x7f60500b78f0 2023-11-27T17:54:04.166 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.160+0000 7f60467fc640 1 -- 172.21.15.31:0/3269391460 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+12786 (secure 0 0 0) 0x7f60480ef620 con 0x7f60500b78f0 2023-11-27T17:54:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:04.167 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":26,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:54:01.258434+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:54:04.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.164+0000 7f6057f43640 1 -- 172.21.15.31:0/3269391460 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f60340667f0 msgr2=0x7f6034068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.164+0000 7f6057f43640 1 --2- 172.21.15.31:0/3269391460 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f60340667f0 0x7f6034068cb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f604c000f70 tx=0x7f604c0079e0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.164+0000 7f6057f43640 1 -- 172.21.15.31:0/3269391460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500b78f0 msgr2=0x7f60501e78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.164+0000 7f6057f43640 1 --2- 172.21.15.31:0/3269391460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500b78f0 0x7f60501e78c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f60480194d0 tx=0x7f6048019660 comp rx=0 tx=0).stop 2023-11-27T17:54:04.169 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.164+0000 7f6057f43640 1 -- 172.21.15.31:0/3269391460 shutdown_connections 2023-11-27T17:54:04.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.164+0000 7f6057f43640 1 --2- 172.21.15.31:0/3269391460 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f60340667f0 0x7f6034068cb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.164+0000 7f6057f43640 1 --2- 172.21.15.31:0/3269391460 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f60500b78f0 0x7f60501e78c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.164+0000 7f6057f43640 1 --2- 172.21.15.31:0/3269391460 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f60500b70e0 0x7f6050152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.164+0000 7f6057f43640 1 --2- 172.21.15.31:0/3269391460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60500b4400 0x7f6050151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.164+0000 7f6057f43640 1 -- 172.21.15.31:0/3269391460 >> 172.21.15.31:0/3269391460 conn(0x7f60500c0cb0 msgr2=0x7f605014a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:04.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.164+0000 7f6057f43640 1 -- 172.21.15.31:0/3269391460 shutdown_connections 2023-11-27T17:54:04.170 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.164+0000 7f6057f43640 1 -- 172.21.15.31:0/3269391460 wait complete. 2023-11-27T17:54:04.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-27T17:53:11.177026+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-27T17:54:04.187 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-27T17:54:04.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.304+0000 7f9a32bed640 1 Processor -- start 2023-11-27T17:54:04.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.304+0000 7f9a32bed640 1 -- start start 2023-11-27T17:54:04.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.304+0000 7f9a32bed640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1425e0 0x7f9a2c0bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.304+0000 7f9a32bed640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9a2c0b5d90 0x7f9a2c148570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a32bed640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0b6840 con 0x7f9a2c0b61d0 2023-11-27T17:54:04.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a32bed640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c1429c0 con 0x7f9a2c0b5d90 2023-11-27T17:54:04.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a32bed640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0b6b20 con 0x7f9a2c1425e0 2023-11-27T17:54:04.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a3118a640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9a2c0b61d0 0x7f9a2c14b690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:49008/0 (socket says 172.21.15.31:49008) 2023-11-27T17:54:04.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a3118a640 1 -- 172.21.15.31:0/3577490181 learned_addr learned my addr 172.21.15.31:0/3577490181 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:04.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a30989640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1425e0 0x7f9a2c0bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2bfff640 1 --2- 172.21.15.31:0/3577490181 >> v2:172.21.15.81:3300/0 conn(0x7f9a2c0b5d90 0x7f9a2c148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592325352 0 0) 0x7f9a2c0b6840 con 0x7f9a2c0b61d0 2023-11-27T17:54:04.318 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a18003530 con 0x7f9a2c0b61d0 2023-11-27T17:54:04.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2664566234 0 0) 0x7f9a18003530 con 0x7f9a2c0b61d0 2023-11-27T17:54:04.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1425e0 msgr2=0x7f9a2c0bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:04.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1425e0 0x7f9a2c0bd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 >> v2:172.21.15.81:3300/0 conn(0x7f9a2c0b5d90 msgr2=0x7f9a2c148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:04.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 --2- 172.21.15.31:0/3577490181 >> v2:172.21.15.81:3300/0 conn(0x7f9a2c0b5d90 0x7f9a2c148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0b6e00 con 0x7f9a2c0b61d0 2023-11-27T17:54:04.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f9a24001680 con 0x7f9a2c0b61d0 2023-11-27T17:54:04.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 >> v1:172.21.15.31:6789/0 conn(0x7f9a2c0b61d0 legacy=0x7f9a2c14b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1425e0 0x7f9a180039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a18003f70 0x7f9a180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a18004d10 0x7f9a18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.320 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c1429c0 con 0x7f9a18004d10 2023-11-27T17:54:04.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0b6b20 con 0x7f9a18003f70 2023-11-27T17:54:04.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1800b9c0 con 0x7f9a2c1425e0 2023-11-27T17:54:04.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a3118a640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a18004d10 0x7f9a18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a2bfff640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a18003f70 0x7f9a180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a30989640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1425e0 0x7f9a180039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a3118a640 1 -- 172.21.15.31:0/3577490181 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1425e0 msgr2=0x7f9a180039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:04.321 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a3118a640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1425e0 0x7f9a180039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a3118a640 1 -- 172.21.15.31:0/3577490181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a18003f70 msgr2=0x7f9a180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:04.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a3118a640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a18003f70 0x7f9a180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a3118a640 1 -- 172.21.15.31:0/3577490181 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a18003530 con 0x7f9a18004d10 2023-11-27T17:54:04.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a30989640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1425e0 0x7f9a180039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:54:04.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.308+0000 7f9a3118a640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a18004d10 0x7f9a18005190 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400c290 tx=0x7f9a2401cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7cde5cb5e55297 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:04.322 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240a5950 con 0x7f9a18004d10 2023-11-27T17:54:04.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a240a5ab0 con 0x7f9a18004d10 2023-11-27T17:54:04.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a2b7fe640 1 -- 172.21.15.31:0/3577490181 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240a5e60 con 0x7f9a18004d10 2023-11-27T17:54:04.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 -- 172.21.15.31:0/3577490181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a18004d10 msgr2=0x7f9a18005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 --2- 172.21.15.31:0/3577490181 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a18004d10 0x7f9a18005190 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400c290 tx=0x7f9a2401cce0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a3118a640 1 -- 172.21.15.31:0/3577490181 reap_dead start 2023-11-27T17:54:04.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 -- 172.21.15.31:0/3577490181 shutdown_connections 2023-11-27T17:54:04.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 -- 172.21.15.31:0/3577490181 >> 172.21.15.31:0/3577490181 conn(0x7f9a2c06ab60 msgr2=0x7f9a2c0bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:04.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 -- 172.21.15.31:0/3577490181 shutdown_connections 2023-11-27T17:54:04.324 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 -- 172.21.15.31:0/3577490181 wait complete. 2023-11-27T17:54:04.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 Processor -- start 2023-11-27T17:54:04.328 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 -- start start 2023-11-27T17:54:04.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a18004d10 0x7f9a2c143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1433f0 0x7f9a2c1df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a2c147f70 0x7f9a2c1471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c143f40 con 0x7f9a2c147f70 2023-11-27T17:54:04.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c1447f0 con 0x7f9a18004d10 2023-11-27T17:54:04.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c142c30 con 0x7f9a2c1433f0 2023-11-27T17:54:04.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a3118a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a2c147f70 0x7f9a2c1471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a3118a640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a2c147f70 0x7f9a2c1471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37130/0 (socket says 172.21.15.31:37130) 2023-11-27T17:54:04.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a3118a640 1 -- 172.21.15.31:0/3455349894 learned_addr learned my addr 172.21.15.31:0/3455349894 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:04.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a30989640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a18004d10 0x7f9a2c143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a2bfff640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1433f0 0x7f9a2c1df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a3118a640 1 -- 172.21.15.31:0/3455349894 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1433f0 msgr2=0x7f9a2c1df6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a3118a640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1433f0 0x7f9a2c1df6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a3118a640 1 -- 172.21.15.31:0/3455349894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a18004d10 msgr2=0x7f9a2c143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a3118a640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a18004d10 0x7f9a2c143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.331 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a3118a640 1 -- 172.21.15.31:0/3455349894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c142ed0 con 0x7f9a2c147f70 2023-11-27T17:54:04.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a30989640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a18004d10 0x7f9a2c143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:04.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a2bfff640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1433f0 0x7f9a2c1df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:04.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a3118a640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a2c147f70 0x7f9a2c1471d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a240ab040 tx=0x7f9a18005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:04.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a297fa640 1 -- 172.21.15.31:0/3455349894 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240072d0 con 0x7f9a2c147f70 2023-11-27T17:54:04.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a297fa640 1 -- 172.21.15.31:0/3455349894 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a24007430 con 0x7f9a2c147f70 2023-11-27T17:54:04.332 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 -- 172.21.15.31:0/3455349894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c1dfbf0 con 0x7f9a2c147f70 2023-11-27T17:54:04.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a297fa640 1 -- 172.21.15.31:0/3455349894 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24001650 con 0x7f9a2c147f70 2023-11-27T17:54:04.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.312+0000 7f9a32bed640 1 -- 172.21.15.31:0/3455349894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c144a90 con 0x7f9a2c147f70 2023-11-27T17:54:04.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.316+0000 7f9a32bed640 1 -- 172.21.15.31:0/3455349894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c1430c0 con 0x7f9a2c147f70 2023-11-27T17:54:04.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.316+0000 7f9a297fa640 1 -- 172.21.15.31:0/3455349894 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f9a240af440 con 0x7f9a2c147f70 2023-11-27T17:54:04.333 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.316+0000 7f9a297fa640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9a0c0667f0 0x7f9a0c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.316+0000 7f9a297fa640 1 -- 172.21.15.31:0/3455349894 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9a240b5030 con 0x7f9a2c147f70 2023-11-27T17:54:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.316+0000 7f9a30989640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9a0c0667f0 0x7f9a0c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.316+0000 7f9a30989640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9a0c0667f0 0x7f9a0c068cb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c007520 tx=0x7f9a1c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.320+0000 7f9a297fa640 1 -- 172.21.15.31:0/3455349894 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9a240ebd20 con 0x7f9a2c147f70 2023-11-27T17:54:04.479 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.472+0000 7f9a32bed640 1 -- 172.21.15.31:0/3455349894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a2c04e850 con 0x7f9a2c147f70 2023-11-27T17:54:04.480 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a297fa640 1 -- 172.21.15.31:0/3455349894 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a240bf020 con 0x7f9a2c147f70 2023-11-27T17:54:04.480 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2023-11-27T17:54:04.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a32bed640 1 -- 172.21.15.31:0/3455349894 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9a0c0667f0 msgr2=0x7f9a0c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a32bed640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9a0c0667f0 0x7f9a0c068cb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c007520 tx=0x7f9a1c00b040 comp rx=0 tx=0).stop 2023-11-27T17:54:04.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a32bed640 1 -- 172.21.15.31:0/3455349894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a2c147f70 msgr2=0x7f9a2c1471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a32bed640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a2c147f70 0x7f9a2c1471d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9a240ab040 tx=0x7f9a18005800 comp rx=0 tx=0).stop 2023-11-27T17:54:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a32bed640 1 -- 172.21.15.31:0/3455349894 shutdown_connections 2023-11-27T17:54:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a32bed640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f9a0c0667f0 0x7f9a0c068cb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a32bed640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a2c147f70 0x7f9a2c1471d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a32bed640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f9a2c1433f0 0x7f9a2c1df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a32bed640 1 --2- 172.21.15.31:0/3455349894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a18004d10 0x7f9a2c143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a32bed640 1 -- 172.21.15.31:0/3455349894 >> 172.21.15.31:0/3455349894 conn(0x7f9a2c06ab60 msgr2=0x7f9a2c0b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a32bed640 1 -- 172.21.15.31:0/3455349894 shutdown_connections 2023-11-27T17:54:04.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.476+0000 7f9a32bed640 1 -- 172.21.15.31:0/3455349894 wait complete. 2023-11-27T17:54:04.497 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-27T17:54:04.607 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.600+0000 7f5d8ffe8640 1 Processor -- start 2023-11-27T17:54:04.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8ffe8640 1 -- start start 2023-11-27T17:54:04.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8ffe8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d88141cc0 0x7f5d880b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8ffe8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d880b5880 con 0x7f5d88072510 2023-11-27T17:54:04.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8ffe8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d880b6100 con 0x7f5d881418e0 2023-11-27T17:54:04.610 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8ffe8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880b6ff0 con 0x7f5d88141cc0 2023-11-27T17:54:04.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8e585640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5d88072510 0x7f5d8814ad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53856/0 (socket says 172.21.15.31:53856) 2023-11-27T17:54:04.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8e585640 1 -- 172.21.15.31:0/1310408966 learned_addr learned my addr 172.21.15.31:0/1310408966 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:04.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8d583640 1 --2- 172.21.15.31:0/1310408966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d88141cc0 0x7f5d880b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119153867 0 0) 0x7f5d880b5880 con 0x7f5d88072510 2023-11-27T17:54:04.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d74003450 con 0x7f5d88072510 2023-11-27T17:54:04.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1587422867 0 0) 0x7f5d74003450 con 0x7f5d88072510 2023-11-27T17:54:04.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d88141cc0 msgr2=0x7f5d880b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:04.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 --2- 172.21.15.31:0/1310408966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d88141cc0 0x7f5d880b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 >> v1:172.21.15.81:6789/0 conn(0x7f5d881418e0 legacy=0x7f5d880b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d880b6590 con 0x7f5d88072510 2023-11-27T17:54:04.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f5d80001a00 con 0x7f5d88072510 2023-11-27T17:54:04.611 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 >> v1:172.21.15.31:6789/0 conn(0x7f5d88072510 legacy=0x7f5d8814ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 --2- 172.21.15.31:0/1310408966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d74003b10 0x7f5d74003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 --2- 172.21.15.31:0/1310408966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d88141cc0 0x7f5d7400a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 --2- 172.21.15.31:0/1310408966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d7400b080 0x7f5d7400d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880b6ff0 con 0x7f5d74003b10 2023-11-27T17:54:04.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7400dd80 con 0x7f5d7400b080 2023-11-27T17:54:04.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7400df40 con 0x7f5d88141cc0 2023-11-27T17:54:04.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8dd84640 1 --2- 172.21.15.31:0/1310408966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d74003b10 0x7f5d74003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8dd84640 1 -- 172.21.15.31:0/1310408966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d88141cc0 msgr2=0x7f5d7400a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:04.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8dd84640 1 --2- 172.21.15.31:0/1310408966 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d88141cc0 0x7f5d7400a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8dd84640 1 -- 172.21.15.31:0/1310408966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d7400b080 msgr2=0x7f5d7400d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:04.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8dd84640 1 --2- 172.21.15.31:0/1310408966 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d7400b080 0x7f5d7400d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.612 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.604+0000 7f5d8dd84640 1 -- 172.21.15.31:0/1310408966 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d74003450 con 0x7f5d74003b10 2023-11-27T17:54:04.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8dd84640 1 --2- 172.21.15.31:0/1310408966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d74003b10 0x7f5d74003f30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5d84001780 tx=0x7f5d8401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b048be3031ed39 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:04.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840052d0 con 0x7f5d74003b10 2023-11-27T17:54:04.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d840a7050 con 0x7f5d74003b10 2023-11-27T17:54:04.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8cd82640 1 -- 172.21.15.31:0/1310408966 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84003600 con 0x7f5d74003b10 2023-11-27T17:54:04.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/1310408966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d74003b10 msgr2=0x7f5d74003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.615 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 --2- 172.21.15.31:0/1310408966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d74003b10 0x7f5d74003f30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5d84001780 tx=0x7f5d8401c400 comp rx=0 tx=0).stop 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8e585640 1 -- 172.21.15.31:0/1310408966 reap_dead start 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/1310408966 shutdown_connections 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/1310408966 >> 172.21.15.31:0/1310408966 conn(0x7f5d8806ab60 msgr2=0x7f5d880bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/1310408966 shutdown_connections 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/1310408966 wait complete. 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 Processor -- start 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 -- start start 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d74003b10 0x7f5d88147930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d881dfa60 0x7f5d881dfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d8813ec00 0x7f5d8813f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d88148210 con 0x7f5d881dfa60 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880a2c70 con 0x7f5d74003b10 2023-11-27T17:54:04.616 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d881e0420 con 0x7f5d8813ec00 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8d583640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d881dfa60 0x7f5d881dfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8d583640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d881dfa60 0x7f5d881dfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36546/0 (socket says 172.21.15.31:36546) 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8d583640 1 -- 172.21.15.31:0/2075728752 learned_addr learned my addr 172.21.15.31:0/2075728752 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8dd84640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d74003b10 0x7f5d88147930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8e585640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d8813ec00 0x7f5d8813f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8d583640 1 -- 172.21.15.31:0/2075728752 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d8813ec00 msgr2=0x7f5d8813f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8d583640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d8813ec00 0x7f5d8813f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8d583640 1 -- 172.21.15.31:0/2075728752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d74003b10 msgr2=0x7f5d88147930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8d583640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d74003b10 0x7f5d88147930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8d583640 1 -- 172.21.15.31:0/2075728752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d88144c40 con 0x7f5d881dfa60 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8d583640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d881dfa60 0x7f5d881dfee0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800e7f0 tx=0x7f5d7800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d7e7fc640 1 -- 172.21.15.31:0/2075728752 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800c940 con 0x7f5d881dfa60 2023-11-27T17:54:04.617 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d7e7fc640 1 -- 172.21.15.31:0/2075728752 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7800caa0 con 0x7f5d881dfa60 2023-11-27T17:54:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/2075728752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d88144f20 con 0x7f5d881dfa60 2023-11-27T17:54:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d7e7fc640 1 -- 172.21.15.31:0/2075728752 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7800ce50 con 0x7f5d881dfa60 2023-11-27T17:54:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.608+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/2075728752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d881483d0 con 0x7f5d881dfa60 2023-11-27T17:54:04.618 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.612+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/2075728752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d88144a80 con 0x7f5d881dfa60 2023-11-27T17:54:04.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.612+0000 7f5d7e7fc640 1 -- 172.21.15.31:0/2075728752 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5d78013470 con 0x7f5d881dfa60 2023-11-27T17:54:04.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.612+0000 7f5d7e7fc640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f5d6c0667f0 0x7f5d6c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.612+0000 7f5d7e7fc640 1 -- 172.21.15.31:0/2075728752 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5d78083ea0 con 0x7f5d881dfa60 2023-11-27T17:54:04.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.612+0000 7f5d8dd84640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f5d6c0667f0 0x7f5d6c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.619 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.612+0000 7f5d8dd84640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f5d6c0667f0 0x7f5d6c068cb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5d84004000 tx=0x7f5d840011a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:04.621 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.616+0000 7f5d7e7fc640 1 -- 172.21.15.31:0/2075728752 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f5d78051380 con 0x7f5d881dfa60 2023-11-27T17:54:04.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/2075728752 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5d8814b410 con 0x7f5d881dfa60 2023-11-27T17:54:04.777 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d7e7fc640 1 -- 172.21.15.31:0/2075728752 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v26) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5d780549a0 con 0x7f5d881dfa60 2023-11-27T17:54:04.777 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:04.777 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2023-11-27T17:54:04.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-11-27T17:54:04.778 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2023-11-27T17:54:04.778 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2023-11-27T17:54:04.778 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-11-27T17:54:04.778 INFO:teuthology.orchestra.run.smithi031.stdout:] 2023-11-27T17:54:04.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/2075728752 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f5d6c0667f0 msgr2=0x7f5d6c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.779 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d8ffe8640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f5d6c0667f0 0x7f5d6c068cb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5d84004000 tx=0x7f5d840011a0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/2075728752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d881dfa60 msgr2=0x7f5d881dfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d8ffe8640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d881dfa60 0x7f5d881dfee0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800e7f0 tx=0x7f5d7800ecb0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/2075728752 shutdown_connections 2023-11-27T17:54:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d8ffe8640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f5d6c0667f0 0x7f5d6c068cb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d8ffe8640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f5d8813ec00 0x7f5d8813f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d8ffe8640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d881dfa60 0x7f5d881dfee0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d8ffe8640 1 --2- 172.21.15.31:0/2075728752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d74003b10 0x7f5d88147930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.780 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/2075728752 >> 172.21.15.31:0/2075728752 conn(0x7f5d8806ab60 msgr2=0x7f5d88140fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:04.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.772+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/2075728752 shutdown_connections 2023-11-27T17:54:04.781 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.776+0000 7f5d8ffe8640 1 -- 172.21.15.31:0/2075728752 wait complete. 2023-11-27T17:54:04.796 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-27T17:54:04.796 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-27T17:54:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.920+0000 7f84f3276640 1 Processor -- start 2023-11-27T17:54:04.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.920+0000 7f84f3276640 1 -- start start 2023-11-27T17:54:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.920+0000 7f84f3276640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84ec0b9ac0 0x7f84ec0b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.920+0000 7f84f3276640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec0b50f0 con 0x7f84ec14c980 2023-11-27T17:54:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.920+0000 7f84f3276640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec0b53d0 con 0x7f84ec0b6dd0 2023-11-27T17:54:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.920+0000 7f84f3276640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0b94d0 con 0x7f84ec0b9ac0 2023-11-27T17:54:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.920+0000 7f84f1813640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f84ec14c980 0x7f84ec153c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53860/0 (socket says 172.21.15.31:53860) 2023-11-27T17:54:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.920+0000 7f84f1813640 1 -- 172.21.15.31:0/1646759446 learned_addr learned my addr 172.21.15.31:0/1646759446 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.920+0000 7f84f1012640 1 --2- 172.21.15.31:0/1646759446 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84ec0b9ac0 0x7f84ec0b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.920+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864503158 0 0) 0x7f84ec0b50f0 con 0x7f84ec14c980 2023-11-27T17:54:04.928 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.920+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84d8003530 con 0x7f84ec14c980 2023-11-27T17:54:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 240188228 0 0) 0x7f84d8003530 con 0x7f84ec14c980 2023-11-27T17:54:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84ec0b9ac0 msgr2=0x7f84ec0b8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 --2- 172.21.15.31:0/1646759446 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84ec0b9ac0 0x7f84ec0b8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 >> v1:172.21.15.81:6789/0 conn(0x7f84ec0b6dd0 legacy=0x7f84ec143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.929 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec0b56b0 con 0x7f84ec14c980 2023-11-27T17:54:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f84e4001a00 con 0x7f84ec14c980 2023-11-27T17:54:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 >> v1:172.21.15.31:6789/0 conn(0x7f84ec14c980 legacy=0x7f84ec153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 --2- 172.21.15.31:0/1646759446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d8003a20 0x7f84d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 --2- 172.21.15.31:0/1646759446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d80047d0 0x7f84d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 --2- 172.21.15.31:0/1646759446 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84ec0b9ac0 0x7f84d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0b94d0 con 0x7f84d80047d0 2023-11-27T17:54:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d800ba40 con 0x7f84d8003a20 2023-11-27T17:54:04.930 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d800bbd0 con 0x7f84ec0b9ac0 2023-11-27T17:54:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f0811640 1 --2- 172.21.15.31:0/1646759446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d80047d0 0x7f84d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f1012640 1 --2- 172.21.15.31:0/1646759446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d8003a20 0x7f84d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f1813640 1 --2- 172.21.15.31:0/1646759446 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84ec0b9ac0 0x7f84d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f0811640 1 -- 172.21.15.31:0/1646759446 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84ec0b9ac0 msgr2=0x7f84d8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f0811640 1 --2- 172.21.15.31:0/1646759446 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84ec0b9ac0 0x7f84d8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f0811640 1 -- 172.21.15.31:0/1646759446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d8003a20 msgr2=0x7f84d8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f0811640 1 --2- 172.21.15.31:0/1646759446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84d8003a20 0x7f84d8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.931 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f0811640 1 -- 172.21.15.31:0/1646759446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d8003530 con 0x7f84d80047d0 2023-11-27T17:54:04.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f0811640 1 --2- 172.21.15.31:0/1646759446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d80047d0 0x7f84d8004c50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0b71f0 tx=0x7f84e801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6e6f3c0edbf41c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:04.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e80ab600 con 0x7f84d80047d0 2023-11-27T17:54:04.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e80a7050 con 0x7f84d80047d0 2023-11-27T17:54:04.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84dffff640 1 -- 172.21.15.31:0/1646759446 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e80ab9c0 con 0x7f84d80047d0 2023-11-27T17:54:04.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f3276640 1 -- 172.21.15.31:0/1646759446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d80047d0 msgr2=0x7f84d8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f3276640 1 --2- 172.21.15.31:0/1646759446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84d80047d0 0x7f84d8004c50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0b71f0 tx=0x7f84e801c4c0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f1813640 1 -- 172.21.15.31:0/1646759446 reap_dead start 2023-11-27T17:54:04.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f3276640 1 -- 172.21.15.31:0/1646759446 shutdown_connections 2023-11-27T17:54:04.935 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f3276640 1 -- 172.21.15.31:0/1646759446 >> 172.21.15.31:0/1646759446 conn(0x7f84ec06a730 msgr2=0x7f84ec06ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f3276640 1 -- 172.21.15.31:0/1646759446 shutdown_connections 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.924+0000 7f84f3276640 1 -- 172.21.15.31:0/1646759446 wait complete. 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f3276640 1 Processor -- start 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f3276640 1 -- start start 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f3276640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84d80047d0 0x7f84ec1d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f3276640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec1df570 0x7f84ec1d3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f3276640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84ec149370 0x7f84ec149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f3276640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec1de8a0 con 0x7f84ec149370 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f3276640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec1d3160 con 0x7f84ec1df570 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f3276640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec14c5b0 con 0x7f84d80047d0 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f1813640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84ec149370 0x7f84ec149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f1813640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84ec149370 0x7f84ec149800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36568/0 (socket says 172.21.15.31:36568) 2023-11-27T17:54:04.936 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f1813640 1 -- 172.21.15.31:0/2135710737 learned_addr learned my addr 172.21.15.31:0/2135710737 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f1012640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84d80047d0 0x7f84ec1d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f0811640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec1df570 0x7f84ec1d3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f1813640 1 -- 172.21.15.31:0/2135710737 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84d80047d0 msgr2=0x7f84ec1d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f1813640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84d80047d0 0x7f84ec1d2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f1813640 1 -- 172.21.15.31:0/2135710737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec1df570 msgr2=0x7f84ec1d3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f1813640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec1df570 0x7f84ec1d3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f1813640 1 -- 172.21.15.31:0/2135710737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec1dea90 con 0x7f84ec149370 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f1813640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84ec149370 0x7f84ec149800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0b6bc0 tx=0x7f84e4011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84ddffb640 1 -- 172.21.15.31:0/2135710737 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400f8c0 con 0x7f84ec149370 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84ddffb640 1 -- 172.21.15.31:0/2135710737 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e400fa20 con 0x7f84ec149370 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f3276640 1 -- 172.21.15.31:0/2135710737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec1ded70 con 0x7f84ec149370 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84ddffb640 1 -- 172.21.15.31:0/2135710737 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e400fdb0 con 0x7f84ec149370 2023-11-27T17:54:04.937 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f3276640 1 -- 172.21.15.31:0/2135710737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec147e40 con 0x7f84ec149370 2023-11-27T17:54:04.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84f3276640 1 -- 172.21.15.31:0/2135710737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec1df290 con 0x7f84ec149370 2023-11-27T17:54:04.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84ddffb640 1 -- 172.21.15.31:0/2135710737 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f84e401f460 con 0x7f84ec149370 2023-11-27T17:54:04.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.928+0000 7f84ddffb640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f84d00667f0 0x7f84d0068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:04.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.932+0000 7f84ddffb640 1 -- 172.21.15.31:0/2135710737 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f84e4086ef0 con 0x7f84ec149370 2023-11-27T17:54:04.938 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.932+0000 7f84f1012640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f84d00667f0 0x7f84d0068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:04.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.932+0000 7f84f1012640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f84d00667f0 0x7f84d0068cb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009a30 tx=0x7f84e0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:04.939 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:04.936+0000 7f84ddffb640 1 -- 172.21.15.31:0/2135710737 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f84ec1df290 con 0x7f84ec149370 2023-11-27T17:54:05.096 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.092+0000 7f84f3276640 1 -- 172.21.15.31:0/2135710737 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f84ec1df290 con 0x7f84ec149370 2023-11-27T17:54:05.271 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.264+0000 7f84ddffb640 1 -- 172.21.15.31:0/2135710737 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v27) v1 ==== 138+0+0 (secure 0 0 0) 0x7f84ec1df290 con 0x7f84ec149370 2023-11-27T17:54:05.271 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2023-11-27T17:54:05.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.268+0000 7f84f3276640 1 -- 172.21.15.31:0/2135710737 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f84d00667f0 msgr2=0x7f84d0068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:05.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.268+0000 7f84f3276640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f84d00667f0 0x7f84d0068cb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009a30 tx=0x7f84e0008040 comp rx=0 tx=0).stop 2023-11-27T17:54:05.274 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.268+0000 7f84f3276640 1 -- 172.21.15.31:0/2135710737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84ec149370 msgr2=0x7f84ec149800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:05.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.268+0000 7f84f3276640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84ec149370 0x7f84ec149800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0b6bc0 tx=0x7f84e4011c20 comp rx=0 tx=0).stop 2023-11-27T17:54:05.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.268+0000 7f84f3276640 1 -- 172.21.15.31:0/2135710737 shutdown_connections 2023-11-27T17:54:05.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.268+0000 7f84f3276640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f84d00667f0 0x7f84d0068cb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:05.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.268+0000 7f84f3276640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f84ec149370 0x7f84ec149800 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:05.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.268+0000 7f84f3276640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84ec1df570 0x7f84ec1d3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:05.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.268+0000 7f84f3276640 1 --2- 172.21.15.31:0/2135710737 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f84d80047d0 0x7f84ec1d2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:05.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.268+0000 7f84f3276640 1 -- 172.21.15.31:0/2135710737 >> 172.21.15.31:0/2135710737 conn(0x7f84ec06a730 msgr2=0x7f84ec13fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:05.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.268+0000 7f84f3276640 1 -- 172.21.15.31:0/2135710737 shutdown_connections 2023-11-27T17:54:05.275 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.268+0000 7f84f3276640 1 -- 172.21.15.31:0/2135710737 wait complete. 2023-11-27T17:54:05.301 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-27T17:54:05.433 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac671dc640 1 Processor -- start 2023-11-27T17:54:05.434 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac671dc640 1 -- start start 2023-11-27T17:54:05.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac671dc640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fac6006ab90 0x7fac6006af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:05.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac671dc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac600b6da0 0x7fac60155e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:05.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac671dc640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6006b4b0 con 0x7fac600c0670 2023-11-27T17:54:05.436 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac671dc640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac600bfbd0 con 0x7fac6006ab90 2023-11-27T17:54:05.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac671dc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac600b7ce0 con 0x7fac600b6da0 2023-11-27T17:54:05.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac5ffff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fac600c0670 0x7fac6014b600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53876/0 (socket says 172.21.15.31:53876) 2023-11-27T17:54:05.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac5ffff640 1 -- 172.21.15.31:0/3721767443 learned_addr learned my addr 172.21.15.31:0/3721767443 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:05.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac64f78640 1 --2- 172.21.15.31:0/3721767443 >> v2:172.21.15.31:3300/0 conn(0x7fac6006ab90 0x7fac6006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:05.437 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac65779640 1 --2- 172.21.15.31:0/3721767443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac600b6da0 0x7fac60155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:05.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac5f7fe640 1 -- 172.21.15.31:0/3721767443 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885737724 0 0) 0x7fac6006b4b0 con 0x7fac600c0670 2023-11-27T17:54:05.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac5f7fe640 1 -- 172.21.15.31:0/3721767443 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac40003530 con 0x7fac600c0670 2023-11-27T17:54:05.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac64f78640 1 -- 172.21.15.31:0/3721767443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac600b6da0 msgr2=0x7fac60155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:05.438 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac64f78640 1 --2- 172.21.15.31:0/3721767443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac600b6da0 0x7fac60155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:05.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac64f78640 1 -- 172.21.15.31:0/3721767443 >> v1:172.21.15.31:6789/0 conn(0x7fac600c0670 legacy=0x7fac6014b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:05.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac5f7fe640 1 -- 172.21.15.31:0/3721767443 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2206681094 0 0) 0x7fac40003530 con 0x7fac600c0670 2023-11-27T17:54:05.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac64f78640 1 -- 172.21.15.31:0/3721767443 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac600bfe70 con 0x7fac6006ab90 2023-11-27T17:54:05.439 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.428+0000 7fac65779640 1 --2- 172.21.15.31:0/3721767443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac600b6da0 0x7fac60155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:54:05.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.432+0000 7fac64f78640 1 --2- 172.21.15.31:0/3721767443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac6006ab90 0x7fac6006af70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fac58009d90 tx=0x7fac5801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b5e2e365ae668b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.432+0000 7fac5f7fe640 1 -- 172.21.15.31:0/3721767443 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48001680 con 0x7fac6006ab90 2023-11-27T17:54:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.432+0000 7fac5f7fe640 1 -- 172.21.15.31:0/3721767443 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac580a6480 con 0x7fac6006ab90 2023-11-27T17:54:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.432+0000 7fac5f7fe640 1 -- 172.21.15.31:0/3721767443 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac580a6810 con 0x7fac6006ab90 2023-11-27T17:54:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 -- 172.21.15.31:0/3721767443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac6006ab90 msgr2=0x7fac6006af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 --2- 172.21.15.31:0/3721767443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac6006ab90 0x7fac6006af70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fac58009d90 tx=0x7fac5801c870 comp rx=0 tx=0).stop 2023-11-27T17:54:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 -- 172.21.15.31:0/3721767443 shutdown_connections 2023-11-27T17:54:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 --2- 172.21.15.31:0/3721767443 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac600b6da0 0x7fac60155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 --2- 172.21.15.31:0/3721767443 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac6006ab90 0x7fac6006af70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 -- 172.21.15.31:0/3721767443 >> 172.21.15.31:0/3721767443 conn(0x7fac600a28f0 msgr2=0x7fac600a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 -- 172.21.15.31:0/3721767443 shutdown_connections 2023-11-27T17:54:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 -- 172.21.15.31:0/3721767443 wait complete. 2023-11-27T17:54:05.441 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 Processor -- start 2023-11-27T17:54:05.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 -- start start 2023-11-27T17:54:05.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac6006ab90 0x7fac600b9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:05.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac600b6da0 0x7fac601e42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:05.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac600c0670 0x7fac601e4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:05.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac600ba470 con 0x7fac600b6da0 2023-11-27T17:54:05.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac601e3e90 con 0x7fac600c0670 2023-11-27T17:54:05.443 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac600b8330 con 0x7fac6006ab90 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac5ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac600b6da0 0x7fac601e42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac5ffff640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac600b6da0 0x7fac601e42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36580/0 (socket says 172.21.15.31:36580) 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac5ffff640 1 -- 172.21.15.31:0/3465529032 learned_addr learned my addr 172.21.15.31:0/3465529032 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac64f78640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac6006ab90 0x7fac600b9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac65779640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac600c0670 0x7fac601e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac5ffff640 1 -- 172.21.15.31:0/3465529032 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac6006ab90 msgr2=0x7fac600b9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac5ffff640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac6006ab90 0x7fac600b9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac5ffff640 1 -- 172.21.15.31:0/3465529032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac600c0670 msgr2=0x7fac601e4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac5ffff640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac600c0670 0x7fac601e4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac5ffff640 1 -- 172.21.15.31:0/3465529032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac58009a70 con 0x7fac600b6da0 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac65779640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac600c0670 0x7fac601e4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac5ffff640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac600b6da0 0x7fac601e42c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fac4800c750 tx=0x7fac4800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:05.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac5d7fa640 1 -- 172.21.15.31:0/3465529032 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48005ae0 con 0x7fac600b6da0 2023-11-27T17:54:05.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac5d7fa640 1 -- 172.21.15.31:0/3465529032 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac48005c40 con 0x7fac600b6da0 2023-11-27T17:54:05.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 -- 172.21.15.31:0/3465529032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac600b85d0 con 0x7fac600b6da0 2023-11-27T17:54:05.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac5d7fa640 1 -- 172.21.15.31:0/3465529032 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48007070 con 0x7fac600b6da0 2023-11-27T17:54:05.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.436+0000 7fac671dc640 1 -- 172.21.15.31:0/3465529032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac600ba240 con 0x7fac600b6da0 2023-11-27T17:54:05.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.440+0000 7fac671dc640 1 -- 172.21.15.31:0/3465529032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac600b9210 con 0x7fac600b6da0 2023-11-27T17:54:05.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.440+0000 7fac5d7fa640 1 -- 172.21.15.31:0/3465529032 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fac480071f0 con 0x7fac600b6da0 2023-11-27T17:54:05.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.440+0000 7fac5d7fa640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fac440667f0 0x7fac44068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:05.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.440+0000 7fac64f78640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fac440667f0 0x7fac44068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:05.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.440+0000 7fac5d7fa640 1 -- 172.21.15.31:0/3465529032 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fac48083ec0 con 0x7fac600b6da0 2023-11-27T17:54:05.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.440+0000 7fac64f78640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fac440667f0 0x7fac44068cb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fac580ae000 tx=0x7fac580a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:05.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.444+0000 7fac5d7fa640 1 -- 172.21.15.31:0/3465529032 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fac600b9210 con 0x7fac600b6da0 2023-11-27T17:54:05.608 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:05.604+0000 7fac671dc640 1 -- 172.21.15.31:0/3465529032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fac600b9210 con 0x7fac600b6da0 2023-11-27T17:54:06.284 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.276+0000 7fac5d7fa640 1 -- 172.21.15.31:0/3465529032 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v28) v1 ==== 170+0+0 (secure 0 0 0) 0x7fac600b9210 con 0x7fac600b6da0 2023-11-27T17:54:06.284 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2023-11-27T17:54:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.280+0000 7fac671dc640 1 -- 172.21.15.31:0/3465529032 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fac440667f0 msgr2=0x7fac44068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.280+0000 7fac671dc640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fac440667f0 0x7fac44068cb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fac580ae000 tx=0x7fac580a7000 comp rx=0 tx=0).stop 2023-11-27T17:54:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.280+0000 7fac671dc640 1 -- 172.21.15.31:0/3465529032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac600b6da0 msgr2=0x7fac601e42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.280+0000 7fac671dc640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac600b6da0 0x7fac601e42c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fac4800c750 tx=0x7fac4800cc10 comp rx=0 tx=0).stop 2023-11-27T17:54:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.280+0000 7fac671dc640 1 -- 172.21.15.31:0/3465529032 shutdown_connections 2023-11-27T17:54:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.280+0000 7fac671dc640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fac440667f0 0x7fac44068cb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.280+0000 7fac671dc640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac600c0670 0x7fac601e4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.280+0000 7fac671dc640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fac600b6da0 0x7fac601e42c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.280+0000 7fac671dc640 1 --2- 172.21.15.31:0/3465529032 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fac6006ab90 0x7fac600b9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.280+0000 7fac671dc640 1 -- 172.21.15.31:0/3465529032 >> 172.21.15.31:0/3465529032 conn(0x7fac600a28f0 msgr2=0x7fac60141b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:06.287 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.280+0000 7fac671dc640 1 -- 172.21.15.31:0/3465529032 shutdown_connections 2023-11-27T17:54:06.288 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.280+0000 7fac671dc640 1 -- 172.21.15.31:0/3465529032 wait complete. 2023-11-27T17:54:06.320 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-27T17:54:06.445 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593ed3b640 1 Processor -- start 2023-11-27T17:54:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593ed3b640 1 -- start start 2023-11-27T17:54:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593ed3b640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f593806cda0 0x7f59380b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593ed3b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59380a44b0 0x7f593814b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593ed3b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593814e990 con 0x7f593806d180 2023-11-27T17:54:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593ed3b640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593814efc0 con 0x7f593806cda0 2023-11-27T17:54:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593ed3b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593814c380 con 0x7f59380a44b0 2023-11-27T17:54:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593d2d8640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f593806d180 0x7f593806b5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53890/0 (socket says 172.21.15.31:53890) 2023-11-27T17:54:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593d2d8640 1 -- 172.21.15.31:0/1342882348 learned_addr learned my addr 172.21.15.31:0/1342882348 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593cad7640 1 --2- 172.21.15.31:0/1342882348 >> v2:172.21.15.31:3300/0 conn(0x7f593806cda0 0x7f59380b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f59377fe640 1 -- 172.21.15.31:0/1342882348 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536824244 0 0) 0x7f593814e990 con 0x7f593806d180 2023-11-27T17:54:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f59377fe640 1 -- 172.21.15.31:0/1342882348 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5920003530 con 0x7f593806d180 2023-11-27T17:54:06.446 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f5937fff640 1 --2- 172.21.15.31:0/1342882348 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59380a44b0 0x7f593814b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:06.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593cad7640 1 -- 172.21.15.31:0/1342882348 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59380a44b0 msgr2=0x7f593814b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:06.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593cad7640 1 --2- 172.21.15.31:0/1342882348 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59380a44b0 0x7f593814b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:06.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593cad7640 1 -- 172.21.15.31:0/1342882348 >> v1:172.21.15.31:6789/0 conn(0x7f593806d180 legacy=0x7f593806b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:06.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593cad7640 1 -- 172.21.15.31:0/1342882348 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59380b5cf0 con 0x7f593806cda0 2023-11-27T17:54:06.447 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f5937fff640 1 --2- 172.21.15.31:0/1342882348 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59380a44b0 0x7f593814b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f593cad7640 1 --2- 172.21.15.31:0/1342882348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f593806cda0 0x7f59380b56f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f59280097c0 tx=0x7f592801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cff533d6984133 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f59377fe640 1 -- 172.21.15.31:0/1342882348 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59280a6040 con 0x7f593806cda0 2023-11-27T17:54:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f59377fe640 1 -- 172.21.15.31:0/1342882348 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59280aa600 con 0x7f593806cda0 2023-11-27T17:54:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.440+0000 7f59377fe640 1 -- 172.21.15.31:0/1342882348 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593806c4d0 con 0x7f593806cda0 2023-11-27T17:54:06.448 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 -- 172.21.15.31:0/1342882348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f593806cda0 msgr2=0x7f59380b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 --2- 172.21.15.31:0/1342882348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f593806cda0 0x7f59380b56f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f59280097c0 tx=0x7f592801c480 comp rx=0 tx=0).stop 2023-11-27T17:54:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 -- 172.21.15.31:0/1342882348 shutdown_connections 2023-11-27T17:54:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 --2- 172.21.15.31:0/1342882348 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f59380a44b0 0x7f593814b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 --2- 172.21.15.31:0/1342882348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f593806cda0 0x7f59380b56f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 -- 172.21.15.31:0/1342882348 >> 172.21.15.31:0/1342882348 conn(0x7f59380bb7d0 msgr2=0x7f59380bbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 -- 172.21.15.31:0/1342882348 shutdown_connections 2023-11-27T17:54:06.449 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 -- 172.21.15.31:0/1342882348 wait complete. 2023-11-27T17:54:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 Processor -- start 2023-11-27T17:54:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 -- start start 2023-11-27T17:54:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f593806cda0 0x7f5938140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f593806d180 0x7f5938149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59380a44b0 0x7f593813af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:06.451 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5938141110 con 0x7f593806cda0 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593814c580 con 0x7f59380a44b0 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593814acb0 con 0x7f593806d180 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593cad7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f593806cda0 0x7f5938140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593cad7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f593806cda0 0x7f5938140bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36606/0 (socket says 172.21.15.31:36606) 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593cad7640 1 -- 172.21.15.31:0/1831991753 learned_addr learned my addr 172.21.15.31:0/1831991753 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593d2d8640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59380a44b0 0x7f593813af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593cad7640 1 -- 172.21.15.31:0/1831991753 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f593806d180 msgr2=0x7f5938149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f5937fff640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f593806d180 0x7f5938149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593cad7640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f593806d180 0x7f5938149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593cad7640 1 -- 172.21.15.31:0/1831991753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59380a44b0 msgr2=0x7f593813af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593cad7640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59380a44b0 0x7f593813af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593cad7640 1 -- 172.21.15.31:0/1831991753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5928009420 con 0x7f593806cda0 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593d2d8640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59380a44b0 0x7f593813af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:06.452 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593cad7640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f593806cda0 0x7f5938140bd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f592801cd20 tx=0x7f592801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f59357fa640 1 -- 172.21.15.31:0/1831991753 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59280b3600 con 0x7f593806cda0 2023-11-27T17:54:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f59357fa640 1 -- 172.21.15.31:0/1831991753 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59280b3760 con 0x7f593806cda0 2023-11-27T17:54:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 -- 172.21.15.31:0/1831991753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5938149200 con 0x7f593806cda0 2023-11-27T17:54:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f59357fa640 1 -- 172.21.15.31:0/1831991753 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59280b3ad0 con 0x7f593806cda0 2023-11-27T17:54:06.453 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.444+0000 7f593ed3b640 1 -- 172.21.15.31:0/1831991753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5938146c10 con 0x7f593806cda0 2023-11-27T17:54:06.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.448+0000 7f593ed3b640 1 -- 172.21.15.31:0/1831991753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593814aed0 con 0x7f593806cda0 2023-11-27T17:54:06.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.448+0000 7f59357fa640 1 -- 172.21.15.31:0/1831991753 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f59280b3c30 con 0x7f593806cda0 2023-11-27T17:54:06.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.448+0000 7f59357fa640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f59240667f0 0x7f5924068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:06.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.448+0000 7f59357fa640 1 -- 172.21.15.31:0/1831991753 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f592811ea10 con 0x7f593806cda0 2023-11-27T17:54:06.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.448+0000 7f5937fff640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f59240667f0 0x7f5924068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:06.454 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.448+0000 7f5937fff640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f59240667f0 0x7f5924068cb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f592c006fd0 tx=0x7f592c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:06.457 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.452+0000 7f59357fa640 1 -- 172.21.15.31:0/1831991753 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f59280ebc20 con 0x7f593806cda0 2023-11-27T17:54:06.648 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:06.640+0000 7f593ed3b640 1 -- 172.21.15.31:0/1831991753 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f593804e850 con 0x7f593806cda0 2023-11-27T17:54:07.323 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.316+0000 7f59357fa640 1 -- 172.21.15.31:0/1831991753 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f59280c3020 con 0x7f593806cda0 2023-11-27T17:54:07.324 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 4 and data pool 5 2023-11-27T17:54:07.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.324+0000 7f593ed3b640 1 -- 172.21.15.31:0/1831991753 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f59240667f0 msgr2=0x7f5924068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.324+0000 7f593ed3b640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f59240667f0 0x7f5924068cb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f592c006fd0 tx=0x7f592c008040 comp rx=0 tx=0).stop 2023-11-27T17:54:07.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.324+0000 7f593ed3b640 1 -- 172.21.15.31:0/1831991753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f593806cda0 msgr2=0x7f5938140bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.324+0000 7f593ed3b640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f593806cda0 0x7f5938140bd0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f592801cd20 tx=0x7f592801acc0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.328+0000 7f593ed3b640 1 -- 172.21.15.31:0/1831991753 shutdown_connections 2023-11-27T17:54:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.328+0000 7f593ed3b640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f59240667f0 0x7f5924068cb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.328+0000 7f593ed3b640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59380a44b0 0x7f593813af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.328+0000 7f593ed3b640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f593806d180 0x7f5938149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.328+0000 7f593ed3b640 1 --2- 172.21.15.31:0/1831991753 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f593806cda0 0x7f5938140bd0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.334 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.328+0000 7f593ed3b640 1 -- 172.21.15.31:0/1831991753 >> 172.21.15.31:0/1831991753 conn(0x7f59380bb7d0 msgr2=0x7f593806dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:07.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.328+0000 7f593ed3b640 1 -- 172.21.15.31:0/1831991753 shutdown_connections 2023-11-27T17:54:07.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.328+0000 7f593ed3b640 1 -- 172.21.15.31:0/1831991753 wait complete. 2023-11-27T17:54:07.369 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:54:07.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.480+0000 7f40769b8640 1 Processor -- start 2023-11-27T17:54:07.487 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.480+0000 7f40769b8640 1 -- start start 2023-11-27T17:54:07.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f40769b8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4070143580 0x7f40700b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f40769b8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4070149150 0x7f40701539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f40769b8640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4070143960 con 0x7f4070072830 2023-11-27T17:54:07.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f40769b8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40700bd950 con 0x7f4070143580 2023-11-27T17:54:07.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f40769b8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40700b5120 con 0x7f4070149150 2023-11-27T17:54:07.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406f7fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4070072830 0x7f40700bd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53902/0 (socket says 172.21.15.31:53902) 2023-11-27T17:54:07.488 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406f7fe640 1 -- 172.21.15.31:0/1179370626 learned_addr learned my addr 172.21.15.31:0/1179370626 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:07.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406ffff640 1 --2- 172.21.15.31:0/1179370626 >> v2:172.21.15.81:3300/0 conn(0x7f4070143580 0x7f40700b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f4074f55640 1 --2- 172.21.15.31:0/1179370626 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4070149150 0x7f40701539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354797966 0 0) 0x7f4070143960 con 0x7f4070072830 2023-11-27T17:54:07.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4058003530 con 0x7f4070072830 2023-11-27T17:54:07.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2959050575 0 0) 0x7f4058003530 con 0x7f4070072830 2023-11-27T17:54:07.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4070149150 msgr2=0x7f40701539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:07.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 --2- 172.21.15.31:0/1179370626 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4070149150 0x7f40701539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 >> v2:172.21.15.81:3300/0 conn(0x7f4070143580 msgr2=0x7f40700b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:07.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 --2- 172.21.15.31:0/1179370626 >> v2:172.21.15.81:3300/0 conn(0x7f4070143580 0x7f40700b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40700b4630 con 0x7f4070072830 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f4064001680 con 0x7f4070072830 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 >> v1:172.21.15.31:6789/0 conn(0x7f4070072830 legacy=0x7f40700bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 --2- 172.21.15.31:0/1179370626 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4070149150 0x7f40580039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 --2- 172.21.15.31:0/1179370626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4058003f70 0x7f40580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 --2- 172.21.15.31:0/1179370626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058004d10 0x7f4058005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40700bd950 con 0x7f4058003f70 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40700b5120 con 0x7f4058004d10 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405800b9c0 con 0x7f4070149150 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406f7fe640 1 --2- 172.21.15.31:0/1179370626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4058003f70 0x7f40580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406ffff640 1 --2- 172.21.15.31:0/1179370626 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4070149150 0x7f40580039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f4074f55640 1 --2- 172.21.15.31:0/1179370626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058004d10 0x7f4058005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406f7fe640 1 -- 172.21.15.31:0/1179370626 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4070149150 msgr2=0x7f40580039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406f7fe640 1 --2- 172.21.15.31:0/1179370626 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f4070149150 0x7f40580039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406f7fe640 1 -- 172.21.15.31:0/1179370626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058004d10 msgr2=0x7f4058005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:07.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406f7fe640 1 --2- 172.21.15.31:0/1179370626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058004d10 0x7f4058005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.492 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406f7fe640 1 -- 172.21.15.31:0/1179370626 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4058003530 con 0x7f4058003f70 2023-11-27T17:54:07.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406f7fe640 1 --2- 172.21.15.31:0/1179370626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4058003f70 0x7f40580047d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f406400c290 tx=0x7f406401f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa65ba76cfd545ba server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:07.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064005ae0 con 0x7f4058003f70 2023-11-27T17:54:07.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40640ab070 con 0x7f4058003f70 2023-11-27T17:54:07.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.484+0000 7f406effd640 1 -- 172.21.15.31:0/1179370626 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064005e80 con 0x7f4058003f70 2023-11-27T17:54:07.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 -- 172.21.15.31:0/1179370626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4058003f70 msgr2=0x7f40580047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 --2- 172.21.15.31:0/1179370626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4058003f70 0x7f40580047d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f406400c290 tx=0x7f406401f430 comp rx=0 tx=0).stop 2023-11-27T17:54:07.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f4074f55640 1 -- 172.21.15.31:0/1179370626 reap_dead start 2023-11-27T17:54:07.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 -- 172.21.15.31:0/1179370626 shutdown_connections 2023-11-27T17:54:07.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 -- 172.21.15.31:0/1179370626 >> 172.21.15.31:0/1179370626 conn(0x7f407006ab60 msgr2=0x7f40700bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:07.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 -- 172.21.15.31:0/1179370626 shutdown_connections 2023-11-27T17:54:07.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 -- 172.21.15.31:0/1179370626 wait complete. 2023-11-27T17:54:07.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 Processor -- start 2023-11-27T17:54:07.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 -- start start 2023-11-27T17:54:07.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058003f70 0x7f40701426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4070071860 0x7f407013d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f407013d670 0x7f4070070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4070142be0 con 0x7f4070071860 2023-11-27T17:54:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40700b3a70 con 0x7f4058003f70 2023-11-27T17:54:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40700b31d0 con 0x7f407013d670 2023-11-27T17:54:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4070071860 0x7f407013d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406f7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4070071860 0x7f407013d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36614/0 (socket says 172.21.15.31:36614) 2023-11-27T17:54:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406f7fe640 1 -- 172.21.15.31:0/2722179322 learned_addr learned my addr 172.21.15.31:0/2722179322 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406ffff640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058003f70 0x7f40701426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f4074f55640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f407013d670 0x7f4070070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406f7fe640 1 -- 172.21.15.31:0/2722179322 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f407013d670 msgr2=0x7f4070070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406f7fe640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f407013d670 0x7f4070070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406f7fe640 1 -- 172.21.15.31:0/2722179322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058003f70 msgr2=0x7f40701426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406f7fe640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058003f70 0x7f40701426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406f7fe640 1 -- 172.21.15.31:0/2722179322 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40700b34b0 con 0x7f4070071860 2023-11-27T17:54:07.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406f7fe640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4070071860 0x7f407013d130 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f40640260a0 tx=0x7f4058005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:07.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406cff9640 1 -- 172.21.15.31:0/2722179322 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40640b7070 con 0x7f4070071860 2023-11-27T17:54:07.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406cff9640 1 -- 172.21.15.31:0/2722179322 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4064005940 con 0x7f4070071860 2023-11-27T17:54:07.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 -- 172.21.15.31:0/2722179322 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40700b3790 con 0x7f4070071860 2023-11-27T17:54:07.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f406cff9640 1 -- 172.21.15.31:0/2722179322 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064005cf0 con 0x7f4070071860 2023-11-27T17:54:07.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.488+0000 7f40769b8640 1 -- 172.21.15.31:0/2722179322 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4070145d50 con 0x7f4070071860 2023-11-27T17:54:07.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.492+0000 7f40769b8640 1 -- 172.21.15.31:0/2722179322 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407004e850 con 0x7f4070071860 2023-11-27T17:54:07.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.492+0000 7f406cff9640 1 -- 172.21.15.31:0/2722179322 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f40640ad020 con 0x7f4070071860 2023-11-27T17:54:07.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.492+0000 7f406cff9640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f405c066820 0x7f405c068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.492+0000 7f406cff9640 1 -- 172.21.15.31:0/2722179322 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4064120f10 con 0x7f4070071860 2023-11-27T17:54:07.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.492+0000 7f406ffff640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f405c066820 0x7f405c068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.492+0000 7f406ffff640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f405c066820 0x7f405c068ce0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4068007520 tx=0x7f406800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:07.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.496+0000 7f406cff9640 1 -- 172.21.15.31:0/2722179322 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f40640f1aa0 con 0x7f4070071860 2023-11-27T17:54:07.658 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.652+0000 7f40769b8640 1 -- 172.21.15.31:0/2722179322 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4070070710 con 0x7f4070071860 2023-11-27T17:54:07.661 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f406cff9640 1 -- 172.21.15.31:0/2722179322 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16511 (secure 0 0 0) 0x7f40640b4090 con 0x7f4070071860 2023-11-27T17:54:07.661 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:07.661 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:54:06.647557+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:54:05.136152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T17:54:05.648250+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:54:07.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f40769b8640 1 -- 172.21.15.31:0/2722179322 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f405c066820 msgr2=0x7f405c068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f40769b8640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f405c066820 0x7f405c068ce0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4068007520 tx=0x7f406800b040 comp rx=0 tx=0).stop 2023-11-27T17:54:07.663 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f40769b8640 1 -- 172.21.15.31:0/2722179322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4070071860 msgr2=0x7f407013d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f40769b8640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4070071860 0x7f407013d130 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f40640260a0 tx=0x7f4058005800 comp rx=0 tx=0).stop 2023-11-27T17:54:07.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f40769b8640 1 -- 172.21.15.31:0/2722179322 shutdown_connections 2023-11-27T17:54:07.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f40769b8640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f405c066820 0x7f405c068ce0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f40769b8640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f407013d670 0x7f4070070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f40769b8640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4070071860 0x7f407013d130 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.664 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f40769b8640 1 --2- 172.21.15.31:0/2722179322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4058003f70 0x7f40701426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f40769b8640 1 -- 172.21.15.31:0/2722179322 >> 172.21.15.31:0/2722179322 conn(0x7f407006ab60 msgr2=0x7f40700b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:07.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f40769b8640 1 -- 172.21.15.31:0/2722179322 shutdown_connections 2023-11-27T17:54:07.665 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.656+0000 7f40769b8640 1 -- 172.21.15.31:0/2722179322 wait complete. 2023-11-27T17:54:07.680 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:54:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.800+0000 7f5172757640 1 Processor -- start 2023-11-27T17:54:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.800+0000 7f5172757640 1 -- start start 2023-11-27T17:54:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f5172757640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f516c0b89a0 0x7f516c0b9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f5172757640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f516c0bb050 0x7f516c0b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f5172757640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f516c06d220 con 0x7f516c145040 2023-11-27T17:54:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f5172757640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516c06c5d0 con 0x7f516c0b89a0 2023-11-27T17:54:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f5172757640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0ba3f0 con 0x7f516c0bb050 2023-11-27T17:54:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f516bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f516c0b89a0 0x7f516c0b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f5170cf4640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f516c145040 0x7f516c1454b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53916/0 (socket says 172.21.15.31:53916) 2023-11-27T17:54:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f516bfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f516c0b89a0 0x7f516c0b9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36626/0 (socket says 172.21.15.31:36626) 2023-11-27T17:54:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f5170cf4640 1 -- 172.21.15.31:0/3086719624 learned_addr learned my addr 172.21.15.31:0/3086719624 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f516b7fe640 1 --2- 172.21.15.31:0/3086719624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f516c0bb050 0x7f516c0b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f516bfff640 1 -- 172.21.15.31:0/3086719624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f516c0bb050 msgr2=0x7f516c0b9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f516bfff640 1 --2- 172.21.15.31:0/3086719624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f516c0bb050 0x7f516c0b9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f516bfff640 1 -- 172.21.15.31:0/3086719624 >> v1:172.21.15.31:6789/0 conn(0x7f516c145040 legacy=0x7f516c1454b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f516bfff640 1 -- 172.21.15.31:0/3086719624 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c06d500 con 0x7f516c0b89a0 2023-11-27T17:54:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f516affd640 1 -- 172.21.15.31:0/3086719624 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197501407 0 0) 0x7f516c06d220 con 0x7f516c145040 2023-11-27T17:54:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f516bfff640 1 --2- 172.21.15.31:0/3086719624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c0b89a0 0x7f516c0b9970 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f515c0097c0 tx=0x7f515c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47159921199b760d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f516affd640 1 -- 172.21.15.31:0/3086719624 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c0ab600 con 0x7f516c0b89a0 2023-11-27T17:54:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f516affd640 1 -- 172.21.15.31:0/3086719624 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c0a7050 con 0x7f516c0b89a0 2023-11-27T17:54:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.804+0000 7f516affd640 1 -- 172.21.15.31:0/3086719624 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c0ab980 con 0x7f516c0b89a0 2023-11-27T17:54:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 -- 172.21.15.31:0/3086719624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c0b89a0 msgr2=0x7f516c0b9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 --2- 172.21.15.31:0/3086719624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c0b89a0 0x7f516c0b9970 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f515c0097c0 tx=0x7f515c01c3f0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 -- 172.21.15.31:0/3086719624 shutdown_connections 2023-11-27T17:54:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 --2- 172.21.15.31:0/3086719624 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f516c0bb050 0x7f516c0b9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 --2- 172.21.15.31:0/3086719624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c0b89a0 0x7f516c0b9970 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 -- 172.21.15.31:0/3086719624 >> 172.21.15.31:0/3086719624 conn(0x7f516c0beb70 msgr2=0x7f516c0bef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 -- 172.21.15.31:0/3086719624 shutdown_connections 2023-11-27T17:54:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 -- 172.21.15.31:0/3086719624 wait complete. 2023-11-27T17:54:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 Processor -- start 2023-11-27T17:54:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 -- start start 2023-11-27T17:54:07.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f516c0b89a0 0x7f516c0b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c0bb050 0x7f516c1e6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c145040 0x7f516c13e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.817 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c0b71a0 con 0x7f516c145040 2023-11-27T17:54:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516c13e8f0 con 0x7f516c0bb050 2023-11-27T17:54:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516c146260 con 0x7f516c0b89a0 2023-11-27T17:54:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5170cf4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c145040 0x7f516c13e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5170cf4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c145040 0x7f516c13e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36632/0 (socket says 172.21.15.31:36632) 2023-11-27T17:54:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5170cf4640 1 -- 172.21.15.31:0/2179779766 learned_addr learned my addr 172.21.15.31:0/2179779766 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f516b7fe640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c0bb050 0x7f516c1e6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f516bfff640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f516c0b89a0 0x7f516c0b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5170cf4640 1 -- 172.21.15.31:0/2179779766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f516c0b89a0 msgr2=0x7f516c0b75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5170cf4640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f516c0b89a0 0x7f516c0b75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5170cf4640 1 -- 172.21.15.31:0/2179779766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c0bb050 msgr2=0x7f516c1e6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5170cf4640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c0bb050 0x7f516c1e6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5170cf4640 1 -- 172.21.15.31:0/2179779766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c009420 con 0x7f516c145040 2023-11-27T17:54:07.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f516bfff640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f516c0b89a0 0x7f516c0b75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:07.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f516b7fe640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c0bb050 0x7f516c1e6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:07.819 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5170cf4640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c145040 0x7f516c13e3b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f516400c3c0 tx=0x7f516400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5168ff9640 1 -- 172.21.15.31:0/2179779766 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51640074e0 con 0x7f516c145040 2023-11-27T17:54:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5168ff9640 1 -- 172.21.15.31:0/2179779766 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5164007640 con 0x7f516c145040 2023-11-27T17:54:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5168ff9640 1 -- 172.21.15.31:0/2179779766 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164004a30 con 0x7f516c145040 2023-11-27T17:54:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 -- 172.21.15.31:0/2179779766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516c1443e0 con 0x7f516c145040 2023-11-27T17:54:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 -- 172.21.15.31:0/2179779766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516c0b6ae0 con 0x7f516c145040 2023-11-27T17:54:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.808+0000 7f5172757640 1 -- 172.21.15.31:0/2179779766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516c04e850 con 0x7f516c145040 2023-11-27T17:54:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.812+0000 7f5168ff9640 1 -- 172.21.15.31:0/2179779766 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f5164004b90 con 0x7f516c145040 2023-11-27T17:54:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.812+0000 7f5168ff9640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f514c066820 0x7f514c068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:07.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.812+0000 7f5168ff9640 1 -- 172.21.15.31:0/2179779766 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5164083f90 con 0x7f516c145040 2023-11-27T17:54:07.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.816+0000 7f516bfff640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f514c066820 0x7f514c068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:07.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.816+0000 7f516bfff640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f514c066820 0x7f514c068ce0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f515c0ad000 tx=0x7f515c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:07.821 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.816+0000 7f5168ff9640 1 -- 172.21.15.31:0/2179779766 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f51640b5280 con 0x7f516c145040 2023-11-27T17:54:07.979 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.972+0000 7f5172757640 1 -- 172.21.15.31:0/2179779766 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f516c067f80 con 0x7f516c145040 2023-11-27T17:54:07.981 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.976+0000 7f5168ff9640 1 -- 172.21.15.31:0/2179779766 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+16511 (secure 0 0 0) 0x7f5164051120 con 0x7f516c145040 2023-11-27T17:54:07.981 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:07.982 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":29,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:54:06.647557+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:54:05.136152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T17:54:05.648250+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:54:07.984 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.980+0000 7f5172757640 1 -- 172.21.15.31:0/2179779766 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f514c066820 msgr2=0x7f514c068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.980+0000 7f5172757640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f514c066820 0x7f514c068ce0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f515c0ad000 tx=0x7f515c008040 comp rx=0 tx=0).stop 2023-11-27T17:54:07.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.980+0000 7f5172757640 1 -- 172.21.15.31:0/2179779766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c145040 msgr2=0x7f516c13e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:07.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.980+0000 7f5172757640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c145040 0x7f516c13e3b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f516400c3c0 tx=0x7f516400c880 comp rx=0 tx=0).stop 2023-11-27T17:54:07.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.980+0000 7f5172757640 1 -- 172.21.15.31:0/2179779766 shutdown_connections 2023-11-27T17:54:07.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.980+0000 7f5172757640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f514c066820 0x7f514c068ce0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.980+0000 7f5172757640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f516c145040 0x7f516c13e3b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.985 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.980+0000 7f5172757640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f516c0bb050 0x7f516c1e6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.980+0000 7f5172757640 1 --2- 172.21.15.31:0/2179779766 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f516c0b89a0 0x7f516c0b75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:07.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.980+0000 7f5172757640 1 -- 172.21.15.31:0/2179779766 >> 172.21.15.31:0/2179779766 conn(0x7f516c0beb70 msgr2=0x7f516c0722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:07.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.980+0000 7f5172757640 1 -- 172.21.15.31:0/2179779766 shutdown_connections 2023-11-27T17:54:07.986 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:07.980+0000 7f5172757640 1 -- 172.21.15.31:0/2179779766 wait complete. 2023-11-27T17:54:08.001 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-27T17:54:08.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe82097b640 1 Processor -- start 2023-11-27T17:54:08.128 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe82097b640 1 -- start start 2023-11-27T17:54:08.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe82097b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe81c1420f0 0x7fe81c142510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:08.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe82097b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c0b8640 con 0x7fe81c148470 2023-11-27T17:54:08.130 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe82097b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c0b8890 con 0x7fe81c0b6a70 2023-11-27T17:54:08.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe82097b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c06f630 con 0x7fe81c1420f0 2023-11-27T17:54:08.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81ad9d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe81c148470 0x7fe81c148880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53926/0 (socket says 172.21.15.31:53926) 2023-11-27T17:54:08.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81ad9d640 1 -- 172.21.15.31:0/1191680474 learned_addr learned my addr 172.21.15.31:0/1191680474 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:08.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe819d9b640 1 --2- 172.21.15.31:0/1191680474 >> v2:172.21.15.81:3300/0 conn(0x7fe81c1420f0 0x7fe81c142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:08.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923892168 0 0) 0x7fe81c0b8640 con 0x7fe81c148470 2023-11-27T17:54:08.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe808003530 con 0x7fe81c148470 2023-11-27T17:54:08.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1076021903 0 0) 0x7fe808003530 con 0x7fe81c148470 2023-11-27T17:54:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 >> v2:172.21.15.81:3300/0 conn(0x7fe81c1420f0 msgr2=0x7fe81c142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 --2- 172.21.15.31:0/1191680474 >> v2:172.21.15.81:3300/0 conn(0x7fe81c1420f0 0x7fe81c142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 >> v1:172.21.15.81:6789/0 conn(0x7fe81c0b6a70 legacy=0x7fe81c0b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0b8b70 con 0x7fe81c148470 2023-11-27T17:54:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7fe814001680 con 0x7fe81c148470 2023-11-27T17:54:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 >> v1:172.21.15.31:6789/0 conn(0x7fe81c148470 legacy=0x7fe81c148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 --2- 172.21.15.31:0/1191680474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8080039f0 0x7fe808003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:08.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 --2- 172.21.15.31:0/1191680474 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe8080047d0 0x7fe808004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:08.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 --2- 172.21.15.31:0/1191680474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe808005190 0x7fe80800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:08.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c06f630 con 0x7fe808005190 2023-11-27T17:54:08.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80800c0c0 con 0x7fe8080039f0 2023-11-27T17:54:08.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80800c280 con 0x7fe8080047d0 2023-11-27T17:54:08.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81ad9d640 1 --2- 172.21.15.31:0/1191680474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe808005190 0x7fe80800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:08.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81a59c640 1 --2- 172.21.15.31:0/1191680474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8080039f0 0x7fe808003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:08.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe819d9b640 1 --2- 172.21.15.31:0/1191680474 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe8080047d0 0x7fe808004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:08.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81ad9d640 1 -- 172.21.15.31:0/1191680474 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe8080047d0 msgr2=0x7fe808004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:08.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81ad9d640 1 --2- 172.21.15.31:0/1191680474 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe8080047d0 0x7fe808004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:08.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81ad9d640 1 -- 172.21.15.31:0/1191680474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8080039f0 msgr2=0x7fe808003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:08.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81ad9d640 1 --2- 172.21.15.31:0/1191680474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8080039f0 0x7fe808003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:08.134 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.124+0000 7fe81ad9d640 1 -- 172.21.15.31:0/1191680474 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808003530 con 0x7fe808005190 2023-11-27T17:54:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81ad9d640 1 -- 172.21.15.31:0/1191680474 reap_dead start 2023-11-27T17:54:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81ad9d640 1 --2- 172.21.15.31:0/1191680474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe808005190 0x7fe80800b990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe814007cb0 tx=0x7fe81401ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d0d648ea069d64 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8140a7d70 con 0x7fe808005190 2023-11-27T17:54:08.138 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8140058e0 con 0x7fe808005190 2023-11-27T17:54:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81959a640 1 -- 172.21.15.31:0/1191680474 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814005c90 con 0x7fe808005190 2023-11-27T17:54:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 -- 172.21.15.31:0/1191680474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe808005190 msgr2=0x7fe80800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 --2- 172.21.15.31:0/1191680474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe808005190 0x7fe80800b990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe814007cb0 tx=0x7fe81401ee70 comp rx=0 tx=0).stop 2023-11-27T17:54:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 -- 172.21.15.31:0/1191680474 shutdown_connections 2023-11-27T17:54:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 --2- 172.21.15.31:0/1191680474 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe808005190 0x7fe80800b990 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 -- 172.21.15.31:0/1191680474 >> 172.21.15.31:0/1191680474 conn(0x7fe81c06ab60 msgr2=0x7fe81c0bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 -- 172.21.15.31:0/1191680474 shutdown_connections 2023-11-27T17:54:08.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 -- 172.21.15.31:0/1191680474 wait complete. 2023-11-27T17:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 Processor -- start 2023-11-27T17:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 -- start start 2023-11-27T17:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe808005190 0x7fe81c149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c14bcf0 0x7fe81c070660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe81c070ba0 0x7fe81c072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c1dc960 con 0x7fe81c070ba0 2023-11-27T17:54:08.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c1dcc40 con 0x7fe81c14bcf0 2023-11-27T17:54:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe82097b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c1dcf20 con 0x7fe808005190 2023-11-27T17:54:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81ad9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe81c070ba0 0x7fe81c072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81ad9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe81c070ba0 0x7fe81c072020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36654/0 (socket says 172.21.15.31:36654) 2023-11-27T17:54:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81ad9d640 1 -- 172.21.15.31:0/4196712823 learned_addr learned my addr 172.21.15.31:0/4196712823 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81a59c640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe808005190 0x7fe81c149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:08.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe819d9b640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c14bcf0 0x7fe81c070660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:08.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81ad9d640 1 -- 172.21.15.31:0/4196712823 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe808005190 msgr2=0x7fe81c149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:08.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81ad9d640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe808005190 0x7fe81c149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:08.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81ad9d640 1 -- 172.21.15.31:0/4196712823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c14bcf0 msgr2=0x7fe81c070660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:08.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.128+0000 7fe81ad9d640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c14bcf0 0x7fe81c070660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:08.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe81ad9d640 1 -- 172.21.15.31:0/4196712823 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c1dd200 con 0x7fe81c070ba0 2023-11-27T17:54:08.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe819d9b640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c14bcf0 0x7fe81c070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:54:08.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe81a59c640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe808005190 0x7fe81c149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:54:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe81ad9d640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe81c070ba0 0x7fe81c072020 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe8140253a0 tx=0x7fe808005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe812ffd640 1 -- 172.21.15.31:0/4196712823 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814005c50 con 0x7fe81c070ba0 2023-11-27T17:54:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe812ffd640 1 -- 172.21.15.31:0/4196712823 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe814005db0 con 0x7fe81c070ba0 2023-11-27T17:54:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe82097b640 1 -- 172.21.15.31:0/4196712823 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c14a080 con 0x7fe81c070ba0 2023-11-27T17:54:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe812ffd640 1 -- 172.21.15.31:0/4196712823 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8140072e0 con 0x7fe81c070ba0 2023-11-27T17:54:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe82097b640 1 -- 172.21.15.31:0/4196712823 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c141240 con 0x7fe81c070ba0 2023-11-27T17:54:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe82097b640 1 -- 172.21.15.31:0/4196712823 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c04e850 con 0x7fe81c070ba0 2023-11-27T17:54:08.143 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe812ffd640 1 -- 172.21.15.31:0/4196712823 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fe8140b5020 con 0x7fe81c070ba0 2023-11-27T17:54:08.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe812ffd640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fe7fc066820 0x7fe7fc068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:08.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe812ffd640 1 -- 172.21.15.31:0/4196712823 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe81411fa20 con 0x7fe81c070ba0 2023-11-27T17:54:08.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe81a59c640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fe7fc066820 0x7fe7fc068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:08.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.132+0000 7fe81a59c640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fe7fc066820 0x7fe7fc068ce0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe80c000f90 tx=0x7fe80c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:08.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.136+0000 7fe812ffd640 1 -- 172.21.15.31:0/4196712823 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fe8140ec9f0 con 0x7fe81c070ba0 2023-11-27T17:54:08.335 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:08.328+0000 7fe82097b640 1 -- 172.21.15.31:0/4196712823 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe81c1dcaa0 con 0x7fe81c070ba0 2023-11-27T17:54:09.326 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.320+0000 7fe812ffd640 1 -- 172.21.15.31:0/4196712823 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe81c1dcaa0 con 0x7fe81c070ba0 2023-11-27T17:54:09.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.324+0000 7fe82097b640 1 -- 172.21.15.31:0/4196712823 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fe7fc066820 msgr2=0x7fe7fc068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:09.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.324+0000 7fe82097b640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fe7fc066820 0x7fe7fc068ce0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe80c000f90 tx=0x7fe80c009040 comp rx=0 tx=0).stop 2023-11-27T17:54:09.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.324+0000 7fe82097b640 1 -- 172.21.15.31:0/4196712823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe81c070ba0 msgr2=0x7fe81c072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:09.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.324+0000 7fe82097b640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe81c070ba0 0x7fe81c072020 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe8140253a0 tx=0x7fe808005800 comp rx=0 tx=0).stop 2023-11-27T17:54:09.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.324+0000 7fe82097b640 1 -- 172.21.15.31:0/4196712823 shutdown_connections 2023-11-27T17:54:09.329 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.324+0000 7fe82097b640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fe7fc066820 0x7fe7fc068ce0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:09.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.324+0000 7fe82097b640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe81c070ba0 0x7fe81c072020 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:09.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.324+0000 7fe82097b640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe81c14bcf0 0x7fe81c070660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:09.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.324+0000 7fe82097b640 1 --2- 172.21.15.31:0/4196712823 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fe808005190 0x7fe81c149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:09.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.324+0000 7fe82097b640 1 -- 172.21.15.31:0/4196712823 >> 172.21.15.31:0/4196712823 conn(0x7fe81c06ab60 msgr2=0x7fe81c0b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:09.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.324+0000 7fe82097b640 1 -- 172.21.15.31:0/4196712823 shutdown_connections 2023-11-27T17:54:09.330 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.324+0000 7fe82097b640 1 -- 172.21.15.31:0/4196712823 wait complete. 2023-11-27T17:54:09.349 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-27T17:54:09.350 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-27T17:54:09.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6c1a65640 1 Processor -- start 2023-11-27T17:54:09.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6c1a65640 1 -- start start 2023-11-27T17:54:09.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6c1a65640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa6bc06ab40 0x7fa6bc14b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:09.482 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6c1a65640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6bc14bb90 0x7fa6bc0a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6c1a65640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa6bc0a6630 0x7fa6bc14eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6c1a65640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6bc14bff0 con 0x7fa6bc0a6630 2023-11-27T17:54:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6c1a65640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6bc0bd250 con 0x7fa6bc06ab40 2023-11-27T17:54:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6c1a65640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0c0190 con 0x7fa6bc14bb90 2023-11-27T17:54:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6bbfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa6bc0a6630 0x7fa6bc14eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6bbfff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa6bc0a6630 0x7fa6bc14eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36656/0 (socket says 172.21.15.31:36656) 2023-11-27T17:54:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6bbfff640 1 -- 172.21.15.31:0/795916292 learned_addr learned my addr 172.21.15.31:0/795916292 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6bb7fe640 1 --2- 172.21.15.31:0/795916292 >> v2:172.21.15.81:3300/0 conn(0x7fa6bc06ab40 0x7fa6bc14b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6bbfff640 1 -- 172.21.15.31:0/795916292 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6bc14bb90 msgr2=0x7fa6bc0a60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6b3fff640 1 --2- 172.21.15.31:0/795916292 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6bc14bb90 0x7fa6bc0a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6bbfff640 1 --2- 172.21.15.31:0/795916292 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6bc14bb90 0x7fa6bc0a60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:09.483 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6bbfff640 1 -- 172.21.15.31:0/795916292 >> v2:172.21.15.81:3300/0 conn(0x7fa6bc06ab40 msgr2=0x7fa6bc14b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:09.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6bbfff640 1 --2- 172.21.15.31:0/795916292 >> v2:172.21.15.81:3300/0 conn(0x7fa6bc06ab40 0x7fa6bc14b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:09.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6bbfff640 1 -- 172.21.15.31:0/795916292 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc0c0430 con 0x7fa6bc0a6630 2023-11-27T17:54:09.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6bb7fe640 1 --2- 172.21.15.31:0/795916292 >> v2:172.21.15.81:3300/0 conn(0x7fa6bc06ab40 0x7fa6bc14b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:09.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.476+0000 7fa6b3fff640 1 --2- 172.21.15.31:0/795916292 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6bc14bb90 0x7fa6bc0a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:09.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6bbfff640 1 --2- 172.21.15.31:0/795916292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6bc0a6630 0x7fa6bc14eba0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc072b60 tx=0x7fa6b401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c323649784bfe61 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:09.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6baffd640 1 -- 172.21.15.31:0/795916292 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40af400 con 0x7fa6bc0a6630 2023-11-27T17:54:09.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6baffd640 1 -- 172.21.15.31:0/795916292 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b40ab050 con 0x7fa6bc0a6630 2023-11-27T17:54:09.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6baffd640 1 -- 172.21.15.31:0/795916292 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40af780 con 0x7fa6bc0a6630 2023-11-27T17:54:09.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 -- 172.21.15.31:0/795916292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6bc0a6630 msgr2=0x7fa6bc14eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:09.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 --2- 172.21.15.31:0/795916292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6bc0a6630 0x7fa6bc14eba0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc072b60 tx=0x7fa6b401f1c0 comp rx=0 tx=0).stop 2023-11-27T17:54:09.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 -- 172.21.15.31:0/795916292 shutdown_connections 2023-11-27T17:54:09.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 --2- 172.21.15.31:0/795916292 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6bc0a6630 0x7fa6bc14eba0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:09.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 --2- 172.21.15.31:0/795916292 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6bc14bb90 0x7fa6bc0a60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:09.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 --2- 172.21.15.31:0/795916292 >> v2:172.21.15.81:3300/0 conn(0x7fa6bc06ab40 0x7fa6bc14b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:09.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 -- 172.21.15.31:0/795916292 >> 172.21.15.31:0/795916292 conn(0x7fa6bc0c0cd0 msgr2=0x7fa6bc0c10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:09.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 -- 172.21.15.31:0/795916292 shutdown_connections 2023-11-27T17:54:09.486 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 -- 172.21.15.31:0/795916292 wait complete. 2023-11-27T17:54:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 Processor -- start 2023-11-27T17:54:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 -- start start 2023-11-27T17:54:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6bc06ab40 0x7fa6bc14ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6bc0a6630 0x7fa6bc0b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc14bb90 0x7fa6bc0b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc14b250 con 0x7fa6bc06ab40 2023-11-27T17:54:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0b3cf0 con 0x7fa6bc14bb90 2023-11-27T17:54:09.489 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6c1a65640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc0b7150 con 0x7fa6bc0a6630 2023-11-27T17:54:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6bb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6bc06ab40 0x7fa6bc14ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6bb7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6bc06ab40 0x7fa6bc14ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36672/0 (socket says 172.21.15.31:36672) 2023-11-27T17:54:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6bb7fe640 1 -- 172.21.15.31:0/1940410343 learned_addr learned my addr 172.21.15.31:0/1940410343 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6b3fff640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6bc0a6630 0x7fa6bc0b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6bbfff640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc14bb90 0x7fa6bc0b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6bb7fe640 1 -- 172.21.15.31:0/1940410343 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6bc0a6630 msgr2=0x7fa6bc0b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6bb7fe640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6bc0a6630 0x7fa6bc0b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:09.490 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6bb7fe640 1 -- 172.21.15.31:0/1940410343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc14bb90 msgr2=0x7fa6bc0b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6bb7fe640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc14bb90 0x7fa6bc0b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6bb7fe640 1 -- 172.21.15.31:0/1940410343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b4009b30 con 0x7fa6bc06ab40 2023-11-27T17:54:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6bb7fe640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6bc06ab40 0x7fa6bc14ad10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00c7f0 tx=0x7fa6ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6b8ff9640 1 -- 172.21.15.31:0/1940410343 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac007820 con 0x7fa6bc06ab40 2023-11-27T17:54:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.480+0000 7fa6b8ff9640 1 -- 172.21.15.31:0/1940410343 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac007980 con 0x7fa6bc06ab40 2023-11-27T17:54:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.484+0000 7fa6c1a65640 1 -- 172.21.15.31:0/1940410343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6bc149140 con 0x7fa6bc06ab40 2023-11-27T17:54:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.484+0000 7fa6b8ff9640 1 -- 172.21.15.31:0/1940410343 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac007d30 con 0x7fa6bc06ab40 2023-11-27T17:54:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.484+0000 7fa6c1a65640 1 -- 172.21.15.31:0/1940410343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6bc0b5290 con 0x7fa6bc06ab40 2023-11-27T17:54:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.484+0000 7fa6c1a65640 1 -- 172.21.15.31:0/1940410343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6bc04e850 con 0x7fa6bc06ab40 2023-11-27T17:54:09.491 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.484+0000 7fa6b8ff9640 1 -- 172.21.15.31:0/1940410343 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa6ac0113f0 con 0x7fa6bc06ab40 2023-11-27T17:54:09.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.484+0000 7fa6b8ff9640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa69c0667f0 0x7fa69c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:09.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.484+0000 7fa6b3fff640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa69c0667f0 0x7fa69c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:09.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.484+0000 7fa6b8ff9640 1 -- 172.21.15.31:0/1940410343 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6ac084370 con 0x7fa6bc06ab40 2023-11-27T17:54:09.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.484+0000 7fa6b3fff640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa69c0667f0 0x7fa69c068cb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0bb500 tx=0x7fa6a4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:09.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.488+0000 7fa6b8ff9640 1 -- 172.21.15.31:0/1940410343 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa6ac051470 con 0x7fa6bc06ab40 2023-11-27T17:54:09.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:09.676+0000 7fa6c1a65640 1 -- 172.21.15.31:0/1940410343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa6bc0a00b0 con 0x7fa6bc06ab40 2023-11-27T17:54:10.337 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.332+0000 7fa6b8ff9640 1 -- 172.21.15.31:0/1940410343 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa6ac054a90 con 0x7fa6bc06ab40 2023-11-27T17:54:10.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.336+0000 7fa6c1a65640 1 -- 172.21.15.31:0/1940410343 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa69c0667f0 msgr2=0x7fa69c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:10.341 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.336+0000 7fa6c1a65640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa69c0667f0 0x7fa69c068cb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0bb500 tx=0x7fa6a4008040 comp rx=0 tx=0).stop 2023-11-27T17:54:10.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.336+0000 7fa6c1a65640 1 -- 172.21.15.31:0/1940410343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6bc06ab40 msgr2=0x7fa6bc14ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:10.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.336+0000 7fa6c1a65640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6bc06ab40 0x7fa6bc14ad10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00c7f0 tx=0x7fa6ac00ccb0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.336+0000 7fa6c1a65640 1 -- 172.21.15.31:0/1940410343 shutdown_connections 2023-11-27T17:54:10.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.336+0000 7fa6c1a65640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa69c0667f0 0x7fa69c068cb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.336+0000 7fa6c1a65640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6bc14bb90 0x7fa6bc0b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.342 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.336+0000 7fa6c1a65640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6bc0a6630 0x7fa6bc0b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.336+0000 7fa6c1a65640 1 --2- 172.21.15.31:0/1940410343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6bc06ab40 0x7fa6bc14ad10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.336+0000 7fa6c1a65640 1 -- 172.21.15.31:0/1940410343 >> 172.21.15.31:0/1940410343 conn(0x7fa6bc0c0cd0 msgr2=0x7fa6bc0a46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.336+0000 7fa6c1a65640 1 -- 172.21.15.31:0/1940410343 shutdown_connections 2023-11-27T17:54:10.343 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.336+0000 7fa6c1a65640 1 -- 172.21.15.31:0/1940410343 wait complete. 2023-11-27T17:54:10.366 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-27T17:54:10.366 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:54:10.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.488+0000 7f645520f640 1 Processor -- start 2023-11-27T17:54:10.495 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.488+0000 7f645520f640 1 -- start start 2023-11-27T17:54:10.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64500b6960 0x7f64500bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f645014f240 0x7f6450155c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64500b2ca0 con 0x7f64500b2300 2023-11-27T17:54:10.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64500b2f80 con 0x7f645014f240 2023-11-27T17:54:10.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64500b3260 con 0x7f64500b6960 2023-11-27T17:54:10.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644f59e640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f645014f240 0x7f6450155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644e59c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f64500b2300 0x7f645014eb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53940/0 (socket says 172.21.15.31:53940) 2023-11-27T17:54:10.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644e59c640 1 -- 172.21.15.31:0/1257362022 learned_addr learned my addr 172.21.15.31:0/1257362022 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:10.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644ed9d640 1 --2- 172.21.15.31:0/1257362022 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64500b6960 0x7f64500bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644f59e640 1 -- 172.21.15.31:0/1257362022 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64500b6960 msgr2=0x7f64500bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:10.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644f59e640 1 --2- 172.21.15.31:0/1257362022 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64500b6960 0x7f64500bd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644f59e640 1 -- 172.21.15.31:0/1257362022 >> v1:172.21.15.31:6789/0 conn(0x7f64500b2300 legacy=0x7f645014eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:10.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644f59e640 1 -- 172.21.15.31:0/1257362022 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64500b3540 con 0x7f645014f240 2023-11-27T17:54:10.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644ed9d640 1 --2- 172.21.15.31:0/1257362022 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64500b6960 0x7f64500bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:10.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644f59e640 1 --2- 172.21.15.31:0/1257362022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f645014f240 0x7f6450155c50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6448009d90 tx=0x7f644801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2eaf6a5d45048e server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:10.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644dd9b640 1 -- 172.21.15.31:0/1257362022 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64480af600 con 0x7f645014f240 2023-11-27T17:54:10.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644dd9b640 1 -- 172.21.15.31:0/1257362022 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64480ab050 con 0x7f645014f240 2023-11-27T17:54:10.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f644dd9b640 1 -- 172.21.15.31:0/1257362022 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64480af980 con 0x7f645014f240 2023-11-27T17:54:10.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 -- 172.21.15.31:0/1257362022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f645014f240 msgr2=0x7f6450155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:10.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 --2- 172.21.15.31:0/1257362022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f645014f240 0x7f6450155c50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6448009d90 tx=0x7f644801f130 comp rx=0 tx=0).stop 2023-11-27T17:54:10.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 -- 172.21.15.31:0/1257362022 shutdown_connections 2023-11-27T17:54:10.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 --2- 172.21.15.31:0/1257362022 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f645014f240 0x7f6450155c50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 --2- 172.21.15.31:0/1257362022 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f64500b6960 0x7f64500bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 -- 172.21.15.31:0/1257362022 >> 172.21.15.31:0/1257362022 conn(0x7f645006ab60 msgr2=0x7f64500bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:10.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 -- 172.21.15.31:0/1257362022 shutdown_connections 2023-11-27T17:54:10.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.492+0000 7f645520f640 1 -- 172.21.15.31:0/1257362022 wait complete. 2023-11-27T17:54:10.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f645520f640 1 Processor -- start 2023-11-27T17:54:10.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f645520f640 1 -- start start 2023-11-27T17:54:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f645520f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64500b6960 0x7f64501433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f645520f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f645014f240 0x7f645014a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f645520f640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f645014a8e0 0x7f645014b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f645520f640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64501438f0 con 0x7f645014f240 2023-11-27T17:54:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f645520f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6450140330 con 0x7f64500b6960 2023-11-27T17:54:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f645520f640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6450149180 con 0x7f645014a8e0 2023-11-27T17:54:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f644e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f645014f240 0x7f645014a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f644e59c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f645014f240 0x7f645014a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36692/0 (socket says 172.21.15.31:36692) 2023-11-27T17:54:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f644e59c640 1 -- 172.21.15.31:0/2610215969 learned_addr learned my addr 172.21.15.31:0/2610215969 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f644ed9d640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64500b6960 0x7f64501433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f644f59e640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f645014a8e0 0x7f645014b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f644e59c640 1 -- 172.21.15.31:0/2610215969 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f645014a8e0 msgr2=0x7f645014b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f644e59c640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f645014a8e0 0x7f645014b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f644e59c640 1 -- 172.21.15.31:0/2610215969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64500b6960 msgr2=0x7f64501433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f644e59c640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64500b6960 0x7f64501433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f644e59c640 1 -- 172.21.15.31:0/2610215969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6448009a70 con 0x7f645014f240 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f644f59e640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f645014a8e0 0x7f645014b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f644e59c640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f645014f240 0x7f645014a3a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f644000c430 tx=0x7f644000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f64377fe640 1 -- 172.21.15.31:0/2610215969 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440005cf0 con 0x7f645014f240 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f64377fe640 1 -- 172.21.15.31:0/2610215969 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6440005e50 con 0x7f645014f240 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f645520f640 1 -- 172.21.15.31:0/2610215969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6450149eb0 con 0x7f645014f240 2023-11-27T17:54:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f64377fe640 1 -- 172.21.15.31:0/2610215969 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64400072d0 con 0x7f645014f240 2023-11-27T17:54:10.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f645520f640 1 -- 172.21.15.31:0/2610215969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64501496b0 con 0x7f645014f240 2023-11-27T17:54:10.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f645520f640 1 -- 172.21.15.31:0/2610215969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645004e850 con 0x7f645014f240 2023-11-27T17:54:10.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.496+0000 7f64377fe640 1 -- 172.21.15.31:0/2610215969 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f6440007430 con 0x7f645014f240 2023-11-27T17:54:10.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.500+0000 7f64377fe640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f643c0667f0 0x7f643c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.500+0000 7f64377fe640 1 -- 172.21.15.31:0/2610215969 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6440083ac0 con 0x7f645014f240 2023-11-27T17:54:10.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.500+0000 7f644ed9d640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f643c0667f0 0x7f643c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.500+0000 7f644ed9d640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f643c0667f0 0x7f643c068cb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6444006fd0 tx=0x7f6444008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:10.507 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.504+0000 7f64377fe640 1 -- 172.21.15.31:0/2610215969 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f6440050de0 con 0x7f645014f240 2023-11-27T17:54:10.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 -- 172.21.15.31:0/2610215969 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64500b9000 con 0x7f645014f240 2023-11-27T17:54:10.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f64377fe640 1 -- 172.21.15.31:0/2610215969 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4119 (secure 0 0 0) 0x7f6440054400 con 0x7f645014f240 2023-11-27T17:54:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:10.697 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/796467990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":796467990},{"type":"v1","addr":"172.21.15.31:6835","nonce":796467990}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4643,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2310489573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2310489573},{"type":"v1","addr":"172.21.15.81:6833","nonce":2310489573}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:54:06.648311+0000","modified":"2023-11-27T17:54:09.683325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6837/1057720964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":1057720964},{"type":"v1","addr":"172.21.15.31:6837","nonce":1057720964}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-27T17:54:10.697 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 14 2023-11-27T17:54:10.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 -- 172.21.15.31:0/2610215969 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f643c0667f0 msgr2=0x7f643c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:10.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f643c0667f0 0x7f643c068cb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6444006fd0 tx=0x7f6444008040 comp rx=0 tx=0).stop 2023-11-27T17:54:10.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 -- 172.21.15.31:0/2610215969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f645014f240 msgr2=0x7f645014a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:10.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f645014f240 0x7f645014a3a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f644000c430 tx=0x7f644000c8f0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 -- 172.21.15.31:0/2610215969 shutdown_connections 2023-11-27T17:54:10.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f643c0667f0 0x7f643c068cb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f645014a8e0 0x7f645014b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f645014f240 0x7f645014a3a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 --2- 172.21.15.31:0/2610215969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64500b6960 0x7f64501433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 -- 172.21.15.31:0/2610215969 >> 172.21.15.31:0/2610215969 conn(0x7f645006ab60 msgr2=0x7f64500b8310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:10.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 -- 172.21.15.31:0/2610215969 shutdown_connections 2023-11-27T17:54:10.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.692+0000 7f645520f640 1 -- 172.21.15.31:0/2610215969 wait complete. 2023-11-27T17:54:10.717 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-27T17:54:10.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.824+0000 7f7a7d550640 1 Processor -- start 2023-11-27T17:54:10.831 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.824+0000 7f7a7d550640 1 -- start start 2023-11-27T17:54:10.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a7d550640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7a780b7480 0x7f7a7814e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a7d550640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a780b5fd0 0x7f7a7814eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a7d550640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a78145ad0 con 0x7f7a781456f0 2023-11-27T17:54:10.832 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a7d550640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a780bbcf0 con 0x7f7a780b7480 2023-11-27T17:54:10.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a7d550640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780b66c0 con 0x7f7a780b5fd0 2023-11-27T17:54:10.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a76ffd640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7a781456f0 0x7f7a780bb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53950/0 (socket says 172.21.15.31:53950) 2023-11-27T17:54:10.833 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a76ffd640 1 -- 172.21.15.31:0/3526806326 learned_addr learned my addr 172.21.15.31:0/3526806326 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:10.834 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606596139 0 0) 0x7f7a78145ad0 con 0x7f7a781456f0 2023-11-27T17:54:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a64003530 con 0x7f7a781456f0 2023-11-27T17:54:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a767fc640 1 --2- 172.21.15.31:0/3526806326 >> v2:172.21.15.81:3300/0 conn(0x7f7a780b7480 0x7f7a7814e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a777fe640 1 --2- 172.21.15.31:0/3526806326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a780b5fd0 0x7f7a7814eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3889096672 0 0) 0x7f7a64003530 con 0x7f7a781456f0 2023-11-27T17:54:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a780b5fd0 msgr2=0x7f7a7814eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 --2- 172.21.15.31:0/3526806326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a780b5fd0 0x7f7a7814eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 >> v2:172.21.15.81:3300/0 conn(0x7f7a780b7480 msgr2=0x7f7a7814e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 --2- 172.21.15.31:0/3526806326 >> v2:172.21.15.81:3300/0 conn(0x7f7a780b7480 0x7f7a7814e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a780b69a0 con 0x7f7a781456f0 2023-11-27T17:54:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f7a68001a00 con 0x7f7a781456f0 2023-11-27T17:54:10.835 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 >> v1:172.21.15.31:6789/0 conn(0x7f7a781456f0 legacy=0x7f7a780bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 --2- 172.21.15.31:0/3526806326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a780b5fd0 0x7f7a640039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 --2- 172.21.15.31:0/3526806326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a64003f70 0x7f7a640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 --2- 172.21.15.31:0/3526806326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a64004d10 0x7f7a64005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780bbcf0 con 0x7f7a64004d10 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780b66c0 con 0x7f7a64003f70 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6400b9c0 con 0x7f7a780b5fd0 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a777fe640 1 --2- 172.21.15.31:0/3526806326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a64004d10 0x7f7a64005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a76ffd640 1 --2- 172.21.15.31:0/3526806326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a780b5fd0 0x7f7a640039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a777fe640 1 -- 172.21.15.31:0/3526806326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a780b5fd0 msgr2=0x7f7a640039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a777fe640 1 --2- 172.21.15.31:0/3526806326 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a780b5fd0 0x7f7a640039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a767fc640 1 --2- 172.21.15.31:0/3526806326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a64003f70 0x7f7a640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a777fe640 1 -- 172.21.15.31:0/3526806326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a64003f70 msgr2=0x7f7a640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:10.836 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a777fe640 1 --2- 172.21.15.31:0/3526806326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a64003f70 0x7f7a640047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.837 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.828+0000 7f7a777fe640 1 -- 172.21.15.31:0/3526806326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a64003530 con 0x7f7a64004d10 2023-11-27T17:54:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a777fe640 1 --2- 172.21.15.31:0/3526806326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a64004d10 0x7f7a64005190 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7a780b63e0 tx=0x7f7a7001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e24e26cb6999ef server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a700a55e0 con 0x7f7a64004d10 2023-11-27T17:54:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a700a5740 con 0x7f7a64004d10 2023-11-27T17:54:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a75ffb640 1 -- 172.21.15.31:0/3526806326 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a700a5af0 con 0x7f7a64004d10 2023-11-27T17:54:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 -- 172.21.15.31:0/3526806326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a64004d10 msgr2=0x7f7a64005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 --2- 172.21.15.31:0/3526806326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a64004d10 0x7f7a64005190 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7a780b63e0 tx=0x7f7a7001c9f0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a777fe640 1 -- 172.21.15.31:0/3526806326 reap_dead start 2023-11-27T17:54:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 -- 172.21.15.31:0/3526806326 shutdown_connections 2023-11-27T17:54:10.838 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 -- 172.21.15.31:0/3526806326 >> 172.21.15.31:0/3526806326 conn(0x7f7a780bd6e0 msgr2=0x7f7a780bdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:10.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 -- 172.21.15.31:0/3526806326 shutdown_connections 2023-11-27T17:54:10.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 -- 172.21.15.31:0/3526806326 wait complete. 2023-11-27T17:54:10.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 Processor -- start 2023-11-27T17:54:10.839 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 -- start start 2023-11-27T17:54:10.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a7814dc90 0x7f7a781e4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a781d45b0 0x7f7a7813cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780ba990 0x7f7a7813d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7813d9b0 con 0x7f7a781d45b0 2023-11-27T17:54:10.840 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a781d6a10 con 0x7f7a780ba990 2023-11-27T17:54:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a781d5630 con 0x7f7a7814dc90 2023-11-27T17:54:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a767fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a781d45b0 0x7f7a7813cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a767fc640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a781d45b0 0x7f7a7813cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36708/0 (socket says 172.21.15.31:36708) 2023-11-27T17:54:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a767fc640 1 -- 172.21.15.31:0/449785138 learned_addr learned my addr 172.21.15.31:0/449785138 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a777fe640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780ba990 0x7f7a7813d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a767fc640 1 -- 172.21.15.31:0/449785138 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a7814dc90 msgr2=0x7f7a781e4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a76ffd640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a7814dc90 0x7f7a781e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a767fc640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a7814dc90 0x7f7a781e4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a767fc640 1 -- 172.21.15.31:0/449785138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780ba990 msgr2=0x7f7a7813d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a767fc640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780ba990 0x7f7a7813d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a767fc640 1 -- 172.21.15.31:0/449785138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a781d4a90 con 0x7f7a781d45b0 2023-11-27T17:54:10.841 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a767fc640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a781d45b0 0x7f7a7813cf30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7a60010900 tx=0x7f7a60010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:10.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a6f7fe640 1 -- 172.21.15.31:0/449785138 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a600096b0 con 0x7f7a781d45b0 2023-11-27T17:54:10.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a6f7fe640 1 -- 172.21.15.31:0/449785138 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6000ec20 con 0x7f7a781d45b0 2023-11-27T17:54:10.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a6f7fe640 1 -- 172.21.15.31:0/449785138 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6001c400 con 0x7f7a781d45b0 2023-11-27T17:54:10.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 -- 172.21.15.31:0/449785138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a781d4fe0 con 0x7f7a781d45b0 2023-11-27T17:54:10.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.832+0000 7f7a7d550640 1 -- 172.21.15.31:0/449785138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7814e070 con 0x7f7a781d45b0 2023-11-27T17:54:10.842 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.836+0000 7f7a7d550640 1 -- 172.21.15.31:0/449785138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a78066f60 con 0x7f7a781d45b0 2023-11-27T17:54:10.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.836+0000 7f7a6f7fe640 1 -- 172.21.15.31:0/449785138 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f7a6001c560 con 0x7f7a781d45b0 2023-11-27T17:54:10.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.836+0000 7f7a6f7fe640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7a58066820 0x7f7a58068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:10.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.836+0000 7f7a6f7fe640 1 -- 172.21.15.31:0/449785138 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a600847d0 con 0x7f7a781d45b0 2023-11-27T17:54:10.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.836+0000 7f7a76ffd640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7a58066820 0x7f7a58068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:10.843 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.836+0000 7f7a76ffd640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7a58066820 0x7f7a58068ce0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a680013e0 tx=0x7f7a68001ba0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:10.845 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.840+0000 7f7a6f7fe640 1 -- 172.21.15.31:0/449785138 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f7a60051a10 con 0x7f7a781d45b0 2023-11-27T17:54:10.999 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.992+0000 7f7a7d550640 1 -- 172.21.15.31:0/449785138 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a781d57a0 con 0x7f7a781d45b0 2023-11-27T17:54:11.001 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:10.996+0000 7f7a6f7fe640 1 -- 172.21.15.31:0/449785138 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16498 (secure 0 0 0) 0x7f7a60055030 con 0x7f7a781d45b0 2023-11-27T17:54:11.002 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:11.002 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":30,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","created":"2023-11-27T17:52:58.164307+0000","modified":"2023-11-27T17:54:08.319246+0000","last_up_change":"2023-11-27T17:53:10.492470+0000","last_in_change":"2023-11-27T17:53:01.135708+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-27T17:53:11.177026+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-27T17:54:05.136152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-27T17:54:05.648250+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2d3cc2c7-687c-403a-bf6f-08af9df079f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6801","nonce":87696833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6803","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6805","nonce":87696833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6811","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6813","nonce":87696833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6807","nonce":87696833},{"type":"v1","addr":"172.21.15.31:6809","nonce":87696833}]},"public_addr":"172.21.15.31:6801/87696833","cluster_addr":"172.21.15.31:6805/87696833","heartbeat_back_addr":"172.21.15.31:6813/87696833","heartbeat_front_addr":"172.21.15.31:6809/87696833","state":["exists","up"]},{"osd":1,"uuid":"bcd0d342-9cd2-4cf0-9fdf-b43efc03ddb4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6817","nonce":2443446215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6819","nonce":2443446215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6823","nonce":2443446215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2443446215},{"type":"v1","addr":"172.21.15.31:6821","nonce":2443446215}]},"public_addr":"172.21.15.31:6817/2443446215","cluster_addr":"172.21.15.31:6819/2443446215","heartbeat_back_addr":"172.21.15.31:6823/2443446215","heartbeat_front_addr":"172.21.15.31:6821/2443446215","state":["exists","up"]},{"osd":2,"uuid":"29da069a-fe83-4334-9c3d-480084a05f9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6804","nonce":2804285075}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6808","nonce":2804285075}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6814","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6815","nonce":2804285075}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6810","nonce":2804285075},{"type":"v1","addr":"172.21.15.31:6812","nonce":2804285075}]},"public_addr":"172.21.15.31:6804/2804285075","cluster_addr":"172.21.15.31:6808/2804285075","heartbeat_back_addr":"172.21.15.31:6815/2804285075","heartbeat_front_addr":"172.21.15.31:6812/2804285075","state":["exists","up"]},{"osd":3,"uuid":"399a48bb-57ca-4f1a-b64c-23abea9d7695","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6825","nonce":1572841372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6827","nonce":1572841372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6831","nonce":1572841372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":1572841372},{"type":"v1","addr":"172.21.15.31:6829","nonce":1572841372}]},"public_addr":"172.21.15.31:6825/1572841372","cluster_addr":"172.21.15.31:6827/1572841372","heartbeat_back_addr":"172.21.15.31:6831/1572841372","heartbeat_front_addr":"172.21.15.31:6829/1572841372","state":["exists","up"]},{"osd":4,"uuid":"598af3bc-e276-4309-9117-d294c77c3f32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6817","nonce":4034202684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6819","nonce":4034202684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6823","nonce":4034202684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":4034202684},{"type":"v1","addr":"172.21.15.81:6821","nonce":4034202684}]},"public_addr":"172.21.15.81:6817/4034202684","cluster_addr":"172.21.15.81:6819/4034202684","heartbeat_back_addr":"172.21.15.81:6823/4034202684","heartbeat_front_addr":"172.21.15.81:6821/4034202684","state":["exists","up"]},{"osd":5,"uuid":"89174e5a-ed25-48f4-8ba3-2cb3fd77c2eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6809","nonce":691520267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6811","nonce":691520267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6815","nonce":691520267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":691520267},{"type":"v1","addr":"172.21.15.81:6813","nonce":691520267}]},"public_addr":"172.21.15.81:6809/691520267","cluster_addr":"172.21.15.81:6811/691520267","heartbeat_back_addr":"172.21.15.81:6815/691520267","heartbeat_front_addr":"172.21.15.81:6813/691520267","state":["exists","up"]},{"osd":6,"uuid":"64a9670c-d12b-4ac6-ad52-bc3a5c11fa1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6825","nonce":1518266559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6827","nonce":1518266559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6831","nonce":1518266559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":1518266559},{"type":"v1","addr":"172.21.15.81:6829","nonce":1518266559}]},"public_addr":"172.21.15.81:6825/1518266559","cluster_addr":"172.21.15.81:6827/1518266559","heartbeat_back_addr":"172.21.15.81:6831/1518266559","heartbeat_front_addr":"172.21.15.81:6829/1518266559","state":["exists","up"]},{"osd":7,"uuid":"8a325db0-aedb-4f23-904a-e2c8ee9b9698","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6801","nonce":1833955858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6803","nonce":1833955858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6807","nonce":1833955858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":1833955858},{"type":"v1","addr":"172.21.15.81:6805","nonce":1833955858}]},"public_addr":"172.21.15.81:6801/1833955858","cluster_addr":"172.21.15.81:6803/1833955858","heartbeat_back_addr":"172.21.15.81:6807/1833955858","heartbeat_front_addr":"172.21.15.81:6805/1833955858","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.568034+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.653212+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.703779+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.812399+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.748502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.666755+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.681060+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2023-11-27T17:53:06.547936+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-27T17:54:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.000+0000 7f7a7d550640 1 -- 172.21.15.31:0/449785138 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7a58066820 msgr2=0x7f7a58068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.000+0000 7f7a7d550640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7a58066820 0x7f7a58068ce0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a680013e0 tx=0x7f7a68001ba0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.000+0000 7f7a7d550640 1 -- 172.21.15.31:0/449785138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a781d45b0 msgr2=0x7f7a7813cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.000+0000 7f7a7d550640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a781d45b0 0x7f7a7813cf30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7a60010900 tx=0x7f7a60010dc0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.000+0000 7f7a7d550640 1 -- 172.21.15.31:0/449785138 shutdown_connections 2023-11-27T17:54:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.000+0000 7f7a7d550640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f7a58066820 0x7f7a58068ce0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.000+0000 7f7a7d550640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7a780ba990 0x7f7a7813d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.000+0000 7f7a7d550640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a781d45b0 0x7f7a7813cf30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.000+0000 7f7a7d550640 1 --2- 172.21.15.31:0/449785138 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f7a7814dc90 0x7f7a781e4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.000+0000 7f7a7d550640 1 -- 172.21.15.31:0/449785138 >> 172.21.15.31:0/449785138 conn(0x7f7a780bd6e0 msgr2=0x7f7a781408d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.000+0000 7f7a7d550640 1 -- 172.21.15.31:0/449785138 shutdown_connections 2023-11-27T17:54:11.004 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.000+0000 7f7a7d550640 1 -- 172.21.15.31:0/449785138 wait complete. 2023-11-27T17:54:11.019 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-27T17:54:11.020 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:54:11.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.124+0000 7f04594d3640 1 Processor -- start 2023-11-27T17:54:11.131 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.124+0000 7f04594d3640 1 -- start start 2023-11-27T17:54:11.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f04594d3640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04541418e0 0x7f04540b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f04594d3640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04540b5880 con 0x7f0454072510 2023-11-27T17:54:11.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f04594d3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04540b6100 con 0x7f0454141cc0 2023-11-27T17:54:11.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f04594d3640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04540b6ff0 con 0x7f04541418e0 2023-11-27T17:54:11.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f0452ffd640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04541418e0 0x7f04540b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f04537fe640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0454072510 0x7f045414ad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53966/0 (socket says 172.21.15.31:53966) 2023-11-27T17:54:11.132 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f04537fe640 1 -- 172.21.15.31:0/2552021226 learned_addr learned my addr 172.21.15.31:0/2552021226 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:11.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f0451ffb640 1 -- 172.21.15.31:0/2552021226 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697413228 0 0) 0x7f04540b5880 con 0x7f0454072510 2023-11-27T17:54:11.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f0451ffb640 1 -- 172.21.15.31:0/2552021226 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0440005740 con 0x7f0454072510 2023-11-27T17:54:11.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f0452ffd640 1 -- 172.21.15.31:0/2552021226 >> v1:172.21.15.81:6789/0 conn(0x7f0454141cc0 legacy=0x7f04540b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:11.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f0452ffd640 1 -- 172.21.15.31:0/2552021226 >> v1:172.21.15.31:6789/0 conn(0x7f0454072510 legacy=0x7f045414ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.133 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f0452ffd640 1 -- 172.21.15.31:0/2552021226 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540b6590 con 0x7f04541418e0 2023-11-27T17:54:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f0452ffd640 1 --2- 172.21.15.31:0/2552021226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04541418e0 0x7f04540b38f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f044c0097c0 tx=0x7f044c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f512650b425ffd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f0451ffb640 1 -- 172.21.15.31:0/2552021226 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0a8930 con 0x7f04541418e0 2023-11-27T17:54:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f0451ffb640 1 -- 172.21.15.31:0/2552021226 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c0a8a90 con 0x7f04541418e0 2023-11-27T17:54:11.135 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.128+0000 7f0451ffb640 1 -- 172.21.15.31:0/2552021226 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0a8e00 con 0x7f04541418e0 2023-11-27T17:54:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 -- 172.21.15.31:0/2552021226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04541418e0 msgr2=0x7f04540b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 --2- 172.21.15.31:0/2552021226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04541418e0 0x7f04540b38f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f044c0097c0 tx=0x7f044c01ec30 comp rx=0 tx=0).stop 2023-11-27T17:54:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 -- 172.21.15.31:0/2552021226 shutdown_connections 2023-11-27T17:54:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 --2- 172.21.15.31:0/2552021226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04541418e0 0x7f04540b38f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 -- 172.21.15.31:0/2552021226 >> 172.21.15.31:0/2552021226 conn(0x7f045406ab60 msgr2=0x7f04540bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 -- 172.21.15.31:0/2552021226 shutdown_connections 2023-11-27T17:54:11.136 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 -- 172.21.15.31:0/2552021226 wait complete. 2023-11-27T17:54:11.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 Processor -- start 2023-11-27T17:54:11.137 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 -- start start 2023-11-27T17:54:11.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0454072510 0x7f04540710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f04541418e0 0x7f045413fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0454141cc0 0x7f0454140380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0454071d00 con 0x7f0454072510 2023-11-27T17:54:11.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0454071620 con 0x7f0454141cc0 2023-11-27T17:54:11.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0454071990 con 0x7f04541418e0 2023-11-27T17:54:11.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f0452ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0454072510 0x7f04540710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f0452ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0454072510 0x7f04540710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36724/0 (socket says 172.21.15.31:36724) 2023-11-27T17:54:11.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f0452ffd640 1 -- 172.21.15.31:0/877537345 learned_addr learned my addr 172.21.15.31:0/877537345 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:11.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04537fe640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0454141cc0 0x7f0454140380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04527fc640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f04541418e0 0x7f045413fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.139 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f0452ffd640 1 -- 172.21.15.31:0/877537345 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f04541418e0 msgr2=0x7f045413fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f0452ffd640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f04541418e0 0x7f045413fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f0452ffd640 1 -- 172.21.15.31:0/877537345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0454141cc0 msgr2=0x7f0454140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f0452ffd640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0454141cc0 0x7f0454140380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f0452ffd640 1 -- 172.21.15.31:0/877537345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c009420 con 0x7f0454072510 2023-11-27T17:54:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04527fc640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f04541418e0 0x7f045413fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f0452ffd640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0454072510 0x7f04540710e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f044c01b840 tx=0x7f044c01b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f044b7fe640 1 -- 172.21.15.31:0/877537345 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0c0070 con 0x7f0454072510 2023-11-27T17:54:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f044b7fe640 1 -- 172.21.15.31:0/877537345 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c0b1be0 con 0x7f0454072510 2023-11-27T17:54:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 -- 172.21.15.31:0/877537345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0454148760 con 0x7f0454072510 2023-11-27T17:54:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f044b7fe640 1 -- 172.21.15.31:0/877537345 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0b9410 con 0x7f0454072510 2023-11-27T17:54:11.140 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.132+0000 7f04594d3640 1 -- 172.21.15.31:0/877537345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0454148110 con 0x7f0454072510 2023-11-27T17:54:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.136+0000 7f04594d3640 1 -- 172.21.15.31:0/877537345 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045404e850 con 0x7f0454072510 2023-11-27T17:54:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.136+0000 7f044b7fe640 1 -- 172.21.15.31:0/877537345 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f044c0b7040 con 0x7f0454072510 2023-11-27T17:54:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.136+0000 7f044b7fe640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0434066820 0x7f0434068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.141 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.136+0000 7f044b7fe640 1 -- 172.21.15.31:0/877537345 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f044c121640 con 0x7f0454072510 2023-11-27T17:54:11.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.136+0000 7f04527fc640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0434066820 0x7f0434068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.142 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.136+0000 7f04527fc640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0434066820 0x7f0434068ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f043c007fd0 tx=0x7f043c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:11.144 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.140+0000 7f044b7fe640 1 -- 172.21.15.31:0/877537345 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f044c0ee7e0 con 0x7f0454072510 2023-11-27T17:54:11.256 INFO:tasks.ceph.mds.a.smithi031.stderr:2023-11-27T17:54:11.252+0000 7f8e57f01640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-27T17:54:11.297 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.292+0000 7f04594d3640 1 -- 172.21.15.31:0/877537345 --> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04540b4c30 con 0x7f0434066820 2023-11-27T17:54:11.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.300+0000 7f044b7fe640 1 -- 172.21.15.31:0/877537345 <== mgr.4101 v2:172.21.15.31:6832/1886714170 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252566 (secure 0 0 0) 0x7f04540b4c30 con 0x7f0434066820 2023-11-27T17:54:11.309 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:11.311 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-11-27T17:54:11.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.304+0000 7f04594d3640 1 -- 172.21.15.31:0/877537345 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0434066820 msgr2=0x7f0434068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.304+0000 7f04594d3640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0434066820 0x7f0434068ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f043c007fd0 tx=0x7f043c009040 comp rx=0 tx=0).stop 2023-11-27T17:54:11.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.304+0000 7f04594d3640 1 -- 172.21.15.31:0/877537345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0454072510 msgr2=0x7f04540710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.304+0000 7f04594d3640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0454072510 0x7f04540710e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f044c01b840 tx=0x7f044c01b9d0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.304+0000 7f04594d3640 1 -- 172.21.15.31:0/877537345 shutdown_connections 2023-11-27T17:54:11.312 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.304+0000 7f04594d3640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f0434066820 0x7f0434068ce0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.304+0000 7f04594d3640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0454141cc0 0x7f0454140380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.304+0000 7f04594d3640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f04541418e0 0x7f045413fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.304+0000 7f04594d3640 1 --2- 172.21.15.31:0/877537345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0454072510 0x7f04540710e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.304+0000 7f04594d3640 1 -- 172.21.15.31:0/877537345 >> 172.21.15.31:0/877537345 conn(0x7f045406ab60 msgr2=0x7f04540b9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:11.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.308+0000 7f04594d3640 1 -- 172.21.15.31:0/877537345 shutdown_connections 2023-11-27T17:54:11.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.308+0000 7f04594d3640 1 -- 172.21.15.31:0/877537345 wait complete. 2023-11-27T17:54:11.330 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-11-27T17:54:11.112414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219644,"kb_used_data":3476,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755076,"statfs":{"total":773094113280,"available":772869197824,"internally_reserved":0,"allocated":3559424,"data_stored":2050505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.839998"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.278652+0000","last_change":"2023-11-27T17:54:05.278652+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.278652+0000","last_undegraded":"2023-11-27T17:54:05.278652+0000","last_fullsized":"2023-11-27T17:54:05.278652+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.525813+0000","last_change":"2023-11-27T17:54:05.525813+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.525813+0000","last_undegraded":"2023-11-27T17:54:05.525813+0000","last_fullsized":"2023-11-27T17:54:05.525813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.285316+0000","last_change":"2023-11-27T17:54:05.285316+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.285316+0000","last_undegraded":"2023-11-27T17:54:05.285316+0000","last_fullsized":"2023-11-27T17:54:05.285316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.279165+0000","last_change":"2023-11-27T17:54:05.279165+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.279165+0000","last_undegraded":"2023-11-27T17:54:05.279165+0000","last_fullsized":"2023-11-27T17:54:05.279165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282661+0000","last_change":"2023-11-27T17:54:05.282661+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282661+0000","last_undegraded":"2023-11-27T17:54:05.282661+0000","last_fullsized":"2023-11-27T17:54:05.282661+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282845+0000","last_change":"2023-11-27T17:54:05.282845+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282845+0000","last_undegraded":"2023-11-27T17:54:05.282845+0000","last_fullsized":"2023-11-27T17:54:05.282845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.284571+0000","last_change":"2023-11-27T17:54:05.284571+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.284571+0000","last_undegraded":"2023-11-27T17:54:05.284571+0000","last_fullsized":"2023-11-27T17:54:05.284571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281922+0000","last_change":"2023-11-27T17:54:05.281922+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281922+0000","last_undegraded":"2023-11-27T17:54:05.281922+0000","last_fullsized":"2023-11-27T17:54:05.281922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.284582+0000","last_change":"2023-11-27T17:54:05.284582+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.284582+0000","last_undegraded":"2023-11-27T17:54:05.284582+0000","last_fullsized":"2023-11-27T17:54:05.284582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.523421+0000","last_change":"2023-11-27T17:54:05.523421+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.523421+0000","last_undegraded":"2023-11-27T17:54:05.523421+0000","last_fullsized":"2023-11-27T17:54:05.523421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.283343+0000","last_change":"2023-11-27T17:54:05.283343+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.283343+0000","last_undegraded":"2023-11-27T17:54:05.283343+0000","last_fullsized":"2023-11-27T17:54:05.283343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.284671+0000","last_change":"2023-11-27T17:54:05.284671+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.284671+0000","last_undegraded":"2023-11-27T17:54:05.284671+0000","last_fullsized":"2023-11-27T17:54:05.284671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281665+0000","last_change":"2023-11-27T17:54:05.281665+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281665+0000","last_undegraded":"2023-11-27T17:54:05.281665+0000","last_fullsized":"2023-11-27T17:54:05.281665+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282183+0000","last_change":"2023-11-27T17:54:05.282183+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282183+0000","last_undegraded":"2023-11-27T17:54:05.282183+0000","last_fullsized":"2023-11-27T17:54:05.282183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.286355+0000","last_change":"2023-11-27T17:54:05.286355+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.286355+0000","last_undegraded":"2023-11-27T17:54:05.286355+0000","last_fullsized":"2023-11-27T17:54:05.286355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.285387+0000","last_change":"2023-11-27T17:54:05.285387+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.285387+0000","last_undegraded":"2023-11-27T17:54:05.285387+0000","last_fullsized":"2023-11-27T17:54:05.285387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281988+0000","last_change":"2023-11-27T17:54:05.281988+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281988+0000","last_undegraded":"2023-11-27T17:54:05.281988+0000","last_fullsized":"2023-11-27T17:54:05.281988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282205+0000","last_change":"2023-11-27T17:54:05.282205+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282205+0000","last_undegraded":"2023-11-27T17:54:05.282205+0000","last_fullsized":"2023-11-27T17:54:05.282205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282061+0000","last_change":"2023-11-27T17:54:05.282061+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282061+0000","last_undegraded":"2023-11-27T17:54:05.282061+0000","last_fullsized":"2023-11-27T17:54:05.282061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.283605+0000","last_change":"2023-11-27T17:54:05.283605+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.283605+0000","last_undegraded":"2023-11-27T17:54:05.283605+0000","last_fullsized":"2023-11-27T17:54:05.283605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.524638+0000","last_change":"2023-11-27T17:54:05.524638+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.524638+0000","last_undegraded":"2023-11-27T17:54:05.524638+0000","last_fullsized":"2023-11-27T17:54:05.524638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.278485+0000","last_change":"2023-11-27T17:54:05.278485+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.278485+0000","last_undegraded":"2023-11-27T17:54:05.278485+0000","last_fullsized":"2023-11-27T17:54:05.278485+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.285432+0000","last_change":"2023-11-27T17:54:05.285432+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.285432+0000","last_undegraded":"2023-11-27T17:54:05.285432+0000","last_fullsized":"2023-11-27T17:54:05.285432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.283231+0000","last_change":"2023-11-27T17:54:05.283231+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.283231+0000","last_undegraded":"2023-11-27T17:54:05.283231+0000","last_fullsized":"2023-11-27T17:54:05.283231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281251+0000","last_change":"2023-11-27T17:54:05.281251+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281251+0000","last_undegraded":"2023-11-27T17:54:05.281251+0000","last_fullsized":"2023-11-27T17:54:05.281251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.524841+0000","last_change":"2023-11-27T17:54:05.524841+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.524841+0000","last_undegraded":"2023-11-27T17:54:05.524841+0000","last_fullsized":"2023-11-27T17:54:05.524841+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281181+0000","last_change":"2023-11-27T17:54:05.281181+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281181+0000","last_undegraded":"2023-11-27T17:54:05.281181+0000","last_fullsized":"2023-11-27T17:54:05.281181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.523367+0000","last_change":"2023-11-27T17:54:05.523367+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.523367+0000","last_undegraded":"2023-11-27T17:54:05.523367+0000","last_fullsized":"2023-11-27T17:54:05.523367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281245+0000","last_change":"2023-11-27T17:54:05.281245+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281245+0000","last_undegraded":"2023-11-27T17:54:05.281245+0000","last_fullsized":"2023-11-27T17:54:05.281245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281580+0000","last_change":"2023-11-27T17:54:05.281580+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281580+0000","last_undegraded":"2023-11-27T17:54:05.281580+0000","last_fullsized":"2023-11-27T17:54:05.281580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.286158+0000","last_change":"2023-11-27T17:54:05.286158+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.286158+0000","last_undegraded":"2023-11-27T17:54:05.286158+0000","last_fullsized":"2023-11-27T17:54:05.286158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.278483+0000","last_change":"2023-11-27T17:54:05.278483+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.278483+0000","last_undegraded":"2023-11-27T17:54:05.278483+0000","last_fullsized":"2023-11-27T17:54:05.278483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T17:54:01.589311+0000","last_change":"2023-11-27T17:53:12.619175+0000","last_active":"2023-11-27T17:54:01.589311+0000","last_peered":"2023-11-27T17:54:01.589311+0000","last_clean":"2023-11-27T17:54:01.589311+0000","last_became_active":"2023-11-27T17:53:12.617047+0000","last_became_peered":"2023-11-27T17:53:12.617047+0000","last_unstale":"2023-11-27T17:54:01.589311+0000","last_undegraded":"2023-11-27T17:54:01.589311+0000","last_fullsized":"2023-11-27T17:54:01.589311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_clean_scrub_stamp":"2023-11-27T17:53:11.496632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:23:56.619761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":700071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":108684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":693235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:54:11.334 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:54:11.493 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69ca54640 1 Processor -- start 2023-11-27T17:54:11.494 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69ca54640 1 -- start start 2023-11-27T17:54:11.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69ca54640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981498d0 0x7fa6980baee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.496 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69ca54640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6980b6670 con 0x7fa6980bab00 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69ca54640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6980b9570 con 0x7fa6980b6070 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69ca54640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980b6cf0 con 0x7fa6981498d0 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69659c640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa6980bab00 0x7fa6981430b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53982/0 (socket says 172.21.15.31:53982) 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69659c640 1 -- 172.21.15.31:0/2501361487 learned_addr learned my addr 172.21.15.31:0/2501361487 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa696d9d640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981498d0 0x7fa6980baee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422789892 0 0) 0x7fa6980b6670 con 0x7fa6980bab00 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa684003530 con 0x7fa6980bab00 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1700822900 0 0) 0x7fa684003530 con 0x7fa6980bab00 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981498d0 msgr2=0x7fa6980baee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981498d0 0x7fa6980baee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 >> v1:172.21.15.81:6789/0 conn(0x7fa6980b6070 legacy=0x7fa6981491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6980b9e10 con 0x7fa6980bab00 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7fa680001680 con 0x7fa6980bab00 2023-11-27T17:54:11.497 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 >> v1:172.21.15.31:6789/0 conn(0x7fa6980bab00 legacy=0x7fa6981430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa684003a20 0x7fa684003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981498d0 0x7fa6840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa684004d10 0x7fa684005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980b6cf0 con 0x7fa684004d10 2023-11-27T17:54:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68400baa0 con 0x7fa684003a20 2023-11-27T17:54:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.488+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68400bc60 con 0x7fa6981498d0 2023-11-27T17:54:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa696d9d640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa684004d10 0x7fa684005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa69659c640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa684003a20 0x7fa684003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa695d9b640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981498d0 0x7fa6840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa696d9d640 1 -- 172.21.15.31:0/2501361487 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981498d0 msgr2=0x7fa6840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa696d9d640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981498d0 0x7fa6840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.498 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa696d9d640 1 -- 172.21.15.31:0/2501361487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa684003a20 msgr2=0x7fa684003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:11.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa696d9d640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa684003a20 0x7fa684003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa696d9d640 1 -- 172.21.15.31:0/2501361487 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684003530 con 0x7fa684004d10 2023-11-27T17:54:11.499 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa69659c640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa684003a20 0x7fa684003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:54:11.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa696d9d640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa684004d10 0x7fa684005190 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa690009ab0 tx=0x7fa69001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267a433f2fc157fa server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:11.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6900a5620 con 0x7fa684004d10 2023-11-27T17:54:11.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6900a5780 con 0x7fa684004d10 2023-11-27T17:54:11.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.492+0000 7fa69559a640 1 -- 172.21.15.31:0/2501361487 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6900a5b30 con 0x7fa684004d10 2023-11-27T17:54:11.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 -- 172.21.15.31:0/2501361487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa684004d10 msgr2=0x7fa684005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 --2- 172.21.15.31:0/2501361487 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa684004d10 0x7fa684005190 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa690009ab0 tx=0x7fa69001ca30 comp rx=0 tx=0).stop 2023-11-27T17:54:11.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa696d9d640 1 -- 172.21.15.31:0/2501361487 reap_dead start 2023-11-27T17:54:11.500 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 -- 172.21.15.31:0/2501361487 shutdown_connections 2023-11-27T17:54:11.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 -- 172.21.15.31:0/2501361487 >> 172.21.15.31:0/2501361487 conn(0x7fa6980beb70 msgr2=0x7fa6980bef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:11.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 -- 172.21.15.31:0/2501361487 shutdown_connections 2023-11-27T17:54:11.501 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 -- 172.21.15.31:0/2501361487 wait complete. 2023-11-27T17:54:11.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 Processor -- start 2023-11-27T17:54:11.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 -- start start 2023-11-27T17:54:11.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6981d3fc0 0x7fa6981def80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.502 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6981df4c0 0x7fa6981e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981e2400 0x7fa6981e2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6981deaf0 con 0x7fa6981d3fc0 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6981df900 con 0x7fa6981df4c0 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6981d5490 con 0x7fa6981e2400 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6981d3fc0 0x7fa6981def80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69659c640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6981d3fc0 0x7fa6981def80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36756/0 (socket says 172.21.15.31:36756) 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69659c640 1 -- 172.21.15.31:0/2097667579 learned_addr learned my addr 172.21.15.31:0/2097667579 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa695d9b640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6981df4c0 0x7fa6981e1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa696d9d640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981e2400 0x7fa6981e2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69659c640 1 -- 172.21.15.31:0/2097667579 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981e2400 msgr2=0x7fa6981e2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69659c640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981e2400 0x7fa6981e2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69659c640 1 -- 172.21.15.31:0/2097667579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6981df4c0 msgr2=0x7fa6981e1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.503 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69659c640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6981df4c0 0x7fa6981e1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69659c640 1 -- 172.21.15.31:0/2097667579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6981d59e0 con 0x7fa6981d3fc0 2023-11-27T17:54:11.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa696d9d640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981e2400 0x7fa6981e2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:11.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69659c640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6981d3fc0 0x7fa6981def80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa68000eb20 tx=0x7fa680005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:11.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa68effd640 1 -- 172.21.15.31:0/2097667579 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68000c870 con 0x7fa6981d3fc0 2023-11-27T17:54:11.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa68effd640 1 -- 172.21.15.31:0/2097667579 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68000c9d0 con 0x7fa6981d3fc0 2023-11-27T17:54:11.504 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa68effd640 1 -- 172.21.15.31:0/2097667579 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68000cd40 con 0x7fa6981d3fc0 2023-11-27T17:54:11.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 -- 172.21.15.31:0/2097667579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6981d47f0 con 0x7fa6981d3fc0 2023-11-27T17:54:11.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.496+0000 7fa69ca54640 1 -- 172.21.15.31:0/2097667579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6980be7a0 con 0x7fa6981d3fc0 2023-11-27T17:54:11.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.500+0000 7fa69ca54640 1 -- 172.21.15.31:0/2097667579 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6980b68b0 con 0x7fa6981d3fc0 2023-11-27T17:54:11.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.500+0000 7fa68effd640 1 -- 172.21.15.31:0/2097667579 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa68001d460 con 0x7fa6981d3fc0 2023-11-27T17:54:11.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.500+0000 7fa68effd640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa678066820 0x7fa678068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.500+0000 7fa68effd640 1 -- 172.21.15.31:0/2097667579 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa680084120 con 0x7fa6981d3fc0 2023-11-27T17:54:11.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.500+0000 7fa695d9b640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa678066820 0x7fa678068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.505 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.500+0000 7fa695d9b640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa678066820 0x7fa678068ce0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa69813c8f0 tx=0x7fa688009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:11.508 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.504+0000 7fa68effd640 1 -- 172.21.15.31:0/2097667579 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa6800512d0 con 0x7fa6981d3fc0 2023-11-27T17:54:11.660 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.656+0000 7fa69ca54640 1 -- 172.21.15.31:0/2097667579 --> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6980bf690 con 0x7fa678066820 2023-11-27T17:54:11.678 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.672+0000 7fa68effd640 1 -- 172.21.15.31:0/2097667579 <== mgr.4101 v2:172.21.15.31:6832/1886714170 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252566 (secure 0 0 0) 0x7fa688005760 con 0x7fa678066820 2023-11-27T17:54:11.681 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:11.683 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-11-27T17:54:11.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.676+0000 7fa69ca54640 1 -- 172.21.15.31:0/2097667579 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa678066820 msgr2=0x7fa678068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.683 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.676+0000 7fa69ca54640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa678066820 0x7fa678068ce0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa69813c8f0 tx=0x7fa688009040 comp rx=0 tx=0).stop 2023-11-27T17:54:11.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.676+0000 7fa69ca54640 1 -- 172.21.15.31:0/2097667579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6981d3fc0 msgr2=0x7fa6981def80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.676+0000 7fa69ca54640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6981d3fc0 0x7fa6981def80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa68000eb20 tx=0x7fa680005e60 comp rx=0 tx=0).stop 2023-11-27T17:54:11.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.676+0000 7fa69ca54640 1 -- 172.21.15.31:0/2097667579 shutdown_connections 2023-11-27T17:54:11.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.676+0000 7fa69ca54640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa678066820 0x7fa678068ce0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.676+0000 7fa69ca54640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa6981e2400 0x7fa6981e2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.676+0000 7fa69ca54640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6981df4c0 0x7fa6981e1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.676+0000 7fa69ca54640 1 --2- 172.21.15.31:0/2097667579 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6981d3fc0 0x7fa6981def80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.676+0000 7fa69ca54640 1 -- 172.21.15.31:0/2097667579 >> 172.21.15.31:0/2097667579 conn(0x7fa6980beb70 msgr2=0x7fa69813ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:11.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.680+0000 7fa69ca54640 1 -- 172.21.15.31:0/2097667579 shutdown_connections 2023-11-27T17:54:11.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.680+0000 7fa69ca54640 1 -- 172.21.15.31:0/2097667579 wait complete. 2023-11-27T17:54:11.701 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-11-27T17:54:11.112414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219644,"kb_used_data":3476,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755076,"statfs":{"total":773094113280,"available":772869197824,"internally_reserved":0,"allocated":3559424,"data_stored":2050505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.839998"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.278652+0000","last_change":"2023-11-27T17:54:05.278652+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.278652+0000","last_undegraded":"2023-11-27T17:54:05.278652+0000","last_fullsized":"2023-11-27T17:54:05.278652+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.525813+0000","last_change":"2023-11-27T17:54:05.525813+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.525813+0000","last_undegraded":"2023-11-27T17:54:05.525813+0000","last_fullsized":"2023-11-27T17:54:05.525813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.285316+0000","last_change":"2023-11-27T17:54:05.285316+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.285316+0000","last_undegraded":"2023-11-27T17:54:05.285316+0000","last_fullsized":"2023-11-27T17:54:05.285316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.279165+0000","last_change":"2023-11-27T17:54:05.279165+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.279165+0000","last_undegraded":"2023-11-27T17:54:05.279165+0000","last_fullsized":"2023-11-27T17:54:05.279165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282661+0000","last_change":"2023-11-27T17:54:05.282661+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282661+0000","last_undegraded":"2023-11-27T17:54:05.282661+0000","last_fullsized":"2023-11-27T17:54:05.282661+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282845+0000","last_change":"2023-11-27T17:54:05.282845+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282845+0000","last_undegraded":"2023-11-27T17:54:05.282845+0000","last_fullsized":"2023-11-27T17:54:05.282845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.284571+0000","last_change":"2023-11-27T17:54:05.284571+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.284571+0000","last_undegraded":"2023-11-27T17:54:05.284571+0000","last_fullsized":"2023-11-27T17:54:05.284571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281922+0000","last_change":"2023-11-27T17:54:05.281922+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281922+0000","last_undegraded":"2023-11-27T17:54:05.281922+0000","last_fullsized":"2023-11-27T17:54:05.281922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.284582+0000","last_change":"2023-11-27T17:54:05.284582+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.284582+0000","last_undegraded":"2023-11-27T17:54:05.284582+0000","last_fullsized":"2023-11-27T17:54:05.284582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.523421+0000","last_change":"2023-11-27T17:54:05.523421+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.523421+0000","last_undegraded":"2023-11-27T17:54:05.523421+0000","last_fullsized":"2023-11-27T17:54:05.523421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.283343+0000","last_change":"2023-11-27T17:54:05.283343+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.283343+0000","last_undegraded":"2023-11-27T17:54:05.283343+0000","last_fullsized":"2023-11-27T17:54:05.283343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.284671+0000","last_change":"2023-11-27T17:54:05.284671+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.284671+0000","last_undegraded":"2023-11-27T17:54:05.284671+0000","last_fullsized":"2023-11-27T17:54:05.284671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281665+0000","last_change":"2023-11-27T17:54:05.281665+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281665+0000","last_undegraded":"2023-11-27T17:54:05.281665+0000","last_fullsized":"2023-11-27T17:54:05.281665+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282183+0000","last_change":"2023-11-27T17:54:05.282183+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282183+0000","last_undegraded":"2023-11-27T17:54:05.282183+0000","last_fullsized":"2023-11-27T17:54:05.282183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.286355+0000","last_change":"2023-11-27T17:54:05.286355+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.286355+0000","last_undegraded":"2023-11-27T17:54:05.286355+0000","last_fullsized":"2023-11-27T17:54:05.286355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.285387+0000","last_change":"2023-11-27T17:54:05.285387+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.285387+0000","last_undegraded":"2023-11-27T17:54:05.285387+0000","last_fullsized":"2023-11-27T17:54:05.285387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281988+0000","last_change":"2023-11-27T17:54:05.281988+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281988+0000","last_undegraded":"2023-11-27T17:54:05.281988+0000","last_fullsized":"2023-11-27T17:54:05.281988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282205+0000","last_change":"2023-11-27T17:54:05.282205+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282205+0000","last_undegraded":"2023-11-27T17:54:05.282205+0000","last_fullsized":"2023-11-27T17:54:05.282205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282061+0000","last_change":"2023-11-27T17:54:05.282061+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282061+0000","last_undegraded":"2023-11-27T17:54:05.282061+0000","last_fullsized":"2023-11-27T17:54:05.282061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.283605+0000","last_change":"2023-11-27T17:54:05.283605+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.283605+0000","last_undegraded":"2023-11-27T17:54:05.283605+0000","last_fullsized":"2023-11-27T17:54:05.283605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.524638+0000","last_change":"2023-11-27T17:54:05.524638+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.524638+0000","last_undegraded":"2023-11-27T17:54:05.524638+0000","last_fullsized":"2023-11-27T17:54:05.524638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.278485+0000","last_change":"2023-11-27T17:54:05.278485+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.278485+0000","last_undegraded":"2023-11-27T17:54:05.278485+0000","last_fullsized":"2023-11-27T17:54:05.278485+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.285432+0000","last_change":"2023-11-27T17:54:05.285432+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.285432+0000","last_undegraded":"2023-11-27T17:54:05.285432+0000","last_fullsized":"2023-11-27T17:54:05.285432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.283231+0000","last_change":"2023-11-27T17:54:05.283231+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.283231+0000","last_undegraded":"2023-11-27T17:54:05.283231+0000","last_fullsized":"2023-11-27T17:54:05.283231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281251+0000","last_change":"2023-11-27T17:54:05.281251+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281251+0000","last_undegraded":"2023-11-27T17:54:05.281251+0000","last_fullsized":"2023-11-27T17:54:05.281251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.524841+0000","last_change":"2023-11-27T17:54:05.524841+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.524841+0000","last_undegraded":"2023-11-27T17:54:05.524841+0000","last_fullsized":"2023-11-27T17:54:05.524841+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281181+0000","last_change":"2023-11-27T17:54:05.281181+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281181+0000","last_undegraded":"2023-11-27T17:54:05.281181+0000","last_fullsized":"2023-11-27T17:54:05.281181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.523367+0000","last_change":"2023-11-27T17:54:05.523367+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.523367+0000","last_undegraded":"2023-11-27T17:54:05.523367+0000","last_fullsized":"2023-11-27T17:54:05.523367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281245+0000","last_change":"2023-11-27T17:54:05.281245+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281245+0000","last_undegraded":"2023-11-27T17:54:05.281245+0000","last_fullsized":"2023-11-27T17:54:05.281245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281580+0000","last_change":"2023-11-27T17:54:05.281580+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281580+0000","last_undegraded":"2023-11-27T17:54:05.281580+0000","last_fullsized":"2023-11-27T17:54:05.281580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.286158+0000","last_change":"2023-11-27T17:54:05.286158+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.286158+0000","last_undegraded":"2023-11-27T17:54:05.286158+0000","last_fullsized":"2023-11-27T17:54:05.286158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.278483+0000","last_change":"2023-11-27T17:54:05.278483+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.278483+0000","last_undegraded":"2023-11-27T17:54:05.278483+0000","last_fullsized":"2023-11-27T17:54:05.278483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T17:54:01.589311+0000","last_change":"2023-11-27T17:53:12.619175+0000","last_active":"2023-11-27T17:54:01.589311+0000","last_peered":"2023-11-27T17:54:01.589311+0000","last_clean":"2023-11-27T17:54:01.589311+0000","last_became_active":"2023-11-27T17:53:12.617047+0000","last_became_peered":"2023-11-27T17:53:12.617047+0000","last_unstale":"2023-11-27T17:54:01.589311+0000","last_undegraded":"2023-11-27T17:54:01.589311+0000","last_fullsized":"2023-11-27T17:54:01.589311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_clean_scrub_stamp":"2023-11-27T17:53:11.496632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:23:56.619761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":700071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":108684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":693235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:54:11.705 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:54:11.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94aa564640 1 Processor -- start 2023-11-27T17:54:11.868 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94aa564640 1 -- start start 2023-11-27T17:54:11.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94aa564640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f94a40b89a0 0x7f94a40b9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94aa564640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94a4145750 0x7f94a40b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94aa564640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a406d220 con 0x7f94a40bb050 2023-11-27T17:54:11.869 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94aa564640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a406c5d0 con 0x7f94a40b89a0 2023-11-27T17:54:11.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94aa564640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a40ba3f0 con 0x7f94a4145750 2023-11-27T17:54:11.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94a3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f94a40b89a0 0x7f94a40b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94a3fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f94a40b89a0 0x7f94a40b9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36770/0 (socket says 172.21.15.31:36770) 2023-11-27T17:54:11.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94a3fff640 1 -- 172.21.15.31:0/3136349625 learned_addr learned my addr 172.21.15.31:0/3136349625 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:11.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94a8b01640 1 --2- 172.21.15.31:0/3136349625 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94a4145750 0x7f94a40b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94a3fff640 1 -- 172.21.15.31:0/3136349625 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94a4145750 msgr2=0x7f94a40b9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:11.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94a3fff640 1 --2- 172.21.15.31:0/3136349625 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94a4145750 0x7f94a40b9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94a3fff640 1 -- 172.21.15.31:0/3136349625 >> v1:172.21.15.81:6789/0 conn(0x7f94a40bb050 legacy=0x7f94a4145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:11.870 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94a3fff640 1 -- 172.21.15.31:0/3136349625 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a406d500 con 0x7f94a40b89a0 2023-11-27T17:54:11.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94a3fff640 1 --2- 172.21.15.31:0/3136349625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a40b89a0 0x7f94a40b9970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9494009e50 tx=0x7f949401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5282850823cee78b server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:11.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94a2ffd640 1 -- 172.21.15.31:0/3136349625 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94940a56d0 con 0x7f94a40b89a0 2023-11-27T17:54:11.871 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94a2ffd640 1 -- 172.21.15.31:0/3136349625 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94940a5830 con 0x7f94a40b89a0 2023-11-27T17:54:11.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.864+0000 7f94a2ffd640 1 -- 172.21.15.31:0/3136349625 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94940a5bc0 con 0x7f94a40b89a0 2023-11-27T17:54:11.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 -- 172.21.15.31:0/3136349625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a40b89a0 msgr2=0x7f94a40b9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 --2- 172.21.15.31:0/3136349625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a40b89a0 0x7f94a40b9970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9494009e50 tx=0x7f949401c940 comp rx=0 tx=0).stop 2023-11-27T17:54:11.872 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 -- 172.21.15.31:0/3136349625 shutdown_connections 2023-11-27T17:54:11.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 --2- 172.21.15.31:0/3136349625 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94a4145750 0x7f94a40b9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 --2- 172.21.15.31:0/3136349625 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a40b89a0 0x7f94a40b9970 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 -- 172.21.15.31:0/3136349625 >> 172.21.15.31:0/3136349625 conn(0x7f94a40beb70 msgr2=0x7f94a40bef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:11.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 -- 172.21.15.31:0/3136349625 shutdown_connections 2023-11-27T17:54:11.873 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 -- 172.21.15.31:0/3136349625 wait complete. 2023-11-27T17:54:11.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 Processor -- start 2023-11-27T17:54:11.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 -- start start 2023-11-27T17:54:11.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a40b89a0 0x7f94a4147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.875 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a40bb050 0x7f94a4141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94a4145750 0x7f94a41424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a4148140 con 0x7f94a40bb050 2023-11-27T17:54:11.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a4141b00 con 0x7f94a40b89a0 2023-11-27T17:54:11.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a41464f0 con 0x7f94a4145750 2023-11-27T17:54:11.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a40bb050 0x7f94a4141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a37fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a40bb050 0x7f94a4141f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36780/0 (socket says 172.21.15.31:36780) 2023-11-27T17:54:11.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a37fe640 1 -- 172.21.15.31:0/3490003216 learned_addr learned my addr 172.21.15.31:0/3490003216 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:11.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a8b01640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94a4145750 0x7f94a41424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a37fe640 1 -- 172.21.15.31:0/3490003216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94a4145750 msgr2=0x7f94a41424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a3fff640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a40b89a0 0x7f94a4147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.876 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a37fe640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94a4145750 0x7f94a41424d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a37fe640 1 -- 172.21.15.31:0/3490003216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a40b89a0 msgr2=0x7f94a4147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:11.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a37fe640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a40b89a0 0x7f94a4147c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:11.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a37fe640 1 -- 172.21.15.31:0/3490003216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9494009b30 con 0x7f94a40bb050 2023-11-27T17:54:11.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a37fe640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a40bb050 0x7f94a4141f90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f949800c450 tx=0x7f949800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:11.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a0ff9640 1 -- 172.21.15.31:0/3490003216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498012830 con 0x7f94a40bb050 2023-11-27T17:54:11.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a0ff9640 1 -- 172.21.15.31:0/3490003216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94980129b0 con 0x7f94a40bb050 2023-11-27T17:54:11.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 -- 172.21.15.31:0/3490003216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a41467d0 con 0x7f94a40bb050 2023-11-27T17:54:11.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94a0ff9640 1 -- 172.21.15.31:0/3490003216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9498012d60 con 0x7f94a40bb050 2023-11-27T17:54:11.877 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.868+0000 7f94aa564640 1 -- 172.21.15.31:0/3490003216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a4145bf0 con 0x7f94a40bb050 2023-11-27T17:54:11.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.872+0000 7f94aa564640 1 -- 172.21.15.31:0/3490003216 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a4141c90 con 0x7f94a40bb050 2023-11-27T17:54:11.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.872+0000 7f94a0ff9640 1 -- 172.21.15.31:0/3490003216 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f949801c460 con 0x7f94a40bb050 2023-11-27T17:54:11.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.872+0000 7f94a0ff9640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f94900667f0 0x7f9490068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:11.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.872+0000 7f94a0ff9640 1 -- 172.21.15.31:0/3490003216 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9498084190 con 0x7f94a40bb050 2023-11-27T17:54:11.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.872+0000 7f94a3fff640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f94900667f0 0x7f9490068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:11.879 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.872+0000 7f94a3fff640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f94900667f0 0x7f9490068cb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f94940ae000 tx=0x7f94940a7070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:11.881 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:11.876+0000 7f94a0ff9640 1 -- 172.21.15.31:0/3490003216 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f9498051200 con 0x7f94a40bb050 2023-11-27T17:54:12.029 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.024+0000 7f94aa564640 1 -- 172.21.15.31:0/3490003216 --> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94a4146660 con 0x7f94900667f0 2023-11-27T17:54:12.039 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.032+0000 7f94a0ff9640 1 -- 172.21.15.31:0/3490003216 <== mgr.4101 v2:172.21.15.31:6832/1886714170 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252566 (secure 0 0 0) 0x7f94a4146660 con 0x7f94900667f0 2023-11-27T17:54:12.041 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:12.043 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-11-27T17:54:12.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.036+0000 7f94aa564640 1 -- 172.21.15.31:0/3490003216 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f94900667f0 msgr2=0x7f9490068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.036+0000 7f94aa564640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f94900667f0 0x7f9490068cb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f94940ae000 tx=0x7f94940a7070 comp rx=0 tx=0).stop 2023-11-27T17:54:12.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.036+0000 7f94aa564640 1 -- 172.21.15.31:0/3490003216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a40bb050 msgr2=0x7f94a4141f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.036+0000 7f94aa564640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a40bb050 0x7f94a4141f90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f949800c450 tx=0x7f949800c910 comp rx=0 tx=0).stop 2023-11-27T17:54:12.044 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.036+0000 7f94aa564640 1 -- 172.21.15.31:0/3490003216 shutdown_connections 2023-11-27T17:54:12.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.036+0000 7f94aa564640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f94900667f0 0x7f9490068cb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.036+0000 7f94aa564640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f94a4145750 0x7f94a41424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.036+0000 7f94aa564640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f94a40bb050 0x7f94a4141f90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.036+0000 7f94aa564640 1 --2- 172.21.15.31:0/3490003216 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94a40b89a0 0x7f94a4147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.036+0000 7f94aa564640 1 -- 172.21.15.31:0/3490003216 >> 172.21.15.31:0/3490003216 conn(0x7f94a40beb70 msgr2=0x7f94a40bb650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:12.045 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.036+0000 7f94aa564640 1 -- 172.21.15.31:0/3490003216 shutdown_connections 2023-11-27T17:54:12.046 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.036+0000 7f94aa564640 1 -- 172.21.15.31:0/3490003216 wait complete. 2023-11-27T17:54:12.059 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-11-27T17:54:11.112414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219644,"kb_used_data":3476,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755076,"statfs":{"total":773094113280,"available":772869197824,"internally_reserved":0,"allocated":3559424,"data_stored":2050505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.839998"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.278652+0000","last_change":"2023-11-27T17:54:05.278652+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.278652+0000","last_undegraded":"2023-11-27T17:54:05.278652+0000","last_fullsized":"2023-11-27T17:54:05.278652+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.525813+0000","last_change":"2023-11-27T17:54:05.525813+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.525813+0000","last_undegraded":"2023-11-27T17:54:05.525813+0000","last_fullsized":"2023-11-27T17:54:05.525813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.285316+0000","last_change":"2023-11-27T17:54:05.285316+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.285316+0000","last_undegraded":"2023-11-27T17:54:05.285316+0000","last_fullsized":"2023-11-27T17:54:05.285316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.279165+0000","last_change":"2023-11-27T17:54:05.279165+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.279165+0000","last_undegraded":"2023-11-27T17:54:05.279165+0000","last_fullsized":"2023-11-27T17:54:05.279165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282661+0000","last_change":"2023-11-27T17:54:05.282661+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282661+0000","last_undegraded":"2023-11-27T17:54:05.282661+0000","last_fullsized":"2023-11-27T17:54:05.282661+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282845+0000","last_change":"2023-11-27T17:54:05.282845+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282845+0000","last_undegraded":"2023-11-27T17:54:05.282845+0000","last_fullsized":"2023-11-27T17:54:05.282845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.284571+0000","last_change":"2023-11-27T17:54:05.284571+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.284571+0000","last_undegraded":"2023-11-27T17:54:05.284571+0000","last_fullsized":"2023-11-27T17:54:05.284571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281922+0000","last_change":"2023-11-27T17:54:05.281922+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281922+0000","last_undegraded":"2023-11-27T17:54:05.281922+0000","last_fullsized":"2023-11-27T17:54:05.281922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.284582+0000","last_change":"2023-11-27T17:54:05.284582+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.284582+0000","last_undegraded":"2023-11-27T17:54:05.284582+0000","last_fullsized":"2023-11-27T17:54:05.284582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.523421+0000","last_change":"2023-11-27T17:54:05.523421+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.523421+0000","last_undegraded":"2023-11-27T17:54:05.523421+0000","last_fullsized":"2023-11-27T17:54:05.523421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.283343+0000","last_change":"2023-11-27T17:54:05.283343+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.283343+0000","last_undegraded":"2023-11-27T17:54:05.283343+0000","last_fullsized":"2023-11-27T17:54:05.283343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.284671+0000","last_change":"2023-11-27T17:54:05.284671+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.284671+0000","last_undegraded":"2023-11-27T17:54:05.284671+0000","last_fullsized":"2023-11-27T17:54:05.284671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281665+0000","last_change":"2023-11-27T17:54:05.281665+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281665+0000","last_undegraded":"2023-11-27T17:54:05.281665+0000","last_fullsized":"2023-11-27T17:54:05.281665+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282183+0000","last_change":"2023-11-27T17:54:05.282183+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282183+0000","last_undegraded":"2023-11-27T17:54:05.282183+0000","last_fullsized":"2023-11-27T17:54:05.282183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.286355+0000","last_change":"2023-11-27T17:54:05.286355+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.286355+0000","last_undegraded":"2023-11-27T17:54:05.286355+0000","last_fullsized":"2023-11-27T17:54:05.286355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.285387+0000","last_change":"2023-11-27T17:54:05.285387+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.285387+0000","last_undegraded":"2023-11-27T17:54:05.285387+0000","last_fullsized":"2023-11-27T17:54:05.285387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281988+0000","last_change":"2023-11-27T17:54:05.281988+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281988+0000","last_undegraded":"2023-11-27T17:54:05.281988+0000","last_fullsized":"2023-11-27T17:54:05.281988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282205+0000","last_change":"2023-11-27T17:54:05.282205+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282205+0000","last_undegraded":"2023-11-27T17:54:05.282205+0000","last_fullsized":"2023-11-27T17:54:05.282205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282061+0000","last_change":"2023-11-27T17:54:05.282061+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282061+0000","last_undegraded":"2023-11-27T17:54:05.282061+0000","last_fullsized":"2023-11-27T17:54:05.282061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.283605+0000","last_change":"2023-11-27T17:54:05.283605+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.283605+0000","last_undegraded":"2023-11-27T17:54:05.283605+0000","last_fullsized":"2023-11-27T17:54:05.283605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.524638+0000","last_change":"2023-11-27T17:54:05.524638+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.524638+0000","last_undegraded":"2023-11-27T17:54:05.524638+0000","last_fullsized":"2023-11-27T17:54:05.524638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.278485+0000","last_change":"2023-11-27T17:54:05.278485+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.278485+0000","last_undegraded":"2023-11-27T17:54:05.278485+0000","last_fullsized":"2023-11-27T17:54:05.278485+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.285432+0000","last_change":"2023-11-27T17:54:05.285432+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.285432+0000","last_undegraded":"2023-11-27T17:54:05.285432+0000","last_fullsized":"2023-11-27T17:54:05.285432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.283231+0000","last_change":"2023-11-27T17:54:05.283231+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.283231+0000","last_undegraded":"2023-11-27T17:54:05.283231+0000","last_fullsized":"2023-11-27T17:54:05.283231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281251+0000","last_change":"2023-11-27T17:54:05.281251+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281251+0000","last_undegraded":"2023-11-27T17:54:05.281251+0000","last_fullsized":"2023-11-27T17:54:05.281251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.524841+0000","last_change":"2023-11-27T17:54:05.524841+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.524841+0000","last_undegraded":"2023-11-27T17:54:05.524841+0000","last_fullsized":"2023-11-27T17:54:05.524841+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281181+0000","last_change":"2023-11-27T17:54:05.281181+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281181+0000","last_undegraded":"2023-11-27T17:54:05.281181+0000","last_fullsized":"2023-11-27T17:54:05.281181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.523367+0000","last_change":"2023-11-27T17:54:05.523367+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.523367+0000","last_undegraded":"2023-11-27T17:54:05.523367+0000","last_fullsized":"2023-11-27T17:54:05.523367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281245+0000","last_change":"2023-11-27T17:54:05.281245+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281245+0000","last_undegraded":"2023-11-27T17:54:05.281245+0000","last_fullsized":"2023-11-27T17:54:05.281245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281580+0000","last_change":"2023-11-27T17:54:05.281580+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281580+0000","last_undegraded":"2023-11-27T17:54:05.281580+0000","last_fullsized":"2023-11-27T17:54:05.281580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.286158+0000","last_change":"2023-11-27T17:54:05.286158+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.286158+0000","last_undegraded":"2023-11-27T17:54:05.286158+0000","last_fullsized":"2023-11-27T17:54:05.286158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.278483+0000","last_change":"2023-11-27T17:54:05.278483+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.278483+0000","last_undegraded":"2023-11-27T17:54:05.278483+0000","last_fullsized":"2023-11-27T17:54:05.278483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T17:54:01.589311+0000","last_change":"2023-11-27T17:53:12.619175+0000","last_active":"2023-11-27T17:54:01.589311+0000","last_peered":"2023-11-27T17:54:01.589311+0000","last_clean":"2023-11-27T17:54:01.589311+0000","last_became_active":"2023-11-27T17:53:12.617047+0000","last_became_peered":"2023-11-27T17:53:12.617047+0000","last_unstale":"2023-11-27T17:54:01.589311+0000","last_undegraded":"2023-11-27T17:54:01.589311+0000","last_fullsized":"2023-11-27T17:54:01.589311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_clean_scrub_stamp":"2023-11-27T17:53:11.496632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:23:56.619761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":700071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":108684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":693235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:54:12.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-27T17:54:12.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-27T17:54:12.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-27T17:54:12.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-27T17:54:12.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-27T17:54:12.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-27T17:54:12.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-27T17:54:12.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-27T17:54:12.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-27T17:54:12.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-27T17:54:12.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-27T17:54:12.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-27T17:54:12.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-27T17:54:12.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-27T17:54:12.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-27T17:54:12.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-27T17:54:12.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-27T17:54:12.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-27T17:54:12.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-27T17:54:12.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-27T17:54:12.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-27T17:54:12.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-27T17:54:12.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-27T17:54:12.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-27T17:54:12.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-27T17:54:12.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-27T17:54:12.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-27T17:54:12.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-27T17:54:12.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-27T17:54:12.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-27T17:54:12.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-27T17:54:12.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-27T17:54:12.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-27T17:54:12.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-11-27T17:54:12.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.278652+0000', 'last_change': '2023-11-27T17:54:05.278652+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.278652+0000', 'last_undegraded': '2023-11-27T17:54:05.278652+0000', 'last_fullsized': '2023-11-27T17:54:05.278652+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T17:54:12.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-27T17:54:12.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-27T17:54:12.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.525813+0000', 'last_change': '2023-11-27T17:54:05.525813+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.525813+0000', 'last_undegraded': '2023-11-27T17:54:05.525813+0000', 'last_fullsized': '2023-11-27T17:54:05.525813+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T17:54:12.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-27T17:54:12.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-11-27T17:54:12.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.285316+0000', 'last_change': '2023-11-27T17:54:05.285316+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.285316+0000', 'last_undegraded': '2023-11-27T17:54:05.285316+0000', 'last_fullsized': '2023-11-27T17:54:05.285316+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:54:12.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-27T17:54:12.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-11-27T17:54:12.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.279165+0000', 'last_change': '2023-11-27T17:54:05.279165+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.279165+0000', 'last_undegraded': '2023-11-27T17:54:05.279165+0000', 'last_fullsized': '2023-11-27T17:54:05.279165+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-27T17:54:12.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-27T17:54:12.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-11-27T17:54:12.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.282661+0000', 'last_change': '2023-11-27T17:54:05.282661+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.282661+0000', 'last_undegraded': '2023-11-27T17:54:05.282661+0000', 'last_fullsized': '2023-11-27T17:54:05.282661+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:54:12.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-27T17:54:12.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-11-27T17:54:12.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.282845+0000', 'last_change': '2023-11-27T17:54:05.282845+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.282845+0000', 'last_undegraded': '2023-11-27T17:54:05.282845+0000', 'last_fullsized': '2023-11-27T17:54:05.282845+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:54:12.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-27T17:54:12.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-11-27T17:54:12.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.284571+0000', 'last_change': '2023-11-27T17:54:05.284571+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.284571+0000', 'last_undegraded': '2023-11-27T17:54:05.284571+0000', 'last_fullsized': '2023-11-27T17:54:05.284571+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:54:12.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-27T17:54:12.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-11-27T17:54:12.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.281922+0000', 'last_change': '2023-11-27T17:54:05.281922+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.281922+0000', 'last_undegraded': '2023-11-27T17:54:05.281922+0000', 'last_fullsized': '2023-11-27T17:54:05.281922+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:54:12.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-27T17:54:12.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-27T17:54:12.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.284582+0000', 'last_change': '2023-11-27T17:54:05.284582+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.284582+0000', 'last_undegraded': '2023-11-27T17:54:05.284582+0000', 'last_fullsized': '2023-11-27T17:54:05.284582+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:54:12.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-27T17:54:12.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-27T17:54:12.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.523421+0000', 'last_change': '2023-11-27T17:54:05.523421+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.523421+0000', 'last_undegraded': '2023-11-27T17:54:05.523421+0000', 'last_fullsized': '2023-11-27T17:54:05.523421+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T17:54:12.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-27T17:54:12.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-11-27T17:54:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.283343+0000', 'last_change': '2023-11-27T17:54:05.283343+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.283343+0000', 'last_undegraded': '2023-11-27T17:54:05.283343+0000', 'last_fullsized': '2023-11-27T17:54:05.283343+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T17:54:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-27T17:54:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-11-27T17:54:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.284671+0000', 'last_change': '2023-11-27T17:54:05.284671+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.284671+0000', 'last_undegraded': '2023-11-27T17:54:05.284671+0000', 'last_fullsized': '2023-11-27T17:54:05.284671+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:54:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-27T17:54:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-11-27T17:54:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.281665+0000', 'last_change': '2023-11-27T17:54:05.281665+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.281665+0000', 'last_undegraded': '2023-11-27T17:54:05.281665+0000', 'last_fullsized': '2023-11-27T17:54:05.281665+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:54:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-27T17:54:12.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-27T17:54:12.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.282183+0000', 'last_change': '2023-11-27T17:54:05.282183+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.282183+0000', 'last_undegraded': '2023-11-27T17:54:05.282183+0000', 'last_fullsized': '2023-11-27T17:54:05.282183+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T17:54:12.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-27T17:54:12.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-27T17:54:12.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.286355+0000', 'last_change': '2023-11-27T17:54:05.286355+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.286355+0000', 'last_undegraded': '2023-11-27T17:54:05.286355+0000', 'last_fullsized': '2023-11-27T17:54:05.286355+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:54:12.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-27T17:54:12.081 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.081 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-27T17:54:12.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.285387+0000', 'last_change': '2023-11-27T17:54:05.285387+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.285387+0000', 'last_undegraded': '2023-11-27T17:54:05.285387+0000', 'last_fullsized': '2023-11-27T17:54:05.285387+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:54:12.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-27T17:54:12.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-27T17:54:12.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.281988+0000', 'last_change': '2023-11-27T17:54:05.281988+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.281988+0000', 'last_undegraded': '2023-11-27T17:54:05.281988+0000', 'last_fullsized': '2023-11-27T17:54:05.281988+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T17:54:12.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-27T17:54:12.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.082 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-11-27T17:54:12.082 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.282205+0000', 'last_change': '2023-11-27T17:54:05.282205+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.282205+0000', 'last_undegraded': '2023-11-27T17:54:05.282205+0000', 'last_fullsized': '2023-11-27T17:54:05.282205+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:54:12.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-27T17:54:12.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-11-27T17:54:12.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.282061+0000', 'last_change': '2023-11-27T17:54:05.282061+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.282061+0000', 'last_undegraded': '2023-11-27T17:54:05.282061+0000', 'last_fullsized': '2023-11-27T17:54:05.282061+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:54:12.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-27T17:54:12.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-11-27T17:54:12.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.283605+0000', 'last_change': '2023-11-27T17:54:05.283605+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.283605+0000', 'last_undegraded': '2023-11-27T17:54:05.283605+0000', 'last_fullsized': '2023-11-27T17:54:05.283605+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:54:12.083 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-27T17:54:12.083 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-27T17:54:12.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.524638+0000', 'last_change': '2023-11-27T17:54:05.524638+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.524638+0000', 'last_undegraded': '2023-11-27T17:54:05.524638+0000', 'last_fullsized': '2023-11-27T17:54:05.524638+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T17:54:12.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-27T17:54:12.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-11-27T17:54:12.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.278485+0000', 'last_change': '2023-11-27T17:54:05.278485+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.278485+0000', 'last_undegraded': '2023-11-27T17:54:05.278485+0000', 'last_fullsized': '2023-11-27T17:54:05.278485+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T17:54:12.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-27T17:54:12.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.084 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-11-27T17:54:12.084 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.285432+0000', 'last_change': '2023-11-27T17:54:05.285432+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.285432+0000', 'last_undegraded': '2023-11-27T17:54:05.285432+0000', 'last_fullsized': '2023-11-27T17:54:05.285432+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:54:12.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-27T17:54:12.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-11-27T17:54:12.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.283231+0000', 'last_change': '2023-11-27T17:54:05.283231+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.283231+0000', 'last_undegraded': '2023-11-27T17:54:05.283231+0000', 'last_fullsized': '2023-11-27T17:54:05.283231+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-27T17:54:12.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-27T17:54:12.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-27T17:54:12.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.281251+0000', 'last_change': '2023-11-27T17:54:05.281251+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.281251+0000', 'last_undegraded': '2023-11-27T17:54:05.281251+0000', 'last_fullsized': '2023-11-27T17:54:05.281251+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T17:54:12.085 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-27T17:54:12.085 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-11-27T17:54:12.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.524841+0000', 'last_change': '2023-11-27T17:54:05.524841+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.524841+0000', 'last_undegraded': '2023-11-27T17:54:05.524841+0000', 'last_fullsized': '2023-11-27T17:54:05.524841+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T17:54:12.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-27T17:54:12.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-27T17:54:12.086 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.281181+0000', 'last_change': '2023-11-27T17:54:05.281181+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.281181+0000', 'last_undegraded': '2023-11-27T17:54:05.281181+0000', 'last_fullsized': '2023-11-27T17:54:05.281181+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T17:54:12.086 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-27T17:54:12.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-11-27T17:54:12.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.523367+0000', 'last_change': '2023-11-27T17:54:05.523367+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.523367+0000', 'last_undegraded': '2023-11-27T17:54:05.523367+0000', 'last_fullsized': '2023-11-27T17:54:05.523367+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-27T17:54:12.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-27T17:54:12.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-11-27T17:54:12.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.281245+0000', 'last_change': '2023-11-27T17:54:05.281245+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.281245+0000', 'last_undegraded': '2023-11-27T17:54:05.281245+0000', 'last_fullsized': '2023-11-27T17:54:05.281245+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-27T17:54:12.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-27T17:54:12.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-11-27T17:54:12.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.281580+0000', 'last_change': '2023-11-27T17:54:05.281580+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.281580+0000', 'last_undegraded': '2023-11-27T17:54:05.281580+0000', 'last_fullsized': '2023-11-27T17:54:05.281580+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-27T17:54:12.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-27T17:54:12.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-27T17:54:12.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.286158+0000', 'last_change': '2023-11-27T17:54:05.286158+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.286158+0000', 'last_undegraded': '2023-11-27T17:54:05.286158+0000', 'last_fullsized': '2023-11-27T17:54:05.286158+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-27T17:54:12.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-27T17:54:12.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-27T17:54:06.270893+0000', 'last_change': '2023-11-27T17:54:06.270893+0000', 'last_active': '2023-11-27T17:54:06.270893+0000', 'last_peered': '2023-11-27T17:54:06.270893+0000', 'last_clean': '2023-11-27T17:54:06.270893+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:06.270893+0000', 'last_undegraded': '2023-11-27T17:54:06.270893+0000', 'last_fullsized': '2023-11-27T17:54:06.270893+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:06.270893+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-27T17:54:12.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-11-27T17:54:12.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 27, 'state': 'creating+peering', 'last_fresh': '2023-11-27T17:54:05.278483+0000', 'last_change': '2023-11-27T17:54:05.278483+0000', 'last_active': '2023-11-27T17:54:05.258240+0000', 'last_peered': '2023-11-27T17:54:05.258240+0000', 'last_clean': '2023-11-27T17:54:05.258240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-27T17:54:05.278483+0000', 'last_undegraded': '2023-11-27T17:54:05.278483+0000', 'last_fullsized': '2023-11-27T17:54:05.278483+0000', 'mapping_epoch': 27, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 27, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'last_clean_scrub_stamp': '2023-11-27T17:54:05.258240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-27T17:54:12.089 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-27T17:54:12.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.212+0000 7f221d1f9640 1 Processor -- start 2023-11-27T17:54:12.219 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.212+0000 7f221d1f9640 1 -- start start 2023-11-27T17:54:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f22180b30b0 0x7f22180b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22180b3a60 0x7f221814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2218148930 con 0x7f22180bd240 2023-11-27T17:54:12.220 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22180b52c0 con 0x7f22180b30b0 2023-11-27T17:54:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22180b3490 con 0x7f22180b3a60 2023-11-27T17:54:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221759e640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f22180bd240 0x7f22180b6050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53988/0 (socket says 172.21.15.31:53988) 2023-11-27T17:54:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221759e640 1 -- 172.21.15.31:0/3251262647 learned_addr learned my addr 172.21.15.31:0/3251262647 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f2216d9d640 1 --2- 172.21.15.31:0/3251262647 >> v2:172.21.15.31:3300/0 conn(0x7f22180b30b0 0x7f22180b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f220ffff640 1 --2- 172.21.15.31:0/3251262647 >> v2:172.21.15.81:3300/0 conn(0x7f22180b3a60 0x7f221814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f2216d9d640 1 -- 172.21.15.31:0/3251262647 >> v2:172.21.15.81:3300/0 conn(0x7f22180b3a60 msgr2=0x7f221814b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f2216d9d640 1 --2- 172.21.15.31:0/3251262647 >> v2:172.21.15.81:3300/0 conn(0x7f22180b3a60 0x7f221814b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f2216d9d640 1 -- 172.21.15.31:0/3251262647 >> v1:172.21.15.31:6789/0 conn(0x7f22180bd240 legacy=0x7f22180b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221659c640 1 -- 172.21.15.31:0/3251262647 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626982786 0 0) 0x7f2218148930 con 0x7f22180bd240 2023-11-27T17:54:12.221 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f2216d9d640 1 -- 172.21.15.31:0/3251262647 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2218148040 con 0x7f22180b30b0 2023-11-27T17:54:12.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f2216d9d640 1 --2- 172.21.15.31:0/3251262647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22180b30b0 0x7f22180b46a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f221806b540 tx=0x7f220001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e407afa2591c66dd server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:12.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221659c640 1 -- 172.21.15.31:0/3251262647 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000a7070 con 0x7f22180b30b0 2023-11-27T17:54:12.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221659c640 1 -- 172.21.15.31:0/3251262647 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22000ab430 con 0x7f22180b30b0 2023-11-27T17:54:12.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221659c640 1 -- 172.21.15.31:0/3251262647 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000ab7c0 con 0x7f22180b30b0 2023-11-27T17:54:12.223 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 -- 172.21.15.31:0/3251262647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22180b30b0 msgr2=0x7f22180b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 --2- 172.21.15.31:0/3251262647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22180b30b0 0x7f22180b46a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f221806b540 tx=0x7f220001c430 comp rx=0 tx=0).stop 2023-11-27T17:54:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 -- 172.21.15.31:0/3251262647 shutdown_connections 2023-11-27T17:54:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 --2- 172.21.15.31:0/3251262647 >> v2:172.21.15.81:3300/0 conn(0x7f22180b3a60 0x7f221814b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 --2- 172.21.15.31:0/3251262647 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22180b30b0 0x7f22180b46a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 -- 172.21.15.31:0/3251262647 >> 172.21.15.31:0/3251262647 conn(0x7f221806ab60 msgr2=0x7f22180bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 -- 172.21.15.31:0/3251262647 shutdown_connections 2023-11-27T17:54:12.224 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.216+0000 7f221d1f9640 1 -- 172.21.15.31:0/3251262647 wait complete. 2023-11-27T17:54:12.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f221d1f9640 1 Processor -- start 2023-11-27T17:54:12.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f221d1f9640 1 -- start start 2023-11-27T17:54:12.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f221d1f9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22180b30b0 0x7f221813f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:12.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f221d1f9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22180b3a60 0x7f22181468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:12.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f221d1f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22180bd240 0x7f2218143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:12.227 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f221d1f9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221813f740 con 0x7f22180b30b0 2023-11-27T17:54:12.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f221d1f9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2218149ac0 con 0x7f22180bd240 2023-11-27T17:54:12.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f221d1f9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2218145e90 con 0x7f22180b3a60 2023-11-27T17:54:12.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f2216d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22180b30b0 0x7f221813f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:12.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f2216d9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22180b30b0 0x7f221813f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36804/0 (socket says 172.21.15.31:36804) 2023-11-27T17:54:12.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f2216d9d640 1 -- 172.21.15.31:0/796841771 learned_addr learned my addr 172.21.15.31:0/796841771 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:12.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f221759e640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22180bd240 0x7f2218143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:12.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f220ffff640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22180b3a60 0x7f22181468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:12.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f2216d9d640 1 -- 172.21.15.31:0/796841771 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22180b3a60 msgr2=0x7f22181468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f2216d9d640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22180b3a60 0x7f22181468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f2216d9d640 1 -- 172.21.15.31:0/796841771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22180bd240 msgr2=0x7f2218143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.228 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f2216d9d640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22180bd240 0x7f2218143840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f2216d9d640 1 -- 172.21.15.31:0/796841771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2200009420 con 0x7f22180b30b0 2023-11-27T17:54:12.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f2216d9d640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22180b30b0 0x7f221813f200 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f22000ad040 tx=0x7f220001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:12.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f220f7fe640 1 -- 172.21.15.31:0/796841771 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000b5810 con 0x7f22180b30b0 2023-11-27T17:54:12.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f220f7fe640 1 -- 172.21.15.31:0/796841771 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22000b5990 con 0x7f22180b30b0 2023-11-27T17:54:12.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f220f7fe640 1 -- 172.21.15.31:0/796841771 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22000b5d40 con 0x7f22180b30b0 2023-11-27T17:54:12.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f221d1f9640 1 -- 172.21.15.31:0/796841771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22180b94a0 con 0x7f22180b30b0 2023-11-27T17:54:12.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f221d1f9640 1 -- 172.21.15.31:0/796841771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22181460e0 con 0x7f22180b30b0 2023-11-27T17:54:12.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f221d1f9640 1 -- 172.21.15.31:0/796841771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2218146560 con 0x7f22180b30b0 2023-11-27T17:54:12.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f220f7fe640 1 -- 172.21.15.31:0/796841771 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f22000c83a0 con 0x7f22180b30b0 2023-11-27T17:54:12.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f220f7fe640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f21f80667f0 0x7f21f8068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:12.229 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f220f7fe640 1 -- 172.21.15.31:0/796841771 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f220011eed0 con 0x7f22180b30b0 2023-11-27T17:54:12.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.220+0000 7f220ffff640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f21f80667f0 0x7f21f8068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:12.230 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.224+0000 7f220ffff640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f21f80667f0 0x7f21f8068cb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f221814b590 tx=0x7f2208008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:12.231 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.228+0000 7f220f7fe640 1 -- 172.21.15.31:0/796841771 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f22000ec230 con 0x7f22180b30b0 2023-11-27T17:54:12.440 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.436+0000 7f221d1f9640 1 -- 172.21.15.31:0/796841771 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f221804e850 con 0x7f22180b30b0 2023-11-27T17:54:12.442 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.436+0000 7f220f7fe640 1 -- 172.21.15.31:0/796841771 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2592 (secure 0 0 0) 0x7f22000c4a30 con 0x7f22180b30b0 2023-11-27T17:54:12.443 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:12.443 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":74,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":30,"num_osds":8,"num_up_osds":8,"osd_up_since":1701107590,"num_in_osds":8,"osd_in_since":1701107581,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224915456,"bytes_avail":772869197824,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":14,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4968}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-11-27T17:54:05.110646+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-27T17:54:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.436+0000 7f221d1f9640 1 -- 172.21.15.31:0/796841771 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f21f80667f0 msgr2=0x7f21f8068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.436+0000 7f221d1f9640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f21f80667f0 0x7f21f8068cb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f221814b590 tx=0x7f2208008040 comp rx=0 tx=0).stop 2023-11-27T17:54:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.436+0000 7f221d1f9640 1 -- 172.21.15.31:0/796841771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22180b30b0 msgr2=0x7f221813f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.436+0000 7f221d1f9640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22180b30b0 0x7f221813f200 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f22000ad040 tx=0x7f220001ac70 comp rx=0 tx=0).stop 2023-11-27T17:54:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.440+0000 7f221d1f9640 1 -- 172.21.15.31:0/796841771 shutdown_connections 2023-11-27T17:54:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.440+0000 7f221d1f9640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f21f80667f0 0x7f21f8068cb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.440+0000 7f221d1f9640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22180bd240 0x7f2218143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.440+0000 7f221d1f9640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f22180b3a60 0x7f22181468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.440+0000 7f221d1f9640 1 --2- 172.21.15.31:0/796841771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f22180b30b0 0x7f221813f200 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.440+0000 7f221d1f9640 1 -- 172.21.15.31:0/796841771 >> 172.21.15.31:0/796841771 conn(0x7f221806ab60 msgr2=0x7f22180b7530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.440+0000 7f221d1f9640 1 -- 172.21.15.31:0/796841771 shutdown_connections 2023-11-27T17:54:12.444 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.440+0000 7f221d1f9640 1 -- 172.21.15.31:0/796841771 wait complete. 2023-11-27T17:54:12.459 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-27T17:54:12.460 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:54:12.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.564+0000 7f46c062b640 1 Processor -- start 2023-11-27T17:54:12.571 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.564+0000 7f46c062b640 1 -- start start 2023-11-27T17:54:12.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46c062b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46b81456f0 0x7f46b80bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:12.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46c062b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f46b80b7480 0x7f46b814b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:12.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46c062b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b8145ad0 con 0x7f46b80b5fd0 2023-11-27T17:54:12.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46c062b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b80b66c0 con 0x7f46b81456f0 2023-11-27T17:54:12.572 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46c062b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b80b69a0 con 0x7f46b80b7480 2023-11-27T17:54:12.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46bdbc6640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f46b80b7480 0x7f46b814b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:12.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46be3c7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46b81456f0 0x7f46b80bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:12.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46be3c7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f46b81456f0 0x7f46b80bb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:60478/0 (socket says 172.21.15.31:60478) 2023-11-27T17:54:12.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46be3c7640 1 -- 172.21.15.31:0/513527818 learned_addr learned my addr 172.21.15.31:0/513527818 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:12.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46be3c7640 1 -- 172.21.15.31:0/513527818 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f46b80b7480 msgr2=0x7f46b814b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:12.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46be3c7640 1 --2- 172.21.15.31:0/513527818 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f46b80b7480 0x7f46b814b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46be3c7640 1 -- 172.21.15.31:0/513527818 >> v1:172.21.15.81:6789/0 conn(0x7f46b80b5fd0 legacy=0x7f46b814b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.573 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46be3c7640 1 -- 172.21.15.31:0/513527818 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b80b6c80 con 0x7f46b81456f0 2023-11-27T17:54:12.574 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46bdbc6640 1 --2- 172.21.15.31:0/513527818 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f46b80b7480 0x7f46b814b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:54:12.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.568+0000 7f46be3c7640 1 --2- 172.21.15.31:0/513527818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b81456f0 0x7f46b80bb5e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46b40098a0 tx=0x7f46b401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aac3ec2d9eb1c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:12.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bd3c5640 1 -- 172.21.15.31:0/513527818 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b40aa670 con 0x7f46b81456f0 2023-11-27T17:54:12.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bd3c5640 1 -- 172.21.15.31:0/513527818 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b40aa7d0 con 0x7f46b81456f0 2023-11-27T17:54:12.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bd3c5640 1 -- 172.21.15.31:0/513527818 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b40aab60 con 0x7f46b81456f0 2023-11-27T17:54:12.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 -- 172.21.15.31:0/513527818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b81456f0 msgr2=0x7f46b80bb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 --2- 172.21.15.31:0/513527818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b81456f0 0x7f46b80bb5e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46b40098a0 tx=0x7f46b401c4f0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 -- 172.21.15.31:0/513527818 shutdown_connections 2023-11-27T17:54:12.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 --2- 172.21.15.31:0/513527818 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f46b80b7480 0x7f46b814b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 --2- 172.21.15.31:0/513527818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b81456f0 0x7f46b80bb5e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 -- 172.21.15.31:0/513527818 >> 172.21.15.31:0/513527818 conn(0x7f46b80bd6e0 msgr2=0x7f46b80bdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:12.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 -- 172.21.15.31:0/513527818 shutdown_connections 2023-11-27T17:54:12.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 -- 172.21.15.31:0/513527818 wait complete. 2023-11-27T17:54:12.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 Processor -- start 2023-11-27T17:54:12.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 -- start start 2023-11-27T17:54:12.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b80b5fd0 0x7f46b8148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:12.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f46b80b7480 0x7f46b813c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:12.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81456f0 0x7f46b8147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:12.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8149320 con 0x7f46b81456f0 2023-11-27T17:54:12.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8146180 con 0x7f46b80b5fd0 2023-11-27T17:54:12.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b814f1b0 con 0x7f46b80b7480 2023-11-27T17:54:12.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bebc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81456f0 0x7f46b8147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:12.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bebc8640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81456f0 0x7f46b8147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:36814/0 (socket says 172.21.15.31:36814) 2023-11-27T17:54:12.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bebc8640 1 -- 172.21.15.31:0/3383477499 learned_addr learned my addr 172.21.15.31:0/3383477499 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46be3c7640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b80b5fd0 0x7f46b8148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bdbc6640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f46b80b7480 0x7f46b813c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bebc8640 1 -- 172.21.15.31:0/3383477499 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f46b80b7480 msgr2=0x7f46b813c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bebc8640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f46b80b7480 0x7f46b813c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bebc8640 1 -- 172.21.15.31:0/3383477499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b80b5fd0 msgr2=0x7f46b8148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bebc8640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b80b5fd0 0x7f46b8148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bebc8640 1 -- 172.21.15.31:0/3383477499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a8009420 con 0x7f46b81456f0 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46bebc8640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81456f0 0x7f46b8147c10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c730 tx=0x7f46b000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46aeffd640 1 -- 172.21.15.31:0/3383477499 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0003b80 con 0x7f46b81456f0 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46aeffd640 1 -- 172.21.15.31:0/3383477499 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b0003ce0 con 0x7f46b81456f0 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 -- 172.21.15.31:0/3383477499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b40094d0 con 0x7f46b81456f0 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46aeffd640 1 -- 172.21.15.31:0/3383477499 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b000aa30 con 0x7f46b81456f0 2023-11-27T17:54:12.580 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.572+0000 7f46c062b640 1 -- 172.21.15.31:0/3383477499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b81e4b10 con 0x7f46b81456f0 2023-11-27T17:54:12.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.576+0000 7f46c062b640 1 -- 172.21.15.31:0/3383477499 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b8146380 con 0x7f46b81456f0 2023-11-27T17:54:12.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.576+0000 7f46aeffd640 1 -- 172.21.15.31:0/3383477499 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f46b000ab90 con 0x7f46b81456f0 2023-11-27T17:54:12.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.576+0000 7f46aeffd640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f469c0667f0 0x7f469c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:12.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.576+0000 7f46aeffd640 1 -- 172.21.15.31:0/3383477499 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46b0084090 con 0x7f46b81456f0 2023-11-27T17:54:12.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.576+0000 7f46be3c7640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f469c0667f0 0x7f469c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:12.582 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.576+0000 7f46be3c7640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f469c0667f0 0x7f469c068cb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f46b40ae000 tx=0x7f46b40a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:12.584 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.580+0000 7f46aeffd640 1 -- 172.21.15.31:0/3383477499 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f46b8146380 con 0x7f46b81456f0 2023-11-27T17:54:12.733 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.728+0000 7f46c062b640 1 -- 172.21.15.31:0/3383477499 --> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46b8066f60 con 0x7f469c0667f0 2023-11-27T17:54:12.751 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.744+0000 7f46aeffd640 1 -- 172.21.15.31:0/3383477499 <== mgr.4101 v2:172.21.15.31:6832/1886714170 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252566 (secure 0 0 0) 0x7f46b8066f60 con 0x7f469c0667f0 2023-11-27T17:54:12.753 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:12.755 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-11-27T17:54:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.748+0000 7f46c062b640 1 -- 172.21.15.31:0/3383477499 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f469c0667f0 msgr2=0x7f469c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.756 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.748+0000 7f46c062b640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f469c0667f0 0x7f469c068cb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f46b40ae000 tx=0x7f46b40a7000 comp rx=0 tx=0).stop 2023-11-27T17:54:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.748+0000 7f46c062b640 1 -- 172.21.15.31:0/3383477499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81456f0 msgr2=0x7f46b8147c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.748+0000 7f46c062b640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81456f0 0x7f46b8147c10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c730 tx=0x7f46b000cbf0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.752+0000 7f46c062b640 1 -- 172.21.15.31:0/3383477499 shutdown_connections 2023-11-27T17:54:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.752+0000 7f46c062b640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f469c0667f0 0x7f469c068cb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.752+0000 7f46c062b640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46b81456f0 0x7f46b8147c10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.752+0000 7f46c062b640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f46b80b7480 0x7f46b813c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.752+0000 7f46c062b640 1 --2- 172.21.15.31:0/3383477499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46b80b5fd0 0x7f46b8148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.752+0000 7f46c062b640 1 -- 172.21.15.31:0/3383477499 >> 172.21.15.31:0/3383477499 conn(0x7f46b80bd6e0 msgr2=0x7f46b8141a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.752+0000 7f46c062b640 1 -- 172.21.15.31:0/3383477499 shutdown_connections 2023-11-27T17:54:12.757 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:12.752+0000 7f46c062b640 1 -- 172.21.15.31:0/3383477499 wait complete. 2023-11-27T17:54:12.771 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-11-27T17:54:11.112414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219644,"kb_used_data":3476,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755076,"statfs":{"total":773094113280,"available":772869197824,"internally_reserved":0,"allocated":3559424,"data_stored":2050505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.839998"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.278652+0000","last_change":"2023-11-27T17:54:05.278652+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.278652+0000","last_undegraded":"2023-11-27T17:54:05.278652+0000","last_fullsized":"2023-11-27T17:54:05.278652+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.525813+0000","last_change":"2023-11-27T17:54:05.525813+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.525813+0000","last_undegraded":"2023-11-27T17:54:05.525813+0000","last_fullsized":"2023-11-27T17:54:05.525813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.285316+0000","last_change":"2023-11-27T17:54:05.285316+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.285316+0000","last_undegraded":"2023-11-27T17:54:05.285316+0000","last_fullsized":"2023-11-27T17:54:05.285316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.279165+0000","last_change":"2023-11-27T17:54:05.279165+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.279165+0000","last_undegraded":"2023-11-27T17:54:05.279165+0000","last_fullsized":"2023-11-27T17:54:05.279165+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282661+0000","last_change":"2023-11-27T17:54:05.282661+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282661+0000","last_undegraded":"2023-11-27T17:54:05.282661+0000","last_fullsized":"2023-11-27T17:54:05.282661+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282845+0000","last_change":"2023-11-27T17:54:05.282845+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282845+0000","last_undegraded":"2023-11-27T17:54:05.282845+0000","last_fullsized":"2023-11-27T17:54:05.282845+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.284571+0000","last_change":"2023-11-27T17:54:05.284571+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.284571+0000","last_undegraded":"2023-11-27T17:54:05.284571+0000","last_fullsized":"2023-11-27T17:54:05.284571+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281922+0000","last_change":"2023-11-27T17:54:05.281922+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281922+0000","last_undegraded":"2023-11-27T17:54:05.281922+0000","last_fullsized":"2023-11-27T17:54:05.281922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.284582+0000","last_change":"2023-11-27T17:54:05.284582+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.284582+0000","last_undegraded":"2023-11-27T17:54:05.284582+0000","last_fullsized":"2023-11-27T17:54:05.284582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.523421+0000","last_change":"2023-11-27T17:54:05.523421+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.523421+0000","last_undegraded":"2023-11-27T17:54:05.523421+0000","last_fullsized":"2023-11-27T17:54:05.523421+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.283343+0000","last_change":"2023-11-27T17:54:05.283343+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.283343+0000","last_undegraded":"2023-11-27T17:54:05.283343+0000","last_fullsized":"2023-11-27T17:54:05.283343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.284671+0000","last_change":"2023-11-27T17:54:05.284671+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.284671+0000","last_undegraded":"2023-11-27T17:54:05.284671+0000","last_fullsized":"2023-11-27T17:54:05.284671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281665+0000","last_change":"2023-11-27T17:54:05.281665+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281665+0000","last_undegraded":"2023-11-27T17:54:05.281665+0000","last_fullsized":"2023-11-27T17:54:05.281665+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282183+0000","last_change":"2023-11-27T17:54:05.282183+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282183+0000","last_undegraded":"2023-11-27T17:54:05.282183+0000","last_fullsized":"2023-11-27T17:54:05.282183+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.286355+0000","last_change":"2023-11-27T17:54:05.286355+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.286355+0000","last_undegraded":"2023-11-27T17:54:05.286355+0000","last_fullsized":"2023-11-27T17:54:05.286355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.285387+0000","last_change":"2023-11-27T17:54:05.285387+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.285387+0000","last_undegraded":"2023-11-27T17:54:05.285387+0000","last_fullsized":"2023-11-27T17:54:05.285387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281988+0000","last_change":"2023-11-27T17:54:05.281988+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281988+0000","last_undegraded":"2023-11-27T17:54:05.281988+0000","last_fullsized":"2023-11-27T17:54:05.281988+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282205+0000","last_change":"2023-11-27T17:54:05.282205+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282205+0000","last_undegraded":"2023-11-27T17:54:05.282205+0000","last_fullsized":"2023-11-27T17:54:05.282205+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.282061+0000","last_change":"2023-11-27T17:54:05.282061+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.282061+0000","last_undegraded":"2023-11-27T17:54:05.282061+0000","last_fullsized":"2023-11-27T17:54:05.282061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.283605+0000","last_change":"2023-11-27T17:54:05.283605+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.283605+0000","last_undegraded":"2023-11-27T17:54:05.283605+0000","last_fullsized":"2023-11-27T17:54:05.283605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.524638+0000","last_change":"2023-11-27T17:54:05.524638+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.524638+0000","last_undegraded":"2023-11-27T17:54:05.524638+0000","last_fullsized":"2023-11-27T17:54:05.524638+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.278485+0000","last_change":"2023-11-27T17:54:05.278485+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.278485+0000","last_undegraded":"2023-11-27T17:54:05.278485+0000","last_fullsized":"2023-11-27T17:54:05.278485+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.285432+0000","last_change":"2023-11-27T17:54:05.285432+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.285432+0000","last_undegraded":"2023-11-27T17:54:05.285432+0000","last_fullsized":"2023-11-27T17:54:05.285432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.283231+0000","last_change":"2023-11-27T17:54:05.283231+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.283231+0000","last_undegraded":"2023-11-27T17:54:05.283231+0000","last_fullsized":"2023-11-27T17:54:05.283231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281251+0000","last_change":"2023-11-27T17:54:05.281251+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281251+0000","last_undegraded":"2023-11-27T17:54:05.281251+0000","last_fullsized":"2023-11-27T17:54:05.281251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.524841+0000","last_change":"2023-11-27T17:54:05.524841+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.524841+0000","last_undegraded":"2023-11-27T17:54:05.524841+0000","last_fullsized":"2023-11-27T17:54:05.524841+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281181+0000","last_change":"2023-11-27T17:54:05.281181+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281181+0000","last_undegraded":"2023-11-27T17:54:05.281181+0000","last_fullsized":"2023-11-27T17:54:05.281181+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.523367+0000","last_change":"2023-11-27T17:54:05.523367+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.523367+0000","last_undegraded":"2023-11-27T17:54:05.523367+0000","last_fullsized":"2023-11-27T17:54:05.523367+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281245+0000","last_change":"2023-11-27T17:54:05.281245+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281245+0000","last_undegraded":"2023-11-27T17:54:05.281245+0000","last_fullsized":"2023-11-27T17:54:05.281245+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.281580+0000","last_change":"2023-11-27T17:54:05.281580+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.281580+0000","last_undegraded":"2023-11-27T17:54:05.281580+0000","last_fullsized":"2023-11-27T17:54:05.281580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.286158+0000","last_change":"2023-11-27T17:54:05.286158+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.286158+0000","last_undegraded":"2023-11-27T17:54:05.286158+0000","last_fullsized":"2023-11-27T17:54:05.286158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-27T17:54:06.270893+0000","last_change":"2023-11-27T17:54:06.270893+0000","last_active":"2023-11-27T17:54:06.270893+0000","last_peered":"2023-11-27T17:54:06.270893+0000","last_clean":"2023-11-27T17:54:06.270893+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:06.270893+0000","last_undegraded":"2023-11-27T17:54:06.270893+0000","last_fullsized":"2023-11-27T17:54:06.270893+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":27,"state":"creating+peering","last_fresh":"2023-11-27T17:54:05.278483+0000","last_change":"2023-11-27T17:54:05.278483+0000","last_active":"2023-11-27T17:54:05.258240+0000","last_peered":"2023-11-27T17:54:05.258240+0000","last_clean":"2023-11-27T17:54:05.258240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-27T17:54:05.278483+0000","last_undegraded":"2023-11-27T17:54:05.278483+0000","last_fullsized":"2023-11-27T17:54:05.278483+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-11-27T17:54:01.589311+0000","last_change":"2023-11-27T17:53:12.619175+0000","last_active":"2023-11-27T17:54:01.589311+0000","last_peered":"2023-11-27T17:54:01.589311+0000","last_clean":"2023-11-27T17:54:01.589311+0000","last_became_active":"2023-11-27T17:53:12.617047+0000","last_became_peered":"2023-11-27T17:53:12.617047+0000","last_unstale":"2023-11-27T17:54:01.589311+0000","last_undegraded":"2023-11-27T17:54:01.589311+0000","last_fullsized":"2023-11-27T17:54:01.589311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_clean_scrub_stamp":"2023-11-27T17:53:11.496632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:23:56.619761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":700071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":108684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":109703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":876544,"data_stored":693235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:54:15.778 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-27T17:54:15.913 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1fb88640 1 Processor -- start 2023-11-27T17:54:15.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1fb88640 1 -- start start 2023-11-27T17:54:15.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1fb88640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce18145900 0x7fce1806a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:15.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1fb88640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce180c07c0 0x7fce1814b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:15.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1fb88640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce1814be50 0x7fce1814eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:15.914 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1fb88640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1814b4e0 con 0x7fce1814be50 2023-11-27T17:54:15.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1fb88640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce180bce20 con 0x7fce18145900 2023-11-27T17:54:15.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1fb88640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1814c2b0 con 0x7fce180c07c0 2023-11-27T17:54:15.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1e125640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce1814be50 0x7fce1814eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:15.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1e125640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fce1814be50 0x7fce1814eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46194/0 (socket says 172.21.15.31:46194) 2023-11-27T17:54:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1d924640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce18145900 0x7fce1806a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1e125640 1 -- 172.21.15.31:0/1450132118 learned_addr learned my addr 172.21.15.31:0/1450132118 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1d123640 1 --2- 172.21.15.31:0/1450132118 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce180c07c0 0x7fce1814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1e125640 1 -- 172.21.15.31:0/1450132118 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce180c07c0 msgr2=0x7fce1814b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1e125640 1 --2- 172.21.15.31:0/1450132118 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce180c07c0 0x7fce1814b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1e125640 1 -- 172.21.15.31:0/1450132118 >> v2:172.21.15.81:3300/0 conn(0x7fce18145900 msgr2=0x7fce1806a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1e125640 1 --2- 172.21.15.31:0/1450132118 >> v2:172.21.15.81:3300/0 conn(0x7fce18145900 0x7fce1806a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.908+0000 7fce1e125640 1 -- 172.21.15.31:0/1450132118 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce180bb780 con 0x7fce1814be50 2023-11-27T17:54:15.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1e125640 1 --2- 172.21.15.31:0/1450132118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce1814be50 0x7fce1814eab0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fce1806d810 tx=0x7fce1001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf7d4b5bb807541 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:15.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1c922640 1 -- 172.21.15.31:0/1450132118 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce100a5560 con 0x7fce1814be50 2023-11-27T17:54:15.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1c922640 1 -- 172.21.15.31:0/1450132118 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce100a56c0 con 0x7fce1814be50 2023-11-27T17:54:15.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1c922640 1 -- 172.21.15.31:0/1450132118 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce100a5a50 con 0x7fce1814be50 2023-11-27T17:54:15.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1fb88640 1 -- 172.21.15.31:0/1450132118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce1814be50 msgr2=0x7fce1814eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:15.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1fb88640 1 --2- 172.21.15.31:0/1450132118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce1814be50 0x7fce1814eab0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fce1806d810 tx=0x7fce1001c6e0 comp rx=0 tx=0).stop 2023-11-27T17:54:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1fb88640 1 -- 172.21.15.31:0/1450132118 shutdown_connections 2023-11-27T17:54:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1fb88640 1 --2- 172.21.15.31:0/1450132118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce1814be50 0x7fce1814eab0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1fb88640 1 --2- 172.21.15.31:0/1450132118 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce180c07c0 0x7fce1814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1fb88640 1 --2- 172.21.15.31:0/1450132118 >> v2:172.21.15.81:3300/0 conn(0x7fce18145900 0x7fce1806a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1fb88640 1 -- 172.21.15.31:0/1450132118 >> 172.21.15.31:0/1450132118 conn(0x7fce180c0c60 msgr2=0x7fce180c1070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1fb88640 1 -- 172.21.15.31:0/1450132118 shutdown_connections 2023-11-27T17:54:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1fb88640 1 -- 172.21.15.31:0/1450132118 wait complete. 2023-11-27T17:54:15.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.912+0000 7fce1fb88640 1 Processor -- start 2023-11-27T17:54:15.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1fb88640 1 -- start start 2023-11-27T17:54:15.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1fb88640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce180c07c0 0x7fce1814aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:15.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1fb88640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce18145900 0x7fce18139060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:15.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1fb88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1814be50 0x7fce18136eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1fb88640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1814b030 con 0x7fce18145900 2023-11-27T17:54:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1fb88640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1813c9a0 con 0x7fce1814be50 2023-11-27T17:54:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1fb88640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce18138760 con 0x7fce180c07c0 2023-11-27T17:54:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1d123640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce18145900 0x7fce18139060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1d123640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce18145900 0x7fce18139060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46202/0 (socket says 172.21.15.31:46202) 2023-11-27T17:54:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1d123640 1 -- 172.21.15.31:0/1531422151 learned_addr learned my addr 172.21.15.31:0/1531422151 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1d924640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce180c07c0 0x7fce1814aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1e125640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1814be50 0x7fce18136eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1d123640 1 -- 172.21.15.31:0/1531422151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce180c07c0 msgr2=0x7fce1814aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1d123640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce180c07c0 0x7fce1814aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1d123640 1 -- 172.21.15.31:0/1531422151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1814be50 msgr2=0x7fce18136eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1d123640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1814be50 0x7fce18136eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:15.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1d123640 1 -- 172.21.15.31:0/1531422151 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce10009b30 con 0x7fce18145900 2023-11-27T17:54:15.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1d123640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce18145900 0x7fce18139060 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fce0800e870 tx=0x7fce0800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:15.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce0e7fc640 1 -- 172.21.15.31:0/1531422151 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0800ee60 con 0x7fce18145900 2023-11-27T17:54:15.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce0e7fc640 1 -- 172.21.15.31:0/1531422151 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0800c940 con 0x7fce18145900 2023-11-27T17:54:15.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1fb88640 1 -- 172.21.15.31:0/1531422151 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce180b8740 con 0x7fce18145900 2023-11-27T17:54:15.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce0e7fc640 1 -- 172.21.15.31:0/1531422151 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0800ccf0 con 0x7fce18145900 2023-11-27T17:54:15.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1fb88640 1 -- 172.21.15.31:0/1531422151 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce18138b40 con 0x7fce18145900 2023-11-27T17:54:15.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1fb88640 1 -- 172.21.15.31:0/1531422151 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1804e850 con 0x7fce18145900 2023-11-27T17:54:15.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce0e7fc640 1 -- 172.21.15.31:0/1531422151 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fce08013470 con 0x7fce18145900 2023-11-27T17:54:15.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce0e7fc640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fcdfc0667f0 0x7fcdfc068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:15.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce0e7fc640 1 -- 172.21.15.31:0/1531422151 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce08084250 con 0x7fce18145900 2023-11-27T17:54:15.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.916+0000 7fce1d924640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fcdfc0667f0 0x7fcdfc068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:15.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.920+0000 7fce1d924640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fcdfc0667f0 0x7fcdfc068cb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fce14009a50 tx=0x7fce14008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:15.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:15.920+0000 7fce0e7fc640 1 -- 172.21.15.31:0/1531422151 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fce080513e0 con 0x7fce18145900 2023-11-27T17:54:16.082 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.076+0000 7fce1fb88640 1 -- 172.21.15.31:0/1531422151 --> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce1806ae70 con 0x7fcdfc0667f0 2023-11-27T17:54:16.101 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.096+0000 7fce0e7fc640 1 -- 172.21.15.31:0/1531422151 <== mgr.4101 v2:172.21.15.31:6832/1886714170 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264534 (secure 0 0 0) 0x7fce140119a0 con 0x7fcdfc0667f0 2023-11-27T17:54:16.104 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:16.105 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2023-11-27T17:54:16.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.100+0000 7fce1fb88640 1 -- 172.21.15.31:0/1531422151 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fcdfc0667f0 msgr2=0x7fcdfc068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.106 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.100+0000 7fce1fb88640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fcdfc0667f0 0x7fcdfc068cb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fce14009a50 tx=0x7fce14008040 comp rx=0 tx=0).stop 2023-11-27T17:54:16.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.100+0000 7fce1fb88640 1 -- 172.21.15.31:0/1531422151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce18145900 msgr2=0x7fce18139060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.100+0000 7fce1fb88640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce18145900 0x7fce18139060 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fce0800e870 tx=0x7fce0800ed30 comp rx=0 tx=0).stop 2023-11-27T17:54:16.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.100+0000 7fce1fb88640 1 -- 172.21.15.31:0/1531422151 shutdown_connections 2023-11-27T17:54:16.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.100+0000 7fce1fb88640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fcdfc0667f0 0x7fcdfc068cb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.100+0000 7fce1fb88640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1814be50 0x7fce18136eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.100+0000 7fce1fb88640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fce18145900 0x7fce18139060 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.100+0000 7fce1fb88640 1 --2- 172.21.15.31:0/1531422151 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fce180c07c0 0x7fce1814aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.100+0000 7fce1fb88640 1 -- 172.21.15.31:0/1531422151 >> 172.21.15.31:0/1531422151 conn(0x7fce180c0c60 msgr2=0x7fce180a16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:16.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.100+0000 7fce1fb88640 1 -- 172.21.15.31:0/1531422151 shutdown_connections 2023-11-27T17:54:16.107 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.100+0000 7fce1fb88640 1 -- 172.21.15.31:0/1531422151 wait complete. 2023-11-27T17:54:16.124 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-11-27T17:54:15.113770+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220024,"kb_used_data":3840,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754696,"statfs":{"total":773094113280,"available":772868808704,"internally_reserved":0,"allocated":3932160,"data_stored":2215878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":69,"apply_latency_ms":69,"commit_latency_ns":69000000,"apply_latency_ns":69000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002651"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.724059+0000","last_change":"2023-11-27T17:54:07.334499+0000","last_active":"2023-11-27T17:54:09.724059+0000","last_peered":"2023-11-27T17:54:09.724059+0000","last_clean":"2023-11-27T17:54:09.724059+0000","last_became_active":"2023-11-27T17:54:07.333726+0000","last_became_peered":"2023-11-27T17:54:07.333726+0000","last_unstale":"2023-11-27T17:54:09.724059+0000","last_undegraded":"2023-11-27T17:54:09.724059+0000","last_fullsized":"2023-11-27T17:54:09.724059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:24.312918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.587179+0000","last_change":"2023-11-27T17:54:07.324018+0000","last_active":"2023-11-27T17:54:08.587179+0000","last_peered":"2023-11-27T17:54:08.587179+0000","last_clean":"2023-11-27T17:54:08.587179+0000","last_became_active":"2023-11-27T17:54:07.323717+0000","last_became_peered":"2023-11-27T17:54:07.323717+0000","last_unstale":"2023-11-27T17:54:08.587179+0000","last_undegraded":"2023-11-27T17:54:08.587179+0000","last_fullsized":"2023-11-27T17:54:08.587179+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:55:24.027035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.331169+0000","last_change":"2023-11-27T17:54:07.336290+0000","last_active":"2023-11-27T17:54:08.331169+0000","last_peered":"2023-11-27T17:54:08.331169+0000","last_clean":"2023-11-27T17:54:08.331169+0000","last_became_active":"2023-11-27T17:54:07.335569+0000","last_became_peered":"2023-11-27T17:54:07.335569+0000","last_unstale":"2023-11-27T17:54:08.331169+0000","last_undegraded":"2023-11-27T17:54:08.331169+0000","last_fullsized":"2023-11-27T17:54:08.331169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:33:43.134308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.722938+0000","last_change":"2023-11-27T17:54:07.349083+0000","last_active":"2023-11-27T17:54:09.722938+0000","last_peered":"2023-11-27T17:54:09.722938+0000","last_clean":"2023-11-27T17:54:09.722938+0000","last_became_active":"2023-11-27T17:54:07.347667+0000","last_became_peered":"2023-11-27T17:54:07.347667+0000","last_unstale":"2023-11-27T17:54:09.722938+0000","last_undegraded":"2023-11-27T17:54:09.722938+0000","last_fullsized":"2023-11-27T17:54:09.722938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:11.075594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.516139+0000","last_change":"2023-11-27T17:54:07.327999+0000","last_active":"2023-11-27T17:54:08.516139+0000","last_peered":"2023-11-27T17:54:08.516139+0000","last_clean":"2023-11-27T17:54:08.516139+0000","last_became_active":"2023-11-27T17:54:07.327646+0000","last_became_peered":"2023-11-27T17:54:07.327646+0000","last_unstale":"2023-11-27T17:54:08.516139+0000","last_undegraded":"2023-11-27T17:54:08.516139+0000","last_fullsized":"2023-11-27T17:54:08.516139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:27:50.051753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.586531+0000","last_change":"2023-11-27T17:54:07.336578+0000","last_active":"2023-11-27T17:54:08.586531+0000","last_peered":"2023-11-27T17:54:08.586531+0000","last_clean":"2023-11-27T17:54:08.586531+0000","last_became_active":"2023-11-27T17:54:07.335459+0000","last_became_peered":"2023-11-27T17:54:07.335459+0000","last_unstale":"2023-11-27T17:54:08.586531+0000","last_undegraded":"2023-11-27T17:54:08.586531+0000","last_fullsized":"2023-11-27T17:54:08.586531+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:33:43.134308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.563757+0000","last_change":"2023-11-27T17:54:07.330071+0000","last_active":"2023-11-27T17:54:09.563757+0000","last_peered":"2023-11-27T17:54:09.563757+0000","last_clean":"2023-11-27T17:54:09.563757+0000","last_became_active":"2023-11-27T17:54:07.328781+0000","last_became_peered":"2023-11-27T17:54:07.328781+0000","last_unstale":"2023-11-27T17:54:09.563757+0000","last_undegraded":"2023-11-27T17:54:09.563757+0000","last_fullsized":"2023-11-27T17:54:09.563757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:01:00.356660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.563001+0000","last_change":"2023-11-27T17:54:07.340401+0000","last_active":"2023-11-27T17:54:09.563001+0000","last_peered":"2023-11-27T17:54:09.563001+0000","last_clean":"2023-11-27T17:54:09.563001+0000","last_became_active":"2023-11-27T17:54:07.339703+0000","last_became_peered":"2023-11-27T17:54:07.339703+0000","last_unstale":"2023-11-27T17:54:09.563001+0000","last_undegraded":"2023-11-27T17:54:09.563001+0000","last_fullsized":"2023-11-27T17:54:09.563001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:06.259735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.332182+0000","last_change":"2023-11-27T17:54:07.334148+0000","last_active":"2023-11-27T17:54:08.332182+0000","last_peered":"2023-11-27T17:54:08.332182+0000","last_clean":"2023-11-27T17:54:08.332182+0000","last_became_active":"2023-11-27T17:54:07.333369+0000","last_became_peered":"2023-11-27T17:54:07.333369+0000","last_unstale":"2023-11-27T17:54:08.332182+0000","last_undegraded":"2023-11-27T17:54:08.332182+0000","last_fullsized":"2023-11-27T17:54:08.332182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:05:05.555549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.723071+0000","last_change":"2023-11-27T17:54:07.336250+0000","last_active":"2023-11-27T17:54:09.723071+0000","last_peered":"2023-11-27T17:54:09.723071+0000","last_clean":"2023-11-27T17:54:09.723071+0000","last_became_active":"2023-11-27T17:54:07.335459+0000","last_became_peered":"2023-11-27T17:54:07.335459+0000","last_unstale":"2023-11-27T17:54:09.723071+0000","last_undegraded":"2023-11-27T17:54:09.723071+0000","last_fullsized":"2023-11-27T17:54:09.723071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.196608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.563657+0000","last_change":"2023-11-27T17:54:07.341192+0000","last_active":"2023-11-27T17:54:09.563657+0000","last_peered":"2023-11-27T17:54:09.563657+0000","last_clean":"2023-11-27T17:54:09.563657+0000","last_became_active":"2023-11-27T17:54:07.340518+0000","last_became_peered":"2023-11-27T17:54:07.340518+0000","last_unstale":"2023-11-27T17:54:09.563657+0000","last_undegraded":"2023-11-27T17:54:09.563657+0000","last_fullsized":"2023-11-27T17:54:09.563657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:36:20.447679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.330122+0000","last_change":"2023-11-27T17:54:07.333611+0000","last_active":"2023-11-27T17:54:08.330122+0000","last_peered":"2023-11-27T17:54:08.330122+0000","last_clean":"2023-11-27T17:54:08.330122+0000","last_became_active":"2023-11-27T17:54:07.332860+0000","last_became_peered":"2023-11-27T17:54:07.332860+0000","last_unstale":"2023-11-27T17:54:08.330122+0000","last_undegraded":"2023-11-27T17:54:08.330122+0000","last_fullsized":"2023-11-27T17:54:08.330122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:17:00.752356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.516433+0000","last_change":"2023-11-27T17:54:07.326359+0000","last_active":"2023-11-27T17:54:08.516433+0000","last_peered":"2023-11-27T17:54:08.516433+0000","last_clean":"2023-11-27T17:54:08.516433+0000","last_became_active":"2023-11-27T17:54:07.325985+0000","last_became_peered":"2023-11-27T17:54:07.325985+0000","last_unstale":"2023-11-27T17:54:08.516433+0000","last_undegraded":"2023-11-27T17:54:08.516433+0000","last_fullsized":"2023-11-27T17:54:08.516433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:01:08.705582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.586522+0000","last_change":"2023-11-27T17:54:07.331624+0000","last_active":"2023-11-27T17:54:08.586522+0000","last_peered":"2023-11-27T17:54:08.586522+0000","last_clean":"2023-11-27T17:54:08.586522+0000","last_became_active":"2023-11-27T17:54:07.331322+0000","last_became_peered":"2023-11-27T17:54:07.331322+0000","last_unstale":"2023-11-27T17:54:08.586522+0000","last_undegraded":"2023-11-27T17:54:08.586522+0000","last_fullsized":"2023-11-27T17:54:08.586522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:17:00.752356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.329052+0000","last_change":"2023-11-27T17:54:07.325586+0000","last_active":"2023-11-27T17:54:08.329052+0000","last_peered":"2023-11-27T17:54:08.329052+0000","last_clean":"2023-11-27T17:54:08.329052+0000","last_became_active":"2023-11-27T17:54:07.321582+0000","last_became_peered":"2023-11-27T17:54:07.321582+0000","last_unstale":"2023-11-27T17:54:08.329052+0000","last_undegraded":"2023-11-27T17:54:08.329052+0000","last_fullsized":"2023-11-27T17:54:08.329052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:20.390567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.563622+0000","last_change":"2023-11-27T17:54:07.349071+0000","last_active":"2023-11-27T17:54:09.563622+0000","last_peered":"2023-11-27T17:54:09.563622+0000","last_clean":"2023-11-27T17:54:09.563622+0000","last_became_active":"2023-11-27T17:54:07.348576+0000","last_became_peered":"2023-11-27T17:54:07.348576+0000","last_unstale":"2023-11-27T17:54:09.563622+0000","last_undegraded":"2023-11-27T17:54:09.563622+0000","last_fullsized":"2023-11-27T17:54:09.563622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:33:43.134308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.563765+0000","last_change":"2023-11-27T17:54:07.351214+0000","last_active":"2023-11-27T17:54:09.563765+0000","last_peered":"2023-11-27T17:54:09.563765+0000","last_clean":"2023-11-27T17:54:09.563765+0000","last_became_active":"2023-11-27T17:54:07.350523+0000","last_became_peered":"2023-11-27T17:54:07.350523+0000","last_unstale":"2023-11-27T17:54:09.563765+0000","last_undegraded":"2023-11-27T17:54:09.563765+0000","last_fullsized":"2023-11-27T17:54:09.563765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:40:45.568976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.587274+0000","last_change":"2023-11-27T17:54:07.337576+0000","last_active":"2023-11-27T17:54:08.587274+0000","last_peered":"2023-11-27T17:54:08.587274+0000","last_clean":"2023-11-27T17:54:08.587274+0000","last_became_active":"2023-11-27T17:54:07.337029+0000","last_became_peered":"2023-11-27T17:54:07.337029+0000","last_unstale":"2023-11-27T17:54:08.587274+0000","last_undegraded":"2023-11-27T17:54:08.587274+0000","last_fullsized":"2023-11-27T17:54:08.587274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:33:32.337624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.586883+0000","last_change":"2023-11-27T17:54:07.337411+0000","last_active":"2023-11-27T17:54:08.586883+0000","last_peered":"2023-11-27T17:54:08.586883+0000","last_clean":"2023-11-27T17:54:08.586883+0000","last_became_active":"2023-11-27T17:54:07.337089+0000","last_became_peered":"2023-11-27T17:54:07.337089+0000","last_unstale":"2023-11-27T17:54:08.586883+0000","last_undegraded":"2023-11-27T17:54:08.586883+0000","last_fullsized":"2023-11-27T17:54:08.586883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:36:20.447679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.516694+0000","last_change":"2023-11-27T17:54:07.314431+0000","last_active":"2023-11-27T17:54:08.516694+0000","last_peered":"2023-11-27T17:54:08.516694+0000","last_clean":"2023-11-27T17:54:08.516694+0000","last_became_active":"2023-11-27T17:54:07.313439+0000","last_became_peered":"2023-11-27T17:54:07.313439+0000","last_unstale":"2023-11-27T17:54:08.516694+0000","last_undegraded":"2023-11-27T17:54:08.516694+0000","last_fullsized":"2023-11-27T17:54:08.516694+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:25:06.753234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.330604+0000","last_change":"2023-11-27T17:54:07.335916+0000","last_active":"2023-11-27T17:54:08.330604+0000","last_peered":"2023-11-27T17:54:08.330604+0000","last_clean":"2023-11-27T17:54:08.330604+0000","last_became_active":"2023-11-27T17:54:07.335088+0000","last_became_peered":"2023-11-27T17:54:07.335088+0000","last_unstale":"2023-11-27T17:54:08.330604+0000","last_undegraded":"2023-11-27T17:54:08.330604+0000","last_fullsized":"2023-11-27T17:54:08.330604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:10:10.941300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.330671+0000","last_change":"2023-11-27T17:54:07.333388+0000","last_active":"2023-11-27T17:54:08.330671+0000","last_peered":"2023-11-27T17:54:08.330671+0000","last_clean":"2023-11-27T17:54:08.330671+0000","last_became_active":"2023-11-27T17:54:07.332703+0000","last_became_peered":"2023-11-27T17:54:07.332703+0000","last_unstale":"2023-11-27T17:54:08.330671+0000","last_undegraded":"2023-11-27T17:54:08.330671+0000","last_fullsized":"2023-11-27T17:54:08.330671+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:14:14.448217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.326473+0000","last_change":"2023-11-27T17:54:07.351360+0000","last_active":"2023-11-27T17:54:08.326473+0000","last_peered":"2023-11-27T17:54:08.326473+0000","last_clean":"2023-11-27T17:54:08.326473+0000","last_became_active":"2023-11-27T17:54:07.350818+0000","last_became_peered":"2023-11-27T17:54:07.350818+0000","last_unstale":"2023-11-27T17:54:08.326473+0000","last_undegraded":"2023-11-27T17:54:08.326473+0000","last_fullsized":"2023-11-27T17:54:08.326473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:25.495092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.328934+0000","last_change":"2023-11-27T17:54:07.314496+0000","last_active":"2023-11-27T17:54:08.328934+0000","last_peered":"2023-11-27T17:54:08.328934+0000","last_clean":"2023-11-27T17:54:08.328934+0000","last_became_active":"2023-11-27T17:54:07.313754+0000","last_became_peered":"2023-11-27T17:54:07.313754+0000","last_unstale":"2023-11-27T17:54:08.328934+0000","last_undegraded":"2023-11-27T17:54:08.328934+0000","last_fullsized":"2023-11-27T17:54:08.328934+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:14:06.896627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.723217+0000","last_change":"2023-11-27T17:54:07.354685+0000","last_active":"2023-11-27T17:54:09.723217+0000","last_peered":"2023-11-27T17:54:09.723217+0000","last_clean":"2023-11-27T17:54:09.723217+0000","last_became_active":"2023-11-27T17:54:07.354467+0000","last_became_peered":"2023-11-27T17:54:07.354467+0000","last_unstale":"2023-11-27T17:54:09.723217+0000","last_undegraded":"2023-11-27T17:54:09.723217+0000","last_fullsized":"2023-11-27T17:54:09.723217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:06.259735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.587517+0000","last_change":"2023-11-27T17:54:07.350260+0000","last_active":"2023-11-27T17:54:08.587517+0000","last_peered":"2023-11-27T17:54:08.587517+0000","last_clean":"2023-11-27T17:54:08.587517+0000","last_became_active":"2023-11-27T17:54:07.349996+0000","last_became_peered":"2023-11-27T17:54:07.349996+0000","last_unstale":"2023-11-27T17:54:08.587517+0000","last_undegraded":"2023-11-27T17:54:08.587517+0000","last_fullsized":"2023-11-27T17:54:08.587517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:26:24.509355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.723424+0000","last_change":"2023-11-27T17:54:07.330877+0000","last_active":"2023-11-27T17:54:09.723424+0000","last_peered":"2023-11-27T17:54:09.723424+0000","last_clean":"2023-11-27T17:54:09.723424+0000","last_became_active":"2023-11-27T17:54:07.330126+0000","last_became_peered":"2023-11-27T17:54:07.330126+0000","last_unstale":"2023-11-27T17:54:09.723424+0000","last_undegraded":"2023-11-27T17:54:09.723424+0000","last_fullsized":"2023-11-27T17:54:09.723424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:14:06.896627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.331135+0000","last_change":"2023-11-27T17:54:07.324587+0000","last_active":"2023-11-27T17:54:08.331135+0000","last_peered":"2023-11-27T17:54:08.331135+0000","last_clean":"2023-11-27T17:54:08.331135+0000","last_became_active":"2023-11-27T17:54:07.323840+0000","last_became_peered":"2023-11-27T17:54:07.323840+0000","last_unstale":"2023-11-27T17:54:08.331135+0000","last_undegraded":"2023-11-27T17:54:08.331135+0000","last_fullsized":"2023-11-27T17:54:08.331135+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:36:20.447679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.330965+0000","last_change":"2023-11-27T17:54:07.324696+0000","last_active":"2023-11-27T17:54:08.330965+0000","last_peered":"2023-11-27T17:54:08.330965+0000","last_clean":"2023-11-27T17:54:08.330965+0000","last_became_active":"2023-11-27T17:54:07.323930+0000","last_became_peered":"2023-11-27T17:54:07.323930+0000","last_unstale":"2023-11-27T17:54:08.330965+0000","last_undegraded":"2023-11-27T17:54:08.330965+0000","last_fullsized":"2023-11-27T17:54:08.330965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:33:15.211399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.563001+0000","last_change":"2023-11-27T17:54:07.328471+0000","last_active":"2023-11-27T17:54:09.563001+0000","last_peered":"2023-11-27T17:54:09.563001+0000","last_clean":"2023-11-27T17:54:09.563001+0000","last_became_active":"2023-11-27T17:54:07.327671+0000","last_became_peered":"2023-11-27T17:54:07.327671+0000","last_unstale":"2023-11-27T17:54:09.563001+0000","last_undegraded":"2023-11-27T17:54:09.563001+0000","last_fullsized":"2023-11-27T17:54:09.563001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:20.390567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.724001+0000","last_change":"2023-11-27T17:54:07.336950+0000","last_active":"2023-11-27T17:54:09.724001+0000","last_peered":"2023-11-27T17:54:09.724001+0000","last_clean":"2023-11-27T17:54:09.724001+0000","last_became_active":"2023-11-27T17:54:07.335770+0000","last_became_peered":"2023-11-27T17:54:07.335770+0000","last_unstale":"2023-11-27T17:54:09.724001+0000","last_undegraded":"2023-11-27T17:54:09.724001+0000","last_fullsized":"2023-11-27T17:54:09.724001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:33:07.383987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.562987+0000","last_change":"2023-11-27T17:54:07.339405+0000","last_active":"2023-11-27T17:54:09.562987+0000","last_peered":"2023-11-27T17:54:09.562987+0000","last_clean":"2023-11-27T17:54:09.562987+0000","last_became_active":"2023-11-27T17:54:07.331900+0000","last_became_peered":"2023-11-27T17:54:07.331900+0000","last_unstale":"2023-11-27T17:54:09.562987+0000","last_undegraded":"2023-11-27T17:54:09.562987+0000","last_fullsized":"2023-11-27T17:54:09.562987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:29.196608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.326745+0000","last_change":"2023-11-27T17:54:07.327583+0000","last_active":"2023-11-27T17:54:08.326745+0000","last_peered":"2023-11-27T17:54:08.326745+0000","last_clean":"2023-11-27T17:54:08.326745+0000","last_became_active":"2023-11-27T17:54:07.327233+0000","last_became_peered":"2023-11-27T17:54:07.327233+0000","last_unstale":"2023-11-27T17:54:08.326745+0000","last_undegraded":"2023-11-27T17:54:08.326745+0000","last_fullsized":"2023-11-27T17:54:08.326745+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:42:47.267855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'4","reported_seq":16,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.360519+0000","last_change":"2023-11-27T17:54:06.321770+0000","last_active":"2023-11-27T17:54:07.360519+0000","last_peered":"2023-11-27T17:54:07.360519+0000","last_clean":"2023-11-27T17:54:07.360519+0000","last_became_active":"2023-11-27T17:54:06.321146+0000","last_became_peered":"2023-11-27T17:54:06.321146+0000","last_unstale":"2023-11-27T17:54:07.360519+0000","last_undegraded":"2023-11-27T17:54:07.360519+0000","last_fullsized":"2023-11-27T17:54:07.360519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:11:38.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.724169+0000","last_change":"2023-11-27T17:54:07.332824+0000","last_active":"2023-11-27T17:54:09.724169+0000","last_peered":"2023-11-27T17:54:09.724169+0000","last_clean":"2023-11-27T17:54:09.724169+0000","last_became_active":"2023-11-27T17:54:07.332130+0000","last_became_peered":"2023-11-27T17:54:07.332130+0000","last_unstale":"2023-11-27T17:54:09.724169+0000","last_undegraded":"2023-11-27T17:54:09.724169+0000","last_fullsized":"2023-11-27T17:54:09.724169+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:49.605702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.360095+0000","last_change":"2023-11-27T17:54:06.325480+0000","last_active":"2023-11-27T17:54:07.360095+0000","last_peered":"2023-11-27T17:54:07.360095+0000","last_clean":"2023-11-27T17:54:07.360095+0000","last_became_active":"2023-11-27T17:54:06.325069+0000","last_became_peered":"2023-11-27T17:54:06.325069+0000","last_unstale":"2023-11-27T17:54:07.360095+0000","last_undegraded":"2023-11-27T17:54:07.360095+0000","last_fullsized":"2023-11-27T17:54:07.360095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:02.393127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.331982+0000","last_change":"2023-11-27T17:54:07.331877+0000","last_active":"2023-11-27T17:54:08.331982+0000","last_peered":"2023-11-27T17:54:08.331982+0000","last_clean":"2023-11-27T17:54:08.331982+0000","last_became_active":"2023-11-27T17:54:07.331181+0000","last_became_peered":"2023-11-27T17:54:07.331181+0000","last_unstale":"2023-11-27T17:54:08.331982+0000","last_undegraded":"2023-11-27T17:54:08.331982+0000","last_fullsized":"2023-11-27T17:54:08.331982+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:10.038684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.364723+0000","last_change":"2023-11-27T17:54:06.319150+0000","last_active":"2023-11-27T17:54:07.364723+0000","last_peered":"2023-11-27T17:54:07.364723+0000","last_clean":"2023-11-27T17:54:07.364723+0000","last_became_active":"2023-11-27T17:54:06.318665+0000","last_became_peered":"2023-11-27T17:54:06.318665+0000","last_unstale":"2023-11-27T17:54:07.364723+0000","last_undegraded":"2023-11-27T17:54:07.364723+0000","last_fullsized":"2023-11-27T17:54:07.364723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:05:47.434250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.723443+0000","last_change":"2023-11-27T17:54:07.331123+0000","last_active":"2023-11-27T17:54:09.723443+0000","last_peered":"2023-11-27T17:54:09.723443+0000","last_clean":"2023-11-27T17:54:09.723443+0000","last_became_active":"2023-11-27T17:54:07.330564+0000","last_became_peered":"2023-11-27T17:54:07.330564+0000","last_unstale":"2023-11-27T17:54:09.723443+0000","last_undegraded":"2023-11-27T17:54:09.723443+0000","last_fullsized":"2023-11-27T17:54:09.723443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:18:20.390567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.355985+0000","last_change":"2023-11-27T17:54:06.325316+0000","last_active":"2023-11-27T17:54:07.355985+0000","last_peered":"2023-11-27T17:54:07.355985+0000","last_clean":"2023-11-27T17:54:07.355985+0000","last_became_active":"2023-11-27T17:54:06.325047+0000","last_became_peered":"2023-11-27T17:54:06.325047+0000","last_unstale":"2023-11-27T17:54:07.355985+0000","last_undegraded":"2023-11-27T17:54:07.355985+0000","last_fullsized":"2023-11-27T17:54:07.355985+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:49:42.763823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.563429+0000","last_change":"2023-11-27T17:54:07.339036+0000","last_active":"2023-11-27T17:54:09.563429+0000","last_peered":"2023-11-27T17:54:09.563429+0000","last_clean":"2023-11-27T17:54:09.563429+0000","last_became_active":"2023-11-27T17:54:07.332057+0000","last_became_peered":"2023-11-27T17:54:07.332057+0000","last_unstale":"2023-11-27T17:54:09.563429+0000","last_undegraded":"2023-11-27T17:54:09.563429+0000","last_fullsized":"2023-11-27T17:54:09.563429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:17:00.752356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.365377+0000","last_change":"2023-11-27T17:54:06.317342+0000","last_active":"2023-11-27T17:54:07.365377+0000","last_peered":"2023-11-27T17:54:07.365377+0000","last_clean":"2023-11-27T17:54:07.365377+0000","last_became_active":"2023-11-27T17:54:06.314311+0000","last_became_peered":"2023-11-27T17:54:06.314311+0000","last_unstale":"2023-11-27T17:54:07.365377+0000","last_undegraded":"2023-11-27T17:54:07.365377+0000","last_fullsized":"2023-11-27T17:54:07.365377+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:43:35.415584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.330107+0000","last_change":"2023-11-27T17:54:07.339953+0000","last_active":"2023-11-27T17:54:08.330107+0000","last_peered":"2023-11-27T17:54:08.330107+0000","last_clean":"2023-11-27T17:54:08.330107+0000","last_became_active":"2023-11-27T17:54:07.336054+0000","last_became_peered":"2023-11-27T17:54:07.336054+0000","last_unstale":"2023-11-27T17:54:08.330107+0000","last_undegraded":"2023-11-27T17:54:08.330107+0000","last_fullsized":"2023-11-27T17:54:08.330107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:26:30.786685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.365355+0000","last_change":"2023-11-27T17:54:06.316027+0000","last_active":"2023-11-27T17:54:07.365355+0000","last_peered":"2023-11-27T17:54:07.365355+0000","last_clean":"2023-11-27T17:54:07.365355+0000","last_became_active":"2023-11-27T17:54:06.315103+0000","last_became_peered":"2023-11-27T17:54:06.315103+0000","last_unstale":"2023-11-27T17:54:07.365355+0000","last_undegraded":"2023-11-27T17:54:07.365355+0000","last_fullsized":"2023-11-27T17:54:07.365355+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:02.393127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.329643+0000","last_change":"2023-11-27T17:54:07.319518+0000","last_active":"2023-11-27T17:54:08.329643+0000","last_peered":"2023-11-27T17:54:08.329643+0000","last_clean":"2023-11-27T17:54:08.329643+0000","last_became_active":"2023-11-27T17:54:07.318726+0000","last_became_peered":"2023-11-27T17:54:07.318726+0000","last_unstale":"2023-11-27T17:54:08.329643+0000","last_undegraded":"2023-11-27T17:54:08.329643+0000","last_fullsized":"2023-11-27T17:54:08.329643+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:42:47.267855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.331795+0000","last_change":"2023-11-27T17:54:06.311550+0000","last_active":"2023-11-27T17:54:07.331795+0000","last_peered":"2023-11-27T17:54:07.331795+0000","last_clean":"2023-11-27T17:54:07.331795+0000","last_became_active":"2023-11-27T17:54:06.311206+0000","last_became_peered":"2023-11-27T17:54:06.311206+0000","last_unstale":"2023-11-27T17:54:07.331795+0000","last_undegraded":"2023-11-27T17:54:07.331795+0000","last_fullsized":"2023-11-27T17:54:07.331795+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:14:05.883974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.722421+0000","last_change":"2023-11-27T17:54:07.327400+0000","last_active":"2023-11-27T17:54:09.722421+0000","last_peered":"2023-11-27T17:54:09.722421+0000","last_clean":"2023-11-27T17:54:09.722421+0000","last_became_active":"2023-11-27T17:54:07.326655+0000","last_became_peered":"2023-11-27T17:54:07.326655+0000","last_unstale":"2023-11-27T17:54:09.722421+0000","last_undegraded":"2023-11-27T17:54:09.722421+0000","last_fullsized":"2023-11-27T17:54:09.722421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:05:48.446903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.300060+0000","last_change":"2023-11-27T17:54:06.321465+0000","last_active":"2023-11-27T17:54:07.300060+0000","last_peered":"2023-11-27T17:54:07.300060+0000","last_clean":"2023-11-27T17:54:07.300060+0000","last_became_active":"2023-11-27T17:54:06.321030+0000","last_became_peered":"2023-11-27T17:54:06.321030+0000","last_unstale":"2023-11-27T17:54:07.300060+0000","last_undegraded":"2023-11-27T17:54:07.300060+0000","last_fullsized":"2023-11-27T17:54:07.300060+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:26:37.239204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.331158+0000","last_change":"2023-11-27T17:54:07.340822+0000","last_active":"2023-11-27T17:54:08.331158+0000","last_peered":"2023-11-27T17:54:08.331158+0000","last_clean":"2023-11-27T17:54:08.331158+0000","last_became_active":"2023-11-27T17:54:07.336231+0000","last_became_peered":"2023-11-27T17:54:07.336231+0000","last_unstale":"2023-11-27T17:54:08.331158+0000","last_undegraded":"2023-11-27T17:54:08.331158+0000","last_fullsized":"2023-11-27T17:54:08.331158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:01:00.356660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.309386+0000","last_change":"2023-11-27T17:54:06.325398+0000","last_active":"2023-11-27T17:54:07.309386+0000","last_peered":"2023-11-27T17:54:07.309386+0000","last_clean":"2023-11-27T17:54:07.309386+0000","last_became_active":"2023-11-27T17:54:06.325070+0000","last_became_peered":"2023-11-27T17:54:06.325070+0000","last_unstale":"2023-11-27T17:54:07.309386+0000","last_undegraded":"2023-11-27T17:54:07.309386+0000","last_fullsized":"2023-11-27T17:54:07.309386+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:09.026031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.587104+0000","last_change":"2023-11-27T17:54:07.340780+0000","last_active":"2023-11-27T17:54:08.587104+0000","last_peered":"2023-11-27T17:54:08.587104+0000","last_clean":"2023-11-27T17:54:08.587104+0000","last_became_active":"2023-11-27T17:54:07.340323+0000","last_became_peered":"2023-11-27T17:54:07.340323+0000","last_unstale":"2023-11-27T17:54:08.587104+0000","last_undegraded":"2023-11-27T17:54:08.587104+0000","last_fullsized":"2023-11-27T17:54:08.587104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:40:45.568976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.306429+0000","last_change":"2023-11-27T17:54:06.317273+0000","last_active":"2023-11-27T17:54:07.306429+0000","last_peered":"2023-11-27T17:54:07.306429+0000","last_clean":"2023-11-27T17:54:07.306429+0000","last_became_active":"2023-11-27T17:54:06.316934+0000","last_became_peered":"2023-11-27T17:54:06.316934+0000","last_unstale":"2023-11-27T17:54:07.306429+0000","last_undegraded":"2023-11-27T17:54:07.306429+0000","last_fullsized":"2023-11-27T17:54:07.306429+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:36:19.778982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.586999+0000","last_change":"2023-11-27T17:54:07.349713+0000","last_active":"2023-11-27T17:54:08.586999+0000","last_peered":"2023-11-27T17:54:08.586999+0000","last_clean":"2023-11-27T17:54:08.586999+0000","last_became_active":"2023-11-27T17:54:07.349394+0000","last_became_peered":"2023-11-27T17:54:07.349394+0000","last_unstale":"2023-11-27T17:54:08.586999+0000","last_undegraded":"2023-11-27T17:54:08.586999+0000","last_fullsized":"2023-11-27T17:54:08.586999+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:01:00.356660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"29'3","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.361026+0000","last_change":"2023-11-27T17:54:06.327227+0000","last_active":"2023-11-27T17:54:07.361026+0000","last_peered":"2023-11-27T17:54:07.361026+0000","last_clean":"2023-11-27T17:54:07.361026+0000","last_became_active":"2023-11-27T17:54:06.326574+0000","last_became_peered":"2023-11-27T17:54:06.326574+0000","last_unstale":"2023-11-27T17:54:07.361026+0000","last_undegraded":"2023-11-27T17:54:07.361026+0000","last_fullsized":"2023-11-27T17:54:07.361026+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:28.183955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.330007+0000","last_change":"2023-11-27T17:54:07.341229+0000","last_active":"2023-11-27T17:54:08.330007+0000","last_peered":"2023-11-27T17:54:08.330007+0000","last_clean":"2023-11-27T17:54:08.330007+0000","last_became_active":"2023-11-27T17:54:07.340500+0000","last_became_peered":"2023-11-27T17:54:07.340500+0000","last_unstale":"2023-11-27T17:54:08.330007+0000","last_undegraded":"2023-11-27T17:54:08.330007+0000","last_fullsized":"2023-11-27T17:54:08.330007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T17:59:59.353448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'6","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.366922+0000","last_change":"2023-11-27T17:54:06.325981+0000","last_active":"2023-11-27T17:54:07.366922+0000","last_peered":"2023-11-27T17:54:07.366922+0000","last_clean":"2023-11-27T17:54:07.366922+0000","last_became_active":"2023-11-27T17:54:06.325463+0000","last_became_peered":"2023-11-27T17:54:06.325463+0000","last_unstale":"2023-11-27T17:54:07.366922+0000","last_undegraded":"2023-11-27T17:54:07.366922+0000","last_fullsized":"2023-11-27T17:54:07.366922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:42:28.183955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.722547+0000","last_change":"2023-11-27T17:54:07.334308+0000","last_active":"2023-11-27T17:54:09.722547+0000","last_peered":"2023-11-27T17:54:09.722547+0000","last_clean":"2023-11-27T17:54:09.722547+0000","last_became_active":"2023-11-27T17:54:07.333977+0000","last_became_peered":"2023-11-27T17:54:07.333977+0000","last_unstale":"2023-11-27T17:54:09.722547+0000","last_undegraded":"2023-11-27T17:54:09.722547+0000","last_fullsized":"2023-11-27T17:54:09.722547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:41:10.038684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.358493+0000","last_change":"2023-11-27T17:54:06.311588+0000","last_active":"2023-11-27T17:54:07.358493+0000","last_peered":"2023-11-27T17:54:07.358493+0000","last_clean":"2023-11-27T17:54:07.358493+0000","last_became_active":"2023-11-27T17:54:06.310837+0000","last_became_peered":"2023-11-27T17:54:06.310837+0000","last_unstale":"2023-11-27T17:54:07.358493+0000","last_undegraded":"2023-11-27T17:54:07.358493+0000","last_fullsized":"2023-11-27T17:54:07.358493+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:33:06.371334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.587353+0000","last_change":"2023-11-27T17:54:07.335016+0000","last_active":"2023-11-27T17:54:08.587353+0000","last_peered":"2023-11-27T17:54:08.587353+0000","last_clean":"2023-11-27T17:54:08.587353+0000","last_became_active":"2023-11-27T17:54:07.334586+0000","last_became_peered":"2023-11-27T17:54:07.334586+0000","last_unstale":"2023-11-27T17:54:08.587353+0000","last_undegraded":"2023-11-27T17:54:08.587353+0000","last_fullsized":"2023-11-27T17:54:08.587353+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:17:42.703884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.315385+0000","last_change":"2023-11-27T17:54:06.323074+0000","last_active":"2023-11-27T17:54:07.315385+0000","last_peered":"2023-11-27T17:54:07.315385+0000","last_clean":"2023-11-27T17:54:07.315385+0000","last_became_active":"2023-11-27T17:54:06.322721+0000","last_became_peered":"2023-11-27T17:54:06.322721+0000","last_unstale":"2023-11-27T17:54:07.315385+0000","last_undegraded":"2023-11-27T17:54:07.315385+0000","last_fullsized":"2023-11-27T17:54:07.315385+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:23.300265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.563386+0000","last_change":"2023-11-27T17:54:07.340000+0000","last_active":"2023-11-27T17:54:09.563386+0000","last_peered":"2023-11-27T17:54:09.563386+0000","last_clean":"2023-11-27T17:54:09.563386+0000","last_became_active":"2023-11-27T17:54:07.338813+0000","last_became_peered":"2023-11-27T17:54:07.338813+0000","last_unstale":"2023-11-27T17:54:09.563386+0000","last_undegraded":"2023-11-27T17:54:09.563386+0000","last_fullsized":"2023-11-27T17:54:09.563386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:26:30.786685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.331592+0000","last_change":"2023-11-27T17:54:06.325746+0000","last_active":"2023-11-27T17:54:07.331592+0000","last_peered":"2023-11-27T17:54:07.331592+0000","last_clean":"2023-11-27T17:54:07.331592+0000","last_became_active":"2023-11-27T17:54:06.325300+0000","last_became_peered":"2023-11-27T17:54:06.325300+0000","last_unstale":"2023-11-27T17:54:07.331592+0000","last_undegraded":"2023-11-27T17:54:07.331592+0000","last_fullsized":"2023-11-27T17:54:07.331592+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:24:05.247081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.724160+0000","last_change":"2023-11-27T17:54:07.337962+0000","last_active":"2023-11-27T17:54:09.724160+0000","last_peered":"2023-11-27T17:54:09.724160+0000","last_clean":"2023-11-27T17:54:09.724160+0000","last_became_active":"2023-11-27T17:54:07.337085+0000","last_became_peered":"2023-11-27T17:54:07.337085+0000","last_unstale":"2023-11-27T17:54:09.724160+0000","last_undegraded":"2023-11-27T17:54:09.724160+0000","last_fullsized":"2023-11-27T17:54:09.724160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:25.495092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"29'8","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.365609+0000","last_change":"2023-11-27T17:54:06.315180+0000","last_active":"2023-11-27T17:54:07.365609+0000","last_peered":"2023-11-27T17:54:07.365609+0000","last_clean":"2023-11-27T17:54:07.365609+0000","last_became_active":"2023-11-27T17:54:06.314713+0000","last_became_peered":"2023-11-27T17:54:06.314713+0000","last_unstale":"2023-11-27T17:54:07.365609+0000","last_undegraded":"2023-11-27T17:54:07.365609+0000","last_fullsized":"2023-11-27T17:54:07.365609+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:33:14.198746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.331722+0000","last_change":"2023-11-27T17:54:07.321152+0000","last_active":"2023-11-27T17:54:08.331722+0000","last_peered":"2023-11-27T17:54:08.331722+0000","last_clean":"2023-11-27T17:54:08.331722+0000","last_became_active":"2023-11-27T17:54:07.320224+0000","last_became_peered":"2023-11-27T17:54:07.320224+0000","last_unstale":"2023-11-27T17:54:08.331722+0000","last_undegraded":"2023-11-27T17:54:08.331722+0000","last_fullsized":"2023-11-27T17:54:08.331722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:05:48.446903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.365149+0000","last_change":"2023-11-27T17:54:06.320657+0000","last_active":"2023-11-27T17:54:07.365149+0000","last_peered":"2023-11-27T17:54:07.365149+0000","last_clean":"2023-11-27T17:54:07.365149+0000","last_became_active":"2023-11-27T17:54:06.320277+0000","last_became_peered":"2023-11-27T17:54:06.320277+0000","last_unstale":"2023-11-27T17:54:07.365149+0000","last_undegraded":"2023-11-27T17:54:07.365149+0000","last_fullsized":"2023-11-27T17:54:07.365149+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:10:09.928647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.331326+0000","last_change":"2023-11-27T17:54:07.314145+0000","last_active":"2023-11-27T17:54:08.331326+0000","last_peered":"2023-11-27T17:54:08.331326+0000","last_clean":"2023-11-27T17:54:08.331326+0000","last_became_active":"2023-11-27T17:54:07.313333+0000","last_became_peered":"2023-11-27T17:54:07.313333+0000","last_unstale":"2023-11-27T17:54:08.331326+0000","last_undegraded":"2023-11-27T17:54:08.331326+0000","last_fullsized":"2023-11-27T17:54:08.331326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:40:45.568976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.358417+0000","last_change":"2023-11-27T17:54:06.323888+0000","last_active":"2023-11-27T17:54:07.358417+0000","last_peered":"2023-11-27T17:54:07.358417+0000","last_clean":"2023-11-27T17:54:07.358417+0000","last_became_active":"2023-11-27T17:54:06.323349+0000","last_became_peered":"2023-11-27T17:54:06.323349+0000","last_unstale":"2023-11-27T17:54:07.358417+0000","last_undegraded":"2023-11-27T17:54:07.358417+0000","last_fullsized":"2023-11-27T17:54:07.358417+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:23.300265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.722934+0000","last_change":"2023-11-27T17:54:07.332806+0000","last_active":"2023-11-27T17:54:09.722934+0000","last_peered":"2023-11-27T17:54:09.722934+0000","last_clean":"2023-11-27T17:54:09.722934+0000","last_became_active":"2023-11-27T17:54:07.332562+0000","last_became_peered":"2023-11-27T17:54:07.332562+0000","last_unstale":"2023-11-27T17:54:09.722934+0000","last_undegraded":"2023-11-27T17:54:09.722934+0000","last_fullsized":"2023-11-27T17:54:09.722934+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:05:05.555549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"29'1","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.358280+0000","last_change":"2023-11-27T17:54:06.309621+0000","last_active":"2023-11-27T17:54:07.358280+0000","last_peered":"2023-11-27T17:54:07.358280+0000","last_clean":"2023-11-27T17:54:07.358280+0000","last_became_active":"2023-11-27T17:54:06.304677+0000","last_became_peered":"2023-11-27T17:54:06.304677+0000","last_unstale":"2023-11-27T17:54:07.358280+0000","last_undegraded":"2023-11-27T17:54:07.358280+0000","last_fullsized":"2023-11-27T17:54:07.358280+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T20:11:38.179422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.516549+0000","last_change":"2023-11-27T17:54:07.322717+0000","last_active":"2023-11-27T17:54:08.516549+0000","last_peered":"2023-11-27T17:54:08.516549+0000","last_clean":"2023-11-27T17:54:08.516549+0000","last_became_active":"2023-11-27T17:54:07.321964+0000","last_became_peered":"2023-11-27T17:54:07.321964+0000","last_unstale":"2023-11-27T17:54:08.516549+0000","last_undegraded":"2023-11-27T17:54:08.516549+0000","last_fullsized":"2023-11-27T17:54:08.516549+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:31:03.405781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.300943+0000","last_change":"2023-11-27T17:54:06.315081+0000","last_active":"2023-11-27T17:54:07.300943+0000","last_peered":"2023-11-27T17:54:07.300943+0000","last_clean":"2023-11-27T17:54:07.300943+0000","last_became_active":"2023-11-27T17:54:06.314372+0000","last_became_peered":"2023-11-27T17:54:06.314372+0000","last_unstale":"2023-11-27T17:54:07.300943+0000","last_undegraded":"2023-11-27T17:54:07.300943+0000","last_fullsized":"2023-11-27T17:54:07.300943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T19:36:19.778982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.516421+0000","last_change":"2023-11-27T17:54:07.320218+0000","last_active":"2023-11-27T17:54:08.516421+0000","last_peered":"2023-11-27T17:54:08.516421+0000","last_clean":"2023-11-27T17:54:08.516421+0000","last_became_active":"2023-11-27T17:54:07.319390+0000","last_became_peered":"2023-11-27T17:54:07.319390+0000","last_unstale":"2023-11-27T17:54:08.516421+0000","last_undegraded":"2023-11-27T17:54:08.516421+0000","last_fullsized":"2023-11-27T17:54:08.516421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T05:38:05.875217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.356306+0000","last_change":"2023-11-27T17:54:06.311022+0000","last_active":"2023-11-27T17:54:07.356306+0000","last_peered":"2023-11-27T17:54:07.356306+0000","last_clean":"2023-11-27T17:54:07.356306+0000","last_became_active":"2023-11-27T17:54:06.310698+0000","last_became_peered":"2023-11-27T17:54:06.310698+0000","last_unstale":"2023-11-27T17:54:07.356306+0000","last_undegraded":"2023-11-27T17:54:07.356306+0000","last_fullsized":"2023-11-27T17:54:07.356306+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:33:06.371334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.516544+0000","last_change":"2023-11-27T17:54:07.334441+0000","last_active":"2023-11-27T17:54:08.516544+0000","last_peered":"2023-11-27T17:54:08.516544+0000","last_clean":"2023-11-27T17:54:08.516544+0000","last_became_active":"2023-11-27T17:54:07.334085+0000","last_became_peered":"2023-11-27T17:54:07.334085+0000","last_unstale":"2023-11-27T17:54:08.516544+0000","last_undegraded":"2023-11-27T17:54:08.516544+0000","last_fullsized":"2023-11-27T17:54:08.516544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:26:38.251858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.306717+0000","last_change":"2023-11-27T17:54:06.322862+0000","last_active":"2023-11-27T17:54:07.306717+0000","last_peered":"2023-11-27T17:54:07.306717+0000","last_clean":"2023-11-27T17:54:07.306717+0000","last_became_active":"2023-11-27T17:54:06.322421+0000","last_became_peered":"2023-11-27T17:54:06.322421+0000","last_unstale":"2023-11-27T17:54:07.306717+0000","last_undegraded":"2023-11-27T17:54:07.306717+0000","last_fullsized":"2023-11-27T17:54:07.306717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:25:05.740581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.516159+0000","last_change":"2023-11-27T17:54:07.333293+0000","last_active":"2023-11-27T17:54:08.516159+0000","last_peered":"2023-11-27T17:54:08.516159+0000","last_clean":"2023-11-27T17:54:08.516159+0000","last_became_active":"2023-11-27T17:54:07.332711+0000","last_became_peered":"2023-11-27T17:54:07.332711+0000","last_unstale":"2023-11-27T17:54:08.516159+0000","last_undegraded":"2023-11-27T17:54:08.516159+0000","last_fullsized":"2023-11-27T17:54:08.516159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:03:55.931888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.300182+0000","last_change":"2023-11-27T17:54:06.319157+0000","last_active":"2023-11-27T17:54:07.300182+0000","last_peered":"2023-11-27T17:54:07.300182+0000","last_clean":"2023-11-27T17:54:07.300182+0000","last_became_active":"2023-11-27T17:54:06.318582+0000","last_became_peered":"2023-11-27T17:54:06.318582+0000","last_unstale":"2023-11-27T17:54:07.300182+0000","last_undegraded":"2023-11-27T17:54:07.300182+0000","last_fullsized":"2023-11-27T17:54:07.300182+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T03:25:05.740581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.562983+0000","last_change":"2023-11-27T17:54:07.329559+0000","last_active":"2023-11-27T17:54:09.562983+0000","last_peered":"2023-11-27T17:54:09.562983+0000","last_clean":"2023-11-27T17:54:09.562983+0000","last_became_active":"2023-11-27T17:54:07.327816+0000","last_became_peered":"2023-11-27T17:54:07.327816+0000","last_unstale":"2023-11-27T17:54:09.562983+0000","last_undegraded":"2023-11-27T17:54:09.562983+0000","last_fullsized":"2023-11-27T17:54:09.562983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T01:14:06.896627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.299632+0000","last_change":"2023-11-27T17:54:06.325771+0000","last_active":"2023-11-27T17:54:07.299632+0000","last_peered":"2023-11-27T17:54:07.299632+0000","last_clean":"2023-11-27T17:54:07.299632+0000","last_became_active":"2023-11-27T17:54:06.325357+0000","last_became_peered":"2023-11-27T17:54:06.325357+0000","last_unstale":"2023-11-27T17:54:07.299632+0000","last_undegraded":"2023-11-27T17:54:07.299632+0000","last_fullsized":"2023-11-27T17:54:07.299632+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:32:10.062941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.516443+0000","last_change":"2023-11-27T17:54:07.316602+0000","last_active":"2023-11-27T17:54:08.516443+0000","last_peered":"2023-11-27T17:54:08.516443+0000","last_clean":"2023-11-27T17:54:08.516443+0000","last_became_active":"2023-11-27T17:54:07.315790+0000","last_became_peered":"2023-11-27T17:54:07.315790+0000","last_unstale":"2023-11-27T17:54:08.516443+0000","last_undegraded":"2023-11-27T17:54:08.516443+0000","last_fullsized":"2023-11-27T17:54:08.516443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:13:09.850229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'2","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.359353+0000","last_change":"2023-11-27T17:54:06.315575+0000","last_active":"2023-11-27T17:54:07.359353+0000","last_peered":"2023-11-27T17:54:07.359353+0000","last_clean":"2023-11-27T17:54:07.359353+0000","last_became_active":"2023-11-27T17:54:06.315146+0000","last_became_peered":"2023-11-27T17:54:06.315146+0000","last_unstale":"2023-11-27T17:54:07.359353+0000","last_undegraded":"2023-11-27T17:54:07.359353+0000","last_fullsized":"2023-11-27T17:54:07.359353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:14:13.435564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.331404+0000","last_change":"2023-11-27T17:54:07.334518+0000","last_active":"2023-11-27T17:54:08.331404+0000","last_peered":"2023-11-27T17:54:08.331404+0000","last_clean":"2023-11-27T17:54:08.331404+0000","last_became_active":"2023-11-27T17:54:07.333829+0000","last_became_peered":"2023-11-27T17:54:07.333829+0000","last_unstale":"2023-11-27T17:54:08.331404+0000","last_undegraded":"2023-11-27T17:54:08.331404+0000","last_fullsized":"2023-11-27T17:54:08.331404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T02:55:24.027035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.326895+0000","last_change":"2023-11-27T17:54:06.311884+0000","last_active":"2023-11-27T17:54:08.326895+0000","last_peered":"2023-11-27T17:54:08.326895+0000","last_clean":"2023-11-27T17:54:08.326895+0000","last_became_active":"2023-11-27T17:54:06.311007+0000","last_became_peered":"2023-11-27T17:54:06.311007+0000","last_unstale":"2023-11-27T17:54:08.326895+0000","last_undegraded":"2023-11-27T17:54:08.326895+0000","last_fullsized":"2023-11-27T17:54:08.326895+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:34:12.949366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.326673+0000","last_change":"2023-11-27T17:54:07.339525+0000","last_active":"2023-11-27T17:54:08.326673+0000","last_peered":"2023-11-27T17:54:08.326673+0000","last_clean":"2023-11-27T17:54:08.326673+0000","last_became_active":"2023-11-27T17:54:07.339252+0000","last_became_peered":"2023-11-27T17:54:07.339252+0000","last_unstale":"2023-11-27T17:54:08.326673+0000","last_undegraded":"2023-11-27T17:54:08.326673+0000","last_fullsized":"2023-11-27T17:54:08.326673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:49.605702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.325713+0000","last_change":"2023-11-27T17:54:06.318402+0000","last_active":"2023-11-27T17:54:07.325713+0000","last_peered":"2023-11-27T17:54:07.325713+0000","last_clean":"2023-11-27T17:54:07.325713+0000","last_became_active":"2023-11-27T17:54:06.315952+0000","last_became_peered":"2023-11-27T17:54:06.315952+0000","last_unstale":"2023-11-27T17:54:07.325713+0000","last_undegraded":"2023-11-27T17:54:07.325713+0000","last_fullsized":"2023-11-27T17:54:07.325713+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:42:46.255202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.724599+0000","last_change":"2023-11-27T17:54:07.325576+0000","last_active":"2023-11-27T17:54:09.724599+0000","last_peered":"2023-11-27T17:54:09.724599+0000","last_clean":"2023-11-27T17:54:09.724599+0000","last_became_active":"2023-11-27T17:54:07.322612+0000","last_became_peered":"2023-11-27T17:54:07.322612+0000","last_unstale":"2023-11-27T17:54:09.724599+0000","last_undegraded":"2023-11-27T17:54:09.724599+0000","last_fullsized":"2023-11-27T17:54:09.724599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:42:47.267855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.331209+0000","last_change":"2023-11-27T17:54:06.314853+0000","last_active":"2023-11-27T17:54:07.331209+0000","last_peered":"2023-11-27T17:54:07.331209+0000","last_clean":"2023-11-27T17:54:07.331209+0000","last_became_active":"2023-11-27T17:54:06.314510+0000","last_became_peered":"2023-11-27T17:54:06.314510+0000","last_unstale":"2023-11-27T17:54:07.331209+0000","last_undegraded":"2023-11-27T17:54:07.331209+0000","last_fullsized":"2023-11-27T17:54:07.331209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:03:23.300265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.327144+0000","last_change":"2023-11-27T17:54:07.353540+0000","last_active":"2023-11-27T17:54:08.327144+0000","last_peered":"2023-11-27T17:54:08.327144+0000","last_clean":"2023-11-27T17:54:08.327144+0000","last_became_active":"2023-11-27T17:54:07.353284+0000","last_became_peered":"2023-11-27T17:54:07.353284+0000","last_unstale":"2023-11-27T17:54:08.327144+0000","last_undegraded":"2023-11-27T17:54:08.327144+0000","last_fullsized":"2023-11-27T17:54:08.327144+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:10:10.941300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.315716+0000","last_change":"2023-11-27T17:54:06.317609+0000","last_active":"2023-11-27T17:54:07.315716+0000","last_peered":"2023-11-27T17:54:07.315716+0000","last_clean":"2023-11-27T17:54:07.315716+0000","last_became_active":"2023-11-27T17:54:06.315678+0000","last_became_peered":"2023-11-27T17:54:06.315678+0000","last_unstale":"2023-11-27T17:54:07.315716+0000","last_undegraded":"2023-11-27T17:54:07.315716+0000","last_fullsized":"2023-11-27T17:54:07.315716+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T22:37:24.482438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.586134+0000","last_change":"2023-11-27T17:54:07.319002+0000","last_active":"2023-11-27T17:54:08.586134+0000","last_peered":"2023-11-27T17:54:08.586134+0000","last_clean":"2023-11-27T17:54:08.586134+0000","last_became_active":"2023-11-27T17:54:07.318023+0000","last_became_peered":"2023-11-27T17:54:07.318023+0000","last_unstale":"2023-11-27T17:54:08.586134+0000","last_undegraded":"2023-11-27T17:54:08.586134+0000","last_fullsized":"2023-11-27T17:54:08.586134+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:26:30.786685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.300505+0000","last_change":"2023-11-27T17:54:06.315119+0000","last_active":"2023-11-27T17:54:07.300505+0000","last_peered":"2023-11-27T17:54:07.300505+0000","last_clean":"2023-11-27T17:54:07.300505+0000","last_became_active":"2023-11-27T17:54:06.314509+0000","last_became_peered":"2023-11-27T17:54:06.314509+0000","last_unstale":"2023-11-27T17:54:07.300505+0000","last_undegraded":"2023-11-27T17:54:07.300505+0000","last_fullsized":"2023-11-27T17:54:07.300505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T18:34:12.949366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:08.329559+0000","last_change":"2023-11-27T17:54:07.342843+0000","last_active":"2023-11-27T17:54:08.329559+0000","last_peered":"2023-11-27T17:54:08.329559+0000","last_clean":"2023-11-27T17:54:08.329559+0000","last_became_active":"2023-11-27T17:54:07.342163+0000","last_became_peered":"2023-11-27T17:54:07.342163+0000","last_unstale":"2023-11-27T17:54:08.329559+0000","last_undegraded":"2023-11-27T17:54:08.329559+0000","last_fullsized":"2023-11-27T17:54:08.329559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T21:35:49.605702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.306967+0000","last_change":"2023-11-27T17:54:06.327055+0000","last_active":"2023-11-27T17:54:07.306967+0000","last_peered":"2023-11-27T17:54:07.306967+0000","last_clean":"2023-11-27T17:54:07.306967+0000","last_became_active":"2023-11-27T17:54:06.326527+0000","last_became_peered":"2023-11-27T17:54:06.326527+0000","last_unstale":"2023-11-27T17:54:07.306967+0000","last_undegraded":"2023-11-27T17:54:07.306967+0000","last_fullsized":"2023-11-27T17:54:07.306967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T00:14:13.435564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-27T17:54:09.563358+0000","last_change":"2023-11-27T17:54:07.330909+0000","last_active":"2023-11-27T17:54:09.563358+0000","last_peered":"2023-11-27T17:54:09.563358+0000","last_clean":"2023-11-27T17:54:09.563358+0000","last_became_active":"2023-11-27T17:54:07.330199+0000","last_became_peered":"2023-11-27T17:54:07.330199+0000","last_unstale":"2023-11-27T17:54:09.563358+0000","last_undegraded":"2023-11-27T17:54:09.563358+0000","last_fullsized":"2023-11-27T17:54:09.563358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:06.270893+0000","last_clean_scrub_stamp":"2023-11-27T17:54:06.270893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T17:59:59.353448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.304195+0000","last_change":"2023-11-27T17:54:06.322689+0000","last_active":"2023-11-27T17:54:07.304195+0000","last_peered":"2023-11-27T17:54:07.304195+0000","last_clean":"2023-11-27T17:54:07.304195+0000","last_became_active":"2023-11-27T17:54:06.321986+0000","last_became_peered":"2023-11-27T17:54:06.321986+0000","last_unstale":"2023-11-27T17:54:07.304195+0000","last_undegraded":"2023-11-27T17:54:07.304195+0000","last_fullsized":"2023-11-27T17:54:07.304195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:54:05.258240+0000","last_clean_scrub_stamp":"2023-11-27T17:54:05.258240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-28T23:13:08.837576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-27T17:54:07.317505+0000","last_change":"2023-11-27T17:53:12.619175+0000","last_active":"2023-11-27T17:54:07.317505+0000","last_peered":"2023-11-27T17:54:07.317505+0000","last_clean":"2023-11-27T17:54:07.317505+0000","last_became_active":"2023-11-27T17:53:12.617047+0000","last_became_peered":"2023-11-27T17:53:12.617047+0000","last_unstale":"2023-11-27T17:54:07.317505+0000","last_undegraded":"2023-11-27T17:54:07.317505+0000","last_fullsized":"2023-11-27T17:54:07.317505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-27T17:53:11.496632+0000","last_clean_scrub_stamp":"2023-11-27T17:53:11.496632+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T04:23:56.619761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":933888,"data_stored":719503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.673}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1189999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":128642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":129717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.532}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.861000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.569}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3239999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6539999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.1150000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":129149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.079}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":130679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":129115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":130679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":925696,"data_stored":718394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-27T17:54:16.128 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-27T17:54:16.128 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-27T17:54:16.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa57a4f0640 1 Processor -- start 2023-11-27T17:54:16.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa57a4f0640 1 -- start start 2023-11-27T17:54:16.305 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa57a4f0640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa57406b7d0 0x7fa57406fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa57a4f0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa574070990 0x7fa57406ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa57a4f0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa574070e90 con 0x7fa5741415b0 2023-11-27T17:54:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa57a4f0640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa574071170 con 0x7fa57406b7d0 2023-11-27T17:54:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa57a4f0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa574071450 con 0x7fa574070990 2023-11-27T17:54:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa573fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa57406b7d0 0x7fa57406fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:16.306 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa573fff640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa57406b7d0 0x7fa57406fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46204/0 (socket says 172.21.15.31:46204) 2023-11-27T17:54:16.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa573fff640 1 -- 172.21.15.31:0/3004101959 learned_addr learned my addr 172.21.15.31:0/3004101959 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:16.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa5737fe640 1 --2- 172.21.15.31:0/3004101959 >> v2:172.21.15.81:3300/0 conn(0x7fa574070990 0x7fa57406ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:16.307 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa573fff640 1 -- 172.21.15.31:0/3004101959 >> v2:172.21.15.81:3300/0 conn(0x7fa574070990 msgr2=0x7fa57406ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:16.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa573fff640 1 --2- 172.21.15.31:0/3004101959 >> v2:172.21.15.81:3300/0 conn(0x7fa574070990 0x7fa57406ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa573fff640 1 -- 172.21.15.31:0/3004101959 >> v1:172.21.15.81:6789/0 conn(0x7fa5741415b0 legacy=0x7fa574147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:16.308 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.300+0000 7fa573fff640 1 -- 172.21.15.31:0/3004101959 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57406bbb0 con 0x7fa57406b7d0 2023-11-27T17:54:16.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa573fff640 1 --2- 172.21.15.31:0/3004101959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa57406b7d0 0x7fa57406fa70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa5740bad20 tx=0x7fa56401f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12ec106444d3461 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:16.309 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa572ffd640 1 -- 172.21.15.31:0/3004101959 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640af400 con 0x7fa57406b7d0 2023-11-27T17:54:16.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa572ffd640 1 -- 172.21.15.31:0/3004101959 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5640ab050 con 0x7fa57406b7d0 2023-11-27T17:54:16.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa572ffd640 1 -- 172.21.15.31:0/3004101959 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640af780 con 0x7fa57406b7d0 2023-11-27T17:54:16.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 -- 172.21.15.31:0/3004101959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa57406b7d0 msgr2=0x7fa57406fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 --2- 172.21.15.31:0/3004101959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa57406b7d0 0x7fa57406fa70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa5740bad20 tx=0x7fa56401f180 comp rx=0 tx=0).stop 2023-11-27T17:54:16.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 -- 172.21.15.31:0/3004101959 shutdown_connections 2023-11-27T17:54:16.310 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 --2- 172.21.15.31:0/3004101959 >> v2:172.21.15.81:3300/0 conn(0x7fa574070990 0x7fa57406ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 --2- 172.21.15.31:0/3004101959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa57406b7d0 0x7fa57406fa70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 -- 172.21.15.31:0/3004101959 >> 172.21.15.31:0/3004101959 conn(0x7fa5740b9dc0 msgr2=0x7fa5740ba1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:16.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 -- 172.21.15.31:0/3004101959 shutdown_connections 2023-11-27T17:54:16.311 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 -- 172.21.15.31:0/3004101959 wait complete. 2023-11-27T17:54:16.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 Processor -- start 2023-11-27T17:54:16.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 -- start start 2023-11-27T17:54:16.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57406b7d0 0x7fa57413d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:16.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa574070990 0x7fa57413bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:16.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5741415b0 0x7fa57413c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:16.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57413dc60 con 0x7fa5741415b0 2023-11-27T17:54:16.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5741e1050 con 0x7fa57406b7d0 2023-11-27T17:54:16.313 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa57a4f0640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5741e1330 con 0x7fa574070990 2023-11-27T17:54:16.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa578a8d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5741415b0 0x7fa57413c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:16.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa578a8d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5741415b0 0x7fa57413c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46214/0 (socket says 172.21.15.31:46214) 2023-11-27T17:54:16.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa578a8d640 1 -- 172.21.15.31:0/2845989117 learned_addr learned my addr 172.21.15.31:0/2845989117 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:16.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa573fff640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57406b7d0 0x7fa57413d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:16.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.304+0000 7fa5737fe640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa574070990 0x7fa57413bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:16.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa578a8d640 1 -- 172.21.15.31:0/2845989117 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa574070990 msgr2=0x7fa57413bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa578a8d640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa574070990 0x7fa57413bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa578a8d640 1 -- 172.21.15.31:0/2845989117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57406b7d0 msgr2=0x7fa57413d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa578a8d640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57406b7d0 0x7fa57413d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.314 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa578a8d640 1 -- 172.21.15.31:0/2845989117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa564009b30 con 0x7fa5741415b0 2023-11-27T17:54:16.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa578a8d640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5741415b0 0x7fa57413c1a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00b410 tx=0x7fa56c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:16.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa570ff9640 1 -- 172.21.15.31:0/2845989117 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c011830 con 0x7fa5741415b0 2023-11-27T17:54:16.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa570ff9640 1 -- 172.21.15.31:0/2845989117 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c0119d0 con 0x7fa5741415b0 2023-11-27T17:54:16.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa570ff9640 1 -- 172.21.15.31:0/2845989117 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c011d80 con 0x7fa5741415b0 2023-11-27T17:54:16.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa57a4f0640 1 -- 172.21.15.31:0/2845989117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5741e1610 con 0x7fa5741415b0 2023-11-27T17:54:16.315 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa57a4f0640 1 -- 172.21.15.31:0/2845989117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57413ee70 con 0x7fa5741415b0 2023-11-27T17:54:16.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa57a4f0640 1 -- 172.21.15.31:0/2845989117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57404e850 con 0x7fa5741415b0 2023-11-27T17:54:16.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa570ff9640 1 -- 172.21.15.31:0/2845989117 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7fa56c01a400 con 0x7fa5741415b0 2023-11-27T17:54:16.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa570ff9640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa5540667f0 0x7fa554068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:16.316 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa570ff9640 1 -- 172.21.15.31:0/2845989117 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa56c0843b0 con 0x7fa5741415b0 2023-11-27T17:54:16.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa573fff640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa5540667f0 0x7fa554068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:16.317 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.308+0000 7fa573fff640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa5540667f0 0x7fa554068cb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa5640b1000 tx=0x7fa5640aa000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:16.319 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.312+0000 7fa570ff9640 1 -- 172.21.15.31:0/2845989117 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7fa56c051420 con 0x7fa5741415b0 2023-11-27T17:54:16.531 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.524+0000 7fa57a4f0640 1 -- 172.21.15.31:0/2845989117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa574140690 con 0x7fa5741415b0 2023-11-27T17:54:16.534 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.528+0000 7fa570ff9640 1 -- 172.21.15.31:0/2845989117 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7fa56c054a40 con 0x7fa5741415b0 2023-11-27T17:54:16.535 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2023-11-27T17:54:16.535 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBT12RlGScMHhAAuWSgPslHVjR+yfiMMPITUg== 2023-11-27T17:54:16.535 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2023-11-27T17:54:16.535 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2023-11-27T17:54:16.535 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-27T17:54:16.535 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2023-11-27T17:54:16.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.532+0000 7fa57a4f0640 1 -- 172.21.15.31:0/2845989117 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa5540667f0 msgr2=0x7fa554068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.532+0000 7fa57a4f0640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa5540667f0 0x7fa554068cb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa5640b1000 tx=0x7fa5640aa000 comp rx=0 tx=0).stop 2023-11-27T17:54:16.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.532+0000 7fa57a4f0640 1 -- 172.21.15.31:0/2845989117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5741415b0 msgr2=0x7fa57413c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.537 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.532+0000 7fa57a4f0640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5741415b0 0x7fa57413c1a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00b410 tx=0x7fa56c00b8d0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.532+0000 7fa57a4f0640 1 -- 172.21.15.31:0/2845989117 shutdown_connections 2023-11-27T17:54:16.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.532+0000 7fa57a4f0640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7fa5540667f0 0x7fa554068cb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.532+0000 7fa57a4f0640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa5741415b0 0x7fa57413c1a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.532+0000 7fa57a4f0640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7fa574070990 0x7fa57413bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.532+0000 7fa57a4f0640 1 --2- 172.21.15.31:0/2845989117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa57406b7d0 0x7fa57413d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.532+0000 7fa57a4f0640 1 -- 172.21.15.31:0/2845989117 >> 172.21.15.31:0/2845989117 conn(0x7fa5740b9dc0 msgr2=0x7fa574146880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:16.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.532+0000 7fa57a4f0640 1 -- 172.21.15.31:0/2845989117 shutdown_connections 2023-11-27T17:54:16.538 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.532+0000 7fa57a4f0640 1 -- 172.21.15.31:0/2845989117 wait complete. 2023-11-27T17:54:16.555 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-27T17:54:16.684 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.676+0000 7feec9ba7640 1 Processor -- start 2023-11-27T17:54:16.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.676+0000 7feec9ba7640 1 -- start start 2023-11-27T17:54:16.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.676+0000 7feec9ba7640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feec40b30b0 0x7feec40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:16.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.676+0000 7feec9ba7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feec40b3a60 0x7feec414b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:16.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.676+0000 7feec9ba7640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec4148930 con 0x7feec40bd240 2023-11-27T17:54:16.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.676+0000 7feec9ba7640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec40b52c0 con 0x7feec40b30b0 2023-11-27T17:54:16.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.676+0000 7feec9ba7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40b3490 con 0x7feec40b3a60 2023-11-27T17:54:16.685 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feec40b30b0 0x7feec40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:16.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec3fff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7feec40bd240 0x7feec40b6050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:36202/0 (socket says 172.21.15.31:36202) 2023-11-27T17:54:16.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec37fe640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feec40b30b0 0x7feec40b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46222/0 (socket says 172.21.15.31:46222) 2023-11-27T17:54:16.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec3fff640 1 -- 172.21.15.31:0/3288566535 learned_addr learned my addr 172.21.15.31:0/3288566535 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:54:16.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec2ffd640 1 --2- 172.21.15.31:0/3288566535 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feec40b3a60 0x7feec414b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:16.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec37fe640 1 -- 172.21.15.31:0/3288566535 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feec40b3a60 msgr2=0x7feec414b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:16.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec37fe640 1 --2- 172.21.15.31:0/3288566535 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feec40b3a60 0x7feec414b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec37fe640 1 -- 172.21.15.31:0/3288566535 >> v1:172.21.15.31:6789/0 conn(0x7feec40bd240 legacy=0x7feec40b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.686 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec37fe640 1 -- 172.21.15.31:0/3288566535 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4148040 con 0x7feec40b30b0 2023-11-27T17:54:16.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec37fe640 1 --2- 172.21.15.31:0/3288566535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec40b30b0 0x7feec40b46a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7feeb40097c0 tx=0x7feeb401e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6479174f81f01ac9 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:16.688 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec27fc640 1 -- 172.21.15.31:0/3288566535 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb40a8630 con 0x7feec40b30b0 2023-11-27T17:54:16.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec27fc640 1 -- 172.21.15.31:0/3288566535 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb40a8790 con 0x7feec40b30b0 2023-11-27T17:54:16.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec27fc640 1 -- 172.21.15.31:0/3288566535 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb40a8b20 con 0x7feec40b30b0 2023-11-27T17:54:16.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec9ba7640 1 -- 172.21.15.31:0/3288566535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec40b30b0 msgr2=0x7feec40b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec9ba7640 1 --2- 172.21.15.31:0/3288566535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec40b30b0 0x7feec40b46a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7feeb40097c0 tx=0x7feeb401e660 comp rx=0 tx=0).stop 2023-11-27T17:54:16.689 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec9ba7640 1 -- 172.21.15.31:0/3288566535 shutdown_connections 2023-11-27T17:54:16.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec9ba7640 1 --2- 172.21.15.31:0/3288566535 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feec40b3a60 0x7feec414b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec9ba7640 1 --2- 172.21.15.31:0/3288566535 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec40b30b0 0x7feec40b46a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec9ba7640 1 -- 172.21.15.31:0/3288566535 >> 172.21.15.31:0/3288566535 conn(0x7feec406ab60 msgr2=0x7feec40bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:16.690 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec9ba7640 1 -- 172.21.15.31:0/3288566535 shutdown_connections 2023-11-27T17:54:16.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.680+0000 7feec9ba7640 1 -- 172.21.15.31:0/3288566535 wait complete. 2023-11-27T17:54:16.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec9ba7640 1 Processor -- start 2023-11-27T17:54:16.691 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec9ba7640 1 -- start start 2023-11-27T17:54:16.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec9ba7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec40b30b0 0x7feec40bc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:16.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec9ba7640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec40b3a60 0x7feec40bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:16.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec9ba7640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feec40bd240 0x7feec41e31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:16.695 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec9ba7640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec40bbdb0 con 0x7feec40b3a60 2023-11-27T17:54:16.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec9ba7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec41449c0 con 0x7feec40b30b0 2023-11-27T17:54:16.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec9ba7640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec40bc000 con 0x7feec40bd240 2023-11-27T17:54:16.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec2ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec40b3a60 0x7feec40bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:16.696 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec2ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec40b3a60 0x7feec40bb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46238/0 (socket says 172.21.15.31:46238) 2023-11-27T17:54:16.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec2ffd640 1 -- 172.21.15.31:0/4089666107 learned_addr learned my addr 172.21.15.31:0/4089666107 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:16.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec3fff640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feec40bd240 0x7feec41e31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:16.697 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec37fe640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec40b30b0 0x7feec40bc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:16.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec2ffd640 1 -- 172.21.15.31:0/4089666107 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feec40bd240 msgr2=0x7feec41e31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec2ffd640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feec40bd240 0x7feec41e31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec2ffd640 1 -- 172.21.15.31:0/4089666107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec40b30b0 msgr2=0x7feec40bc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.698 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec2ffd640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec40b30b0 0x7feec40bc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec2ffd640 1 -- 172.21.15.31:0/4089666107 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4009420 con 0x7feec40b3a60 2023-11-27T17:54:16.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec2ffd640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec40b3a60 0x7feec40bb4a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7feeac007ec0 tx=0x7feeac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:16.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feebbfff640 1 -- 172.21.15.31:0/4089666107 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac003ba0 con 0x7feec40b3a60 2023-11-27T17:54:16.699 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feebbfff640 1 -- 172.21.15.31:0/4089666107 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac003d00 con 0x7feec40b3a60 2023-11-27T17:54:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feebbfff640 1 -- 172.21.15.31:0/4089666107 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac004250 con 0x7feec40b3a60 2023-11-27T17:54:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec9ba7640 1 -- 172.21.15.31:0/4089666107 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec40b94a0 con 0x7feec40b3a60 2023-11-27T17:54:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec9ba7640 1 -- 172.21.15.31:0/4089666107 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec4072510 con 0x7feec40b3a60 2023-11-27T17:54:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.684+0000 7feec9ba7640 1 -- 172.21.15.31:0/4089666107 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec4148da0 con 0x7feec40b3a60 2023-11-27T17:54:16.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.688+0000 7feebbfff640 1 -- 172.21.15.31:0/4089666107 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7feeac0043b0 con 0x7feec40b3a60 2023-11-27T17:54:16.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.688+0000 7feebbfff640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7feea4066820 0x7feea4068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:16.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.688+0000 7feebbfff640 1 -- 172.21.15.31:0/4089666107 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feeac0846a0 con 0x7feec40b3a60 2023-11-27T17:54:16.701 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.688+0000 7feec37fe640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7feea4066820 0x7feea4068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.688+0000 7feec37fe640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7feea4066820 0x7feea4068ce0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feeb40b0000 tx=0x7feeb40b5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:16.702 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.692+0000 7feebbfff640 1 -- 172.21.15.31:0/4089666107 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7feec4148da0 con 0x7feec40b3a60 2023-11-27T17:54:16.888 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 -- 172.21.15.31:0/4089666107 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feec4148da0 con 0x7feec40b3a60 2023-11-27T17:54:16.890 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feebbfff640 1 -- 172.21.15.31:0/4089666107 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4119 (secure 0 0 0) 0x7feec4148da0 con 0x7feec40b3a60 2023-11-27T17:54:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:54:16.890 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/796467990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":796467990},{"type":"v1","addr":"172.21.15.31:6835","nonce":796467990}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":4643,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2310489573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2310489573},{"type":"v1","addr":"172.21.15.81:6833","nonce":2310489573}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-27T17:54:06.648311+0000","modified":"2023-11-27T17:54:09.683325+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4968},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4968":{"gid":4968,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6837/1057720964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6836","nonce":1057720964},{"type":"v1","addr":"172.21.15.31:6837","nonce":1057720964}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-27T17:54:16.891 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 14 2023-11-27T17:54:16.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 -- 172.21.15.31:0/4089666107 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7feea4066820 msgr2=0x7feea4068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7feea4066820 0x7feea4068ce0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feeb40b0000 tx=0x7feeb40b5040 comp rx=0 tx=0).stop 2023-11-27T17:54:16.891 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 -- 172.21.15.31:0/4089666107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec40b3a60 msgr2=0x7feec40bb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:16.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec40b3a60 0x7feec40bb4a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7feeac007ec0 tx=0x7feeac00e4b0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 -- 172.21.15.31:0/4089666107 shutdown_connections 2023-11-27T17:54:16.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7feea4066820 0x7feea4068ce0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7feec40bd240 0x7feec41e31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feec40b3a60 0x7feec40bb4a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 --2- 172.21.15.31:0/4089666107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec40b30b0 0x7feec40bc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:16.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 -- 172.21.15.31:0/4089666107 >> 172.21.15.31:0/4089666107 conn(0x7feec406ab60 msgr2=0x7feec40b7220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:16.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 -- 172.21.15.31:0/4089666107 shutdown_connections 2023-11-27T17:54:16.892 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:16.884+0000 7feec9ba7640 1 -- 172.21.15.31:0/4089666107 wait complete. 2023-11-27T17:54:17.055 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:54:17.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:54:17.060 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:54:17.211 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-27T17:54:06.648311+0000', 'modified': '2023-11-27T17:54:09.683325+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4968}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4968': {'gid': 4968, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6837/1057720964', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6836', 'nonce': 1057720964}, {'type': 'v1', 'addr': '172.21.15.31:6837', 'nonce': 1057720964}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-27T17:54:17.211 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-27T17:54:17.211 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-27T17:54:17.345 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d9b9b4640 1 Processor -- start 2023-11-27T17:54:17.346 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d9b9b4640 1 -- start start 2023-11-27T17:54:17.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d9b9b4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d941425e0 0x7f3d940bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d9b9b4640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3d94148c80 0x7f3d941529c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d9b9b4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d940b6840 con 0x7f3d940b5d90 2023-11-27T17:54:17.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d9b9b4640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d941429c0 con 0x7f3d94148c80 2023-11-27T17:54:17.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d9b9b4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940b6b20 con 0x7f3d941425e0 2023-11-27T17:54:17.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d99f51640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3d94148c80 0x7f3d941529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.347 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d99f51640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3d94148c80 0x7f3d941529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46248/0 (socket says 172.21.15.31:46248) 2023-11-27T17:54:17.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d99f51640 1 -- 172.21.15.31:0/1983993336 learned_addr learned my addr 172.21.15.31:0/1983993336 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:17.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d99f51640 1 -- 172.21.15.31:0/1983993336 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d941425e0 msgr2=0x7f3d940bd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:17.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d99f51640 1 --2- 172.21.15.31:0/1983993336 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d941425e0 0x7f3d940bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d99f51640 1 -- 172.21.15.31:0/1983993336 >> v1:172.21.15.81:6789/0 conn(0x7f3d940b5d90 legacy=0x7f3d94148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:17.348 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.340+0000 7f3d99f51640 1 -- 172.21.15.31:0/1983993336 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940b6e00 con 0x7f3d94148c80 2023-11-27T17:54:17.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d99f51640 1 --2- 172.21.15.31:0/1983993336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d94148c80 0x7f3d941529c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009870 tx=0x7f3d8c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d80011d2793e1f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:17.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d93fff640 1 -- 172.21.15.31:0/1983993336 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c0a89b0 con 0x7f3d94148c80 2023-11-27T17:54:17.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d93fff640 1 -- 172.21.15.31:0/1983993336 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c0a8b10 con 0x7f3d94148c80 2023-11-27T17:54:17.349 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d93fff640 1 -- 172.21.15.31:0/1983993336 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c0a8ea0 con 0x7f3d94148c80 2023-11-27T17:54:17.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/1983993336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d94148c80 msgr2=0x7f3d941529c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d9b9b4640 1 --2- 172.21.15.31:0/1983993336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d94148c80 0x7f3d941529c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009870 tx=0x7f3d8c01ecf0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/1983993336 shutdown_connections 2023-11-27T17:54:17.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d9b9b4640 1 --2- 172.21.15.31:0/1983993336 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d94148c80 0x7f3d941529c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d9b9b4640 1 --2- 172.21.15.31:0/1983993336 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d941425e0 0x7f3d940bd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.350 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/1983993336 >> 172.21.15.31:0/1983993336 conn(0x7f3d9406ab60 msgr2=0x7f3d940bcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:17.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/1983993336 shutdown_connections 2023-11-27T17:54:17.351 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/1983993336 wait complete. 2023-11-27T17:54:17.352 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d9b9b4640 1 Processor -- start 2023-11-27T17:54:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.344+0000 7f3d9b9b4640 1 -- start start 2023-11-27T17:54:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d9b9b4640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d940b5d90 0x7f3d94136080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d9b9b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d941425e0 0x7f3d94146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d9b9b4640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d94148c80 0x7f3d94130c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d9b9b4640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941365c0 con 0x7f3d94148c80 2023-11-27T17:54:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d9b9b4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941481c0 con 0x7f3d941425e0 2023-11-27T17:54:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d9b9b4640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941e8a10 con 0x7f3d940b5d90 2023-11-27T17:54:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99f51640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d94148c80 0x7f3d94130c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99f51640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d94148c80 0x7f3d94130c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46250/0 (socket says 172.21.15.31:46250) 2023-11-27T17:54:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99f51640 1 -- 172.21.15.31:0/2941769502 learned_addr learned my addr 172.21.15.31:0/2941769502 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:17.353 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d98f4f640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d941425e0 0x7f3d94146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99750640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d940b5d90 0x7f3d94136080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99f51640 1 -- 172.21.15.31:0/2941769502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d940b5d90 msgr2=0x7f3d94136080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99f51640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d940b5d90 0x7f3d94136080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99f51640 1 -- 172.21.15.31:0/2941769502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d941425e0 msgr2=0x7f3d94146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99f51640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d941425e0 0x7f3d94146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99f51640 1 -- 172.21.15.31:0/2941769502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8c0094d0 con 0x7f3d94148c80 2023-11-27T17:54:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d98f4f640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d941425e0 0x7f3d94146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99750640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d940b5d90 0x7f3d94136080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99f51640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d94148c80 0x7f3d94130c20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009870 tx=0x7f3d8c01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d91ffb640 1 -- 172.21.15.31:0/2941769502 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c0b0e00 con 0x7f3d94148c80 2023-11-27T17:54:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d91ffb640 1 -- 172.21.15.31:0/2941769502 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8c0bb440 con 0x7f3d94148c80 2023-11-27T17:54:17.354 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d91ffb640 1 -- 172.21.15.31:0/2941769502 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c0bb7f0 con 0x7f3d94148c80 2023-11-27T17:54:17.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/2941769502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d941554e0 con 0x7f3d94148c80 2023-11-27T17:54:17.355 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/2941769502 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d94155aa0 con 0x7f3d94148c80 2023-11-27T17:54:17.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d91ffb640 1 -- 172.21.15.31:0/2941769502 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f3d8c0b7040 con 0x7f3d94148c80 2023-11-27T17:54:17.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d91ffb640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3d800667f0 0x7f3d80068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d91ffb640 1 -- 172.21.15.31:0/2941769502 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d8c1223c0 con 0x7f3d94148c80 2023-11-27T17:54:17.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99750640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3d800667f0 0x7f3d80068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.348+0000 7f3d99750640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3d800667f0 0x7f3d80068cb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d84007eb0 tx=0x7f3d840073c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:17.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 Processor -- start 2023-11-27T17:54:17.356 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- start start 2023-11-27T17:54:17.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3d350 0x55ed95c3d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.358 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3dc70 0x55ed95c380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c38630 0x55ed95c38a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed95a6e130 con 0x55ed95c3dc70 2023-11-27T17:54:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed95a5b9a0 con 0x55ed95c3d350 2023-11-27T17:54:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed95a58ed0 con 0x55ed95c38630 2023-11-27T17:54:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d98f4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3dc70 0x55ed95c380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d98f4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3dc70 0x55ed95c380f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46252/0 (socket says 172.21.15.31:46252) 2023-11-27T17:54:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d98f4f640 1 -- 172.21.15.31:0/2301192335 learned_addr learned my addr 172.21.15.31:0/2301192335 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d99750640 1 --2- 172.21.15.31:0/2301192335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3d350 0x55ed95c3d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d98f4f640 1 -- 172.21.15.31:0/2301192335 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c38630 msgr2=0x55ed95c38a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d99f51640 1 --2- 172.21.15.31:0/2301192335 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c38630 0x55ed95c38a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d98f4f640 1 --2- 172.21.15.31:0/2301192335 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c38630 0x55ed95c38a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.359 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d98f4f640 1 -- 172.21.15.31:0/2301192335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3d350 msgr2=0x55ed95c3d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:17.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d98f4f640 1 --2- 172.21.15.31:0/2301192335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3d350 0x55ed95c3d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d98f4f640 1 -- 172.21.15.31:0/2301192335 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed9574c890 con 0x55ed95c3dc70 2023-11-27T17:54:17.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d99750640 1 --2- 172.21.15.31:0/2301192335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3d350 0x55ed95c3d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:54:17.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d98f4f640 1 --2- 172.21.15.31:0/2301192335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3dc70 0x55ed95c380f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3d88003ee0 tx=0x7f3d880043a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54d48c154948189 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:17.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d7affd640 1 -- 172.21.15.31:0/2301192335 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88005230 con 0x55ed95c3dc70 2023-11-27T17:54:17.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d7affd640 1 -- 172.21.15.31:0/2301192335 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d88005390 con 0x55ed95c3dc70 2023-11-27T17:54:17.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d7affd640 1 -- 172.21.15.31:0/2301192335 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88005500 con 0x55ed95c3dc70 2023-11-27T17:54:17.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2301192335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3dc70 msgr2=0x55ed95c380f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/2301192335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3dc70 0x55ed95c380f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3d88003ee0 tx=0x7f3d880043a0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2301192335 shutdown_connections 2023-11-27T17:54:17.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/2301192335 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c38630 0x55ed95c38a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.360 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/2301192335 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3dc70 0x55ed95c380f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/2301192335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3d350 0x55ed95c3d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2301192335 >> 172.21.15.31:0/2301192335 conn(0x55ed95c33ea0 msgr2=0x55ed95c36290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:17.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2301192335 shutdown_connections 2023-11-27T17:54:17.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2301192335 wait complete. 2023-11-27T17:54:17.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- start start 2023-11-27T17:54:17.361 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 Processor -- start 2023-11-27T17:54:17.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c38630 0x55ed95c00a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3d350 0x55ed95c00fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.364 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 0x55ed95c01510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed95a547c0 con 0x55ed95c3d350 2023-11-27T17:54:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed95a0cbf0 con 0x55ed95c3dc70 2023-11-27T17:54:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed95a12a90 con 0x55ed95c38630 2023-11-27T17:54:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d9eae4000 10 client.0 _ll_register_callbacks cb 0x55ed95bef3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T17:54:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d98f4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3d350 0x55ed95c00fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d98f4f640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3d350 0x55ed95c00fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46258/0 (socket says 172.21.15.31:46258) 2023-11-27T17:54:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.352+0000 7f3d98f4f640 1 -- 172.21.15.31:0/2977133911 learned_addr learned my addr 172.21.15.31:0/2977133911 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d99f51640 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 0x55ed95c01510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d99750640 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c38630 0x55ed95c00a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d98f4f640 1 -- 172.21.15.31:0/2977133911 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c38630 msgr2=0x55ed95c00a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d98f4f640 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c38630 0x55ed95c00a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.365 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d98f4f640 1 -- 172.21.15.31:0/2977133911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 msgr2=0x55ed95c01510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d98f4f640 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 0x55ed95c01510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d98f4f640 1 -- 172.21.15.31:0/2977133911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d88003b40 con 0x55ed95c3d350 2023-11-27T17:54:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d98f4f640 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3d350 0x55ed95c00fd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x55ed95a8f280 tx=0x7f3d88003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19285dfbedc37a4d server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-11-27T17:54:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d6ffff640 1 -- 172.21.15.31:0/2977133911 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880069e0 con 0x55ed95c3d350 2023-11-27T17:54:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d6ffff640 1 -- 172.21.15.31:0/2977133911 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d88006b40 con 0x55ed95c3d350 2023-11-27T17:54:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2977133911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed95a16470 con 0x55ed95c3d350 2023-11-27T17:54:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d6ffff640 1 -- 172.21.15.31:0/2977133911 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d88007d50 con 0x55ed95c3d350 2023-11-27T17:54:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 10 client.5184 fetch_fsmap learned FSMap version 14 2023-11-27T17:54:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2977133911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55ed95a15190 con 0x55ed95c3d350 2023-11-27T17:54:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d6ffff640 1 -- 172.21.15.31:0/2977133911 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed95a16470 con 0x55ed95c3d350 2023-11-27T17:54:17.366 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d6ffff640 1 -- 172.21.15.31:0/2977133911 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 14) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f3d88006d00 con 0x55ed95c3d350 2023-11-27T17:54:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 10 client.5184 fetch_fsmap finished waiting for FSMap version 14 2023-11-27T17:54:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 10 client.5184 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-27T17:54:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 20 client.5184 populate_metadata read hostname 'smithi031' 2023-11-27T17:54:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.31:6836/1057720964,v1:172.21.15.31:6837/1057720964] conn(0x55ed95c4c3e0 0x55ed95c4e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 4 client.5184 mds_command: new command op to 4968 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-27T17:54:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2977133911 --> [v2:172.21.15.31:6836/1057720964,v1:172.21.15.31:6837/1057720964] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed95a19b50 con 0x55ed95c4c3e0 2023-11-27T17:54:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d99750640 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.31:6836/1057720964,v1:172.21.15.31:6837/1057720964] conn(0x55ed95c4c3e0 0x55ed95c4e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d99750640 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.31:6836/1057720964,v1:172.21.15.31:6837/1057720964] conn(0x55ed95c4c3e0 0x55ed95c4e7d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43f69533d3a1c7b2 server_cookie=32de4a21743149a9 in_seq=0 out_seq=0 2023-11-27T17:54:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d6ffff640 10 client.5184 ms_handle_connect on v2:172.21.15.31:6836/1057720964 2023-11-27T17:54:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d6ffff640 1 -- 172.21.15.31:0/2977133911 <== mds.0 v2:172.21.15.31:6836/1057720964 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ed95a19b50 con 0x55ed95c4c3e0 2023-11-27T17:54:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d6ffff640 10 client.5184 handle_command_reply: tid=0 2023-11-27T17:54:17.367 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 client.5184 shutdown 2023-11-27T17:54:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2977133911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3d350 msgr2=0x55ed95c00fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3d350 0x55ed95c00fd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x55ed95a8f280 tx=0x7f3d88003700 comp rx=0 tx=0).stop 2023-11-27T17:54:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2977133911 shutdown_connections 2023-11-27T17:54:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.31:6836/1057720964,v1:172.21.15.31:6837/1057720964] conn(0x55ed95c4c3e0 0x55ed95c4e7d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 0x55ed95c01510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c3d350 0x55ed95c00fd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d6ffff640 0 client.5184 ms_handle_reset on v2:172.21.15.31:6836/1057720964 2023-11-27T17:54:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/2977133911 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c38630 0x55ed95c00a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2977133911 >> 172.21.15.31:0/2977133911 conn(0x55ed95c33ea0 msgr2=0x55ed95c36290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2977133911 shutdown_connections 2023-11-27T17:54:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 1 -- 172.21.15.31:0/2977133911 wait complete. 2023-11-27T17:54:17.368 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.356+0000 7f3d9eae4000 20 client.5184 trim_cache size 0 max 16384 2023-11-27T17:54:17.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d9eae4000 1 Processor -- start 2023-11-27T17:54:17.378 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d9eae4000 1 -- start start 2023-11-27T17:54:17.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d9eae4000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 0x55ed95c4e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d9eae4000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c3d350 0x55ed95c4ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d9eae4000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 0x55ed95c4f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.379 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d9eae4000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed9570d940 con 0x55ed95c38630 2023-11-27T17:54:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d9eae4000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed95a138f0 con 0x55ed95c3dc70 2023-11-27T17:54:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d9eae4000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed95a09760 con 0x55ed95c3d350 2023-11-27T17:54:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d99750640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 0x55ed95c4e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d99750640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 0x55ed95c4e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46262/0 (socket says 172.21.15.31:46262) 2023-11-27T17:54:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d99750640 1 -- 172.21.15.31:0/1667198986 learned_addr learned my addr 172.21.15.31:0/1667198986 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d99750640 1 -- 172.21.15.31:0/1667198986 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c3d350 msgr2=0x55ed95c4ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d99750640 1 --2- 172.21.15.31:0/1667198986 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c3d350 0x55ed95c4ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d99750640 1 -- 172.21.15.31:0/1667198986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 msgr2=0x55ed95c4f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d99750640 1 --2- 172.21.15.31:0/1667198986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 0x55ed95c4f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d99750640 1 -- 172.21.15.31:0/1667198986 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed959fb490 con 0x55ed95c38630 2023-11-27T17:54:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d99750640 1 --2- 172.21.15.31:0/1667198986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 0x55ed95c4e7d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3d84000f90 tx=0x7f3d84011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e5b546c82b80ce server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:17.380 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d7b7fe640 1 -- 172.21.15.31:0/1667198986 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84022040 con 0x55ed95c38630 2023-11-27T17:54:17.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d7b7fe640 1 -- 172.21.15.31:0/1667198986 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d84023b00 con 0x55ed95c38630 2023-11-27T17:54:17.381 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.372+0000 7f3d7b7fe640 1 -- 172.21.15.31:0/1667198986 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84023e70 con 0x55ed95c38630 2023-11-27T17:54:17.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- 172.21.15.31:0/1667198986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 msgr2=0x55ed95c4e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/1667198986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 0x55ed95c4e7d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3d84000f90 tx=0x7f3d84011000 comp rx=0 tx=0).stop 2023-11-27T17:54:17.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- 172.21.15.31:0/1667198986 shutdown_connections 2023-11-27T17:54:17.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/1667198986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 0x55ed95c4f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/1667198986 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c3d350 0x55ed95c4ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/1667198986 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 0x55ed95c4e7d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- 172.21.15.31:0/1667198986 >> 172.21.15.31:0/1667198986 conn(0x55ed95c33ea0 msgr2=0x55ed95c082e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:17.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- 172.21.15.31:0/1667198986 shutdown_connections 2023-11-27T17:54:17.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- 172.21.15.31:0/1667198986 wait complete. 2023-11-27T17:54:17.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- start start 2023-11-27T17:54:17.385 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 Processor -- start 2023-11-27T17:54:17.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 0x55ed95c6a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c3d350 0x55ed95c6ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 0x55ed95c6b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed95a96140 con 0x55ed95c38630 2023-11-27T17:54:17.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed95a53650 con 0x55ed95c3dc70 2023-11-27T17:54:17.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed95a57320 con 0x55ed95c3d350 2023-11-27T17:54:17.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 10 client.0 _ll_register_callbacks cb 0x55ed959d86e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-27T17:54:17.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d99750640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 0x55ed95c6a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d99750640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 0x55ed95c6a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46270/0 (socket says 172.21.15.31:46270) 2023-11-27T17:54:17.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d99750640 1 -- 172.21.15.31:0/3057392808 learned_addr learned my addr 172.21.15.31:0/3057392808 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:17.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d98f4f640 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c3d350 0x55ed95c6ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.386 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d99f51640 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 0x55ed95c6b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d99750640 1 -- 172.21.15.31:0/3057392808 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c3d350 msgr2=0x55ed95c6ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:17.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d99750640 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c3d350 0x55ed95c6ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d99750640 1 -- 172.21.15.31:0/3057392808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 msgr2=0x55ed95c6b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:17.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d99750640 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 0x55ed95c6b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d99750640 1 -- 172.21.15.31:0/3057392808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8400ce80 con 0x55ed95c38630 2023-11-27T17:54:17.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d99750640 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 0x55ed95c6a5f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x55ed95a9ecb0 tx=0x7f3d84004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c968b208cd1877 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:17.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d6ffff640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2023-11-27T17:54:17.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d6ffff640 1 -- 172.21.15.31:0/3057392808 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84023440 con 0x55ed95c38630 2023-11-27T17:54:17.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d6ffff640 1 -- 172.21.15.31:0/3057392808 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d840235a0 con 0x55ed95c38630 2023-11-27T17:54:17.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- 172.21.15.31:0/3057392808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed95c3c330 con 0x55ed95c38630 2023-11-27T17:54:17.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d6ffff640 1 -- 172.21.15.31:0/3057392808 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d84023760 con 0x55ed95c38630 2023-11-27T17:54:17.387 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 10 client.5190 fetch_fsmap learned FSMap version 14 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- 172.21.15.31:0/3057392808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55ed9574ccc0 con 0x55ed95c38630 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d6ffff640 1 -- 172.21.15.31:0/3057392808 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed95c3c330 con 0x55ed95c38630 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d6ffff640 1 -- 172.21.15.31:0/3057392808 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 14) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f3d8402b3f0 con 0x55ed95c38630 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 10 client.5190 fetch_fsmap finished waiting for FSMap version 14 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 10 client.5190 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 20 client.5190 populate_metadata read hostname 'smithi031' 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.31:6836/1057720964,v1:172.21.15.31:6837/1057720964] conn(0x55ed95c6ba30 0x55ed95ca6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 4 client.5190 mds_command: new command op to 4968 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- 172.21.15.31:0/3057392808 --> [v2:172.21.15.31:6836/1057720964,v1:172.21.15.31:6837/1057720964] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ed95a53110 con 0x55ed95c6ba30 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d98f4f640 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.31:6836/1057720964,v1:172.21.15.31:6837/1057720964] conn(0x55ed95c6ba30 0x55ed95ca6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d6ffff640 10 client.5190 ms_handle_connect on v2:172.21.15.31:6836/1057720964 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d98f4f640 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.31:6836/1057720964,v1:172.21.15.31:6837/1057720964] conn(0x55ed95c6ba30 0x55ed95ca6250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4df312e5eb27e32 server_cookie=cd553b50f800fb86 in_seq=0 out_seq=0 2023-11-27T17:54:17.388 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d6ffff640 1 -- 172.21.15.31:0/3057392808 <== mds.0 v2:172.21.15.31:6836/1057720964 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55ed95a53110 con 0x55ed95c6ba30 2023-11-27T17:54:17.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d6ffff640 10 client.5190 handle_command_reply: tid=0 2023-11-27T17:54:17.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 client.5190 shutdown 2023-11-27T17:54:17.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- 172.21.15.31:0/3057392808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 msgr2=0x55ed95c6a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 0x55ed95c6a5f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x55ed95a9ecb0 tx=0x7f3d84004a50 comp rx=0 tx=0).stop 2023-11-27T17:54:17.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 -- 172.21.15.31:0/3057392808 shutdown_connections 2023-11-27T17:54:17.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.376+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.31:6836/1057720964,v1:172.21.15.31:6837/1057720964] conn(0x55ed95c6ba30 0x55ed95ca6250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed95c3dc70 0x55ed95c6b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x55ed95c3d350 0x55ed95c6ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9eae4000 1 --2- 172.21.15.31:0/3057392808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55ed95c38630 0x55ed95c6a5f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d6ffff640 0 client.5190 ms_handle_reset on v2:172.21.15.31:6836/1057720964 2023-11-27T17:54:17.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9eae4000 1 -- 172.21.15.31:0/3057392808 >> 172.21.15.31:0/3057392808 conn(0x55ed95c33ea0 msgr2=0x55ed95c08b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:17.389 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9eae4000 1 -- 172.21.15.31:0/3057392808 shutdown_connections 2023-11-27T17:54:17.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9eae4000 1 -- 172.21.15.31:0/3057392808 wait complete. 2023-11-27T17:54:17.390 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9eae4000 20 client.5190 trim_cache size 0 max 16384 2023-11-27T17:54:17.390 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-11-27T17:54:17.390 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "d7e0ec54-b878-4521-a03f-3b848cceedea", 2023-11-27T17:54:17.390 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2023-11-27T17:54:17.390 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4968, 2023-11-27T17:54:17.390 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2023-11-27T17:54:17.390 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2023-11-27T17:54:17.391 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2023-11-27T17:54:17.391 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 10.061117093, 2023-11-27T17:54:17.391 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 14, 2023-11-27T17:54:17.391 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 30, 2023-11-27T17:54:17.391 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 30, 2023-11-27T17:54:17.391 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 16.998334795000002 2023-11-27T17:54:17.391 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-11-27T17:54:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/2941769502 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3d800667f0 msgr2=0x7f3d80068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9b9b4640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3d800667f0 0x7f3d80068cb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3d84007eb0 tx=0x7f3d840073c0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/2941769502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d94148c80 msgr2=0x7f3d94130c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9b9b4640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d94148c80 0x7f3d94130c20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009870 tx=0x7f3d8c01ba90 comp rx=0 tx=0).stop 2023-11-27T17:54:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/2941769502 shutdown_connections 2023-11-27T17:54:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9b9b4640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f3d800667f0 0x7f3d80068cb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9b9b4640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3d94148c80 0x7f3d94130c20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9b9b4640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d941425e0 0x7f3d94146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.392 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9b9b4640 1 --2- 172.21.15.31:0/2941769502 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f3d940b5d90 0x7f3d94136080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/2941769502 >> 172.21.15.31:0/2941769502 conn(0x7f3d9406ab60 msgr2=0x7f3d940b7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/2941769502 shutdown_connections 2023-11-27T17:54:17.393 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.380+0000 7f3d9b9b4640 1 -- 172.21.15.31:0/2941769502 wait complete. 2023-11-27T17:54:17.401 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-27T17:54:17.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f500d5640 1 Processor -- start 2023-11-27T17:54:17.516 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f500d5640 1 -- start start 2023-11-27T17:54:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f500d5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f480bab00 0x7f2f480b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f500d5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f481491c0 0x7f2f48149630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f500d5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f480b6670 con 0x7f2f480baee0 2023-11-27T17:54:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f500d5640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f480b6cf0 con 0x7f2f481491c0 2023-11-27T17:54:17.517 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f500d5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480b9570 con 0x7f2f480bab00 2023-11-27T17:54:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f4de71640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f480bab00 0x7f2f480b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f4e672640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f481491c0 0x7f2f48149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f4e672640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2f481491c0 0x7f2f48149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.31:45688/0 (socket says 172.21.15.31:45688) 2023-11-27T17:54:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f4de71640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f480bab00 0x7f2f480b6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3301/0 says I am v2:172.21.15.31:51430/0 (socket says 172.21.15.31:51430) 2023-11-27T17:54:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f4e672640 1 -- 172.21.15.31:0/1607811901 learned_addr learned my addr 172.21.15.31:0/1607811901 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f4e672640 1 -- 172.21.15.31:0/1607811901 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f480bab00 msgr2=0x7f2f480b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:54:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f4e672640 1 --2- 172.21.15.31:0/1607811901 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f480bab00 0x7f2f480b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f4e672640 1 -- 172.21.15.31:0/1607811901 >> v1:172.21.15.81:6789/0 conn(0x7f2f480baee0 legacy=0x7f2f481430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.518 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.512+0000 7f2f4e672640 1 -- 172.21.15.31:0/1607811901 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f480b9e10 con 0x7f2f481491c0 2023-11-27T17:54:17.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4e672640 1 --2- 172.21.15.31:0/1607811901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f481491c0 0x7f2f48149630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009e50 tx=0x7f2f4001ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b96cc843c3ef7b0c server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:17.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4ce6f640 1 -- 172.21.15.31:0/1607811901 <== mon.1 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f400a57d0 con 0x7f2f481491c0 2023-11-27T17:54:17.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4ce6f640 1 -- 172.21.15.31:0/1607811901 <== mon.1 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f400a5930 con 0x7f2f481491c0 2023-11-27T17:54:17.520 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4ce6f640 1 -- 172.21.15.31:0/1607811901 <== mon.1 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f400a5cc0 con 0x7f2f481491c0 2023-11-27T17:54:17.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 -- 172.21.15.31:0/1607811901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f481491c0 msgr2=0x7f2f48149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 --2- 172.21.15.31:0/1607811901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f481491c0 0x7f2f48149630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f40009e50 tx=0x7f2f4001ca10 comp rx=0 tx=0).stop 2023-11-27T17:54:17.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 -- 172.21.15.31:0/1607811901 shutdown_connections 2023-11-27T17:54:17.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 --2- 172.21.15.31:0/1607811901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f481491c0 0x7f2f48149630 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 --2- 172.21.15.31:0/1607811901 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f480bab00 0x7f2f480b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.521 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 -- 172.21.15.31:0/1607811901 >> 172.21.15.31:0/1607811901 conn(0x7f2f480beb70 msgr2=0x7f2f480bef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:17.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 -- 172.21.15.31:0/1607811901 shutdown_connections 2023-11-27T17:54:17.522 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 -- 172.21.15.31:0/1607811901 wait complete. 2023-11-27T17:54:17.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 Processor -- start 2023-11-27T17:54:17.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 -- start start 2023-11-27T17:54:17.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f480bab00 0x7f2f4806ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480baee0 0x7f2f48148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f481491c0 0x7f2f48137390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4806bf50 con 0x7f2f480baee0 2023-11-27T17:54:17.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f48138c60 con 0x7f2f480bab00 2023-11-27T17:54:17.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f500d5640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480b5740 con 0x7f2f481491c0 2023-11-27T17:54:17.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4d670640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480baee0 0x7f2f48148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4d670640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480baee0 0x7f2f48148110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:46276/0 (socket says 172.21.15.31:46276) 2023-11-27T17:54:17.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4d670640 1 -- 172.21.15.31:0/2614127339 learned_addr learned my addr 172.21.15.31:0/2614127339 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:54:17.524 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4e672640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f481491c0 0x7f2f48137390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4de71640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f480bab00 0x7f2f4806ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4d670640 1 -- 172.21.15.31:0/2614127339 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f481491c0 msgr2=0x7f2f48137390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4d670640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f481491c0 0x7f2f48137390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4d670640 1 -- 172.21.15.31:0/2614127339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f480bab00 msgr2=0x7f2f4806ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4d670640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f480bab00 0x7f2f4806ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.516+0000 7f2f4d670640 1 -- 172.21.15.31:0/2614127339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f40009b30 con 0x7f2f480baee0 2023-11-27T17:54:17.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.520+0000 7f2f4d670640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480baee0 0x7f2f48148110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800c450 tx=0x7f2f3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:17.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.520+0000 7f2f3e7fc640 1 -- 172.21.15.31:0/2614127339 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f380052d0 con 0x7f2f480baee0 2023-11-27T17:54:17.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.520+0000 7f2f500d5640 1 -- 172.21.15.31:0/2614127339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f48148650 con 0x7f2f480baee0 2023-11-27T17:54:17.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.520+0000 7f2f3e7fc640 1 -- 172.21.15.31:0/2614127339 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f38005430 con 0x7f2f480baee0 2023-11-27T17:54:17.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.520+0000 7f2f3e7fc640 1 -- 172.21.15.31:0/2614127339 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38007260 con 0x7f2f480baee0 2023-11-27T17:54:17.525 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.520+0000 7f2f500d5640 1 -- 172.21.15.31:0/2614127339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f481387f0 con 0x7f2f480baee0 2023-11-27T17:54:17.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.520+0000 7f2f500d5640 1 -- 172.21.15.31:0/2614127339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f480b68b0 con 0x7f2f480baee0 2023-11-27T17:54:17.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.520+0000 7f2f3e7fc640 1 -- 172.21.15.31:0/2614127339 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f2f380073c0 con 0x7f2f480baee0 2023-11-27T17:54:17.526 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.520+0000 7f2f3e7fc640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2f2c066820 0x7f2f2c068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:54:17.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.520+0000 7f2f3e7fc640 1 -- 172.21.15.31:0/2614127339 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f38083bc0 con 0x7f2f480baee0 2023-11-27T17:54:17.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.520+0000 7f2f4de71640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2f2c066820 0x7f2f2c068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:54:17.527 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.520+0000 7f2f4de71640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2f2c066820 0x7f2f2c068ce0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009af0 tx=0x7f2f44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:54:17.530 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.524+0000 7f2f3e7fc640 1 -- 172.21.15.31:0/2614127339 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f2f38050c30 con 0x7f2f480baee0 2023-11-27T17:54:17.723 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 -- 172.21.15.31:0/2614127339 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2f480bcac0 con 0x7f2f480baee0 2023-11-27T17:54:17.724 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f3e7fc640 1 -- 172.21.15.31:0/2614127339 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2f38054250 con 0x7f2f480baee0 2023-11-27T17:54:17.724 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-27T17:54:17.726 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 -- 172.21.15.31:0/2614127339 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2f2c066820 msgr2=0x7f2f2c068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2f2c066820 0x7f2f2c068ce0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2f44009af0 tx=0x7f2f44008040 comp rx=0 tx=0).stop 2023-11-27T17:54:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 -- 172.21.15.31:0/2614127339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480baee0 msgr2=0x7f2f48148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:54:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480baee0 0x7f2f48148110 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f3800c450 tx=0x7f2f3800c910 comp rx=0 tx=0).stop 2023-11-27T17:54:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 -- 172.21.15.31:0/2614127339 shutdown_connections 2023-11-27T17:54:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2f2c066820 0x7f2f2c068ce0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f481491c0 0x7f2f48137390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f480baee0 0x7f2f48148110 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 --2- 172.21.15.31:0/2614127339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f480bab00 0x7f2f4806ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:54:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 -- 172.21.15.31:0/2614127339 >> 172.21.15.31:0/2614127339 conn(0x7f2f480beb70 msgr2=0x7f2f481390f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:54:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 -- 172.21.15.31:0/2614127339 shutdown_connections 2023-11-27T17:54:17.727 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:54:17.720+0000 7f2f500d5640 1 -- 172.21.15.31:0/2614127339 wait complete. 2023-11-27T17:54:17.743 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-27T17:54:17.743 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-27T17:54:17.743 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2023-11-27T17:54:17.744 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-27T17:54:17.744 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-27T17:54:17.744 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-27T17:54:17.744 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-27T17:54:17.744 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-27T17:54:17.744 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T17:54:17.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:17.744 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2023-11-27T17:54:17.754 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-27T17:54:17.754 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-27T17:54:17.754 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2023-11-27T17:54:17.754 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:54:17.754 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2023-11-27T17:54:17.755 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:54:17.755 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-27T17:54:17.755 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:54:17.755 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2023-11-27T17:54:17.755 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-27T17:54:17.755 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:54:17.755 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2023-11-27T17:54:17.755 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-27T17:54:17.755 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:54:17.755 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-27T17:54:17.755 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:54:17.755 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-27T17:54:17.756 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 41835sec preferred_lft 41835sec 2023-11-27T17:54:17.756 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link 2023-11-27T17:54:17.756 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:54:17.756 INFO:teuthology.orchestra.run.smithi176.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-27T17:54:17.756 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 02:42:b5:18:27:01 brd ff:ff:ff:ff:ff:ff 2023-11-27T17:54:17.756 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-27T17:54:17.756 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:54:17.756 INFO:teuthology.orchestra.run.smithi176.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-27T17:54:17.756 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-27T17:54:17.756 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-27T17:54:17.756 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:54:17.756 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-27T17:54:17.757 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:54:17.757 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-27T17:54:17.757 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-27T17:54:17.757 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-27T17:54:17.757 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-27T17:54:17.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:17.758 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-27T17:54:17.824 INFO:teuthology.orchestra.run.smithi176.stdout:1 2023-11-27T17:54:17.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:17.827 DEBUG:teuthology.orchestra.run.smithi176:> route 2023-11-27T17:54:17.881 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2023-11-27T17:54:17.882 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-27T17:54:17.883 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-27T17:54:17.883 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-27T17:54:17.883 INFO:teuthology.orchestra.run.smithi176.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-27T17:54:17.883 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-27T17:54:17.884 INFO:teuthology.orchestra.run.smithi176.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-27T17:54:17.884 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-27T17:54:17.884 INFO:teuthology.orchestra.run.smithi176.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-27T17:54:17.884 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-27T17:54:17.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:17.885 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-27T17:54:17.885 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-27T17:54:17.886 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-27T17:54:17.886 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-27T17:54:17.886 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-27T17:54:17.886 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-27T17:54:17.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:17.984 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-27T17:54:17.992 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-27T17:54:17.993 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-27T17:54:17.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:17.994 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2023-11-27T17:54:18.057 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:54:18.058 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-27T17:54:18.110 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-27T17:54:18.110 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-27T17:54:18.110 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-27T17:54:18.160 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-27T17:54:18.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:18.160 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T17:54:18.252 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T17:54:18.252 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T17:54:18.252 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-27T17:54:18.268 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T17:54:18.268 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T17:54:18.268 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-27T17:54:18.268 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.81:3300,172.21.15.81:3301" 2023-11-27T17:54:18.268 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:54:18.281 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-27T17:54:18.281 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-27T17:54:18.281 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-27T17:54:18.281 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.81:3300,172.21.15.81:3301" 2023-11-27T17:54:18.281 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-27T17:54:18.281 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.81:6789,172.21.15.81:6790" 2023-11-27T17:54:18.281 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.81:6789,172.21.15.81:6790:/ 2023-11-27T17:54:18.281 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=d7e0ec54-b878-4521-a03f-3b848cceedea" will pass to kernel 2023-11-27T17:54:18.285 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-27T17:54:18.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:18.285 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-27T17:54:18.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:18.307 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-27T17:54:18.377 INFO:teuthology.orchestra.run.smithi176.stdout:client4736 2023-11-27T17:54:18.377 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:54:18.377 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-27T17:54:18.429 DEBUG:teuthology.orchestra.run.smithi176:> mktemp -d --suffix=xfstests-dev 2023-11-27T17:54:18.480 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.jkmd5q6IvPxfstests-dev 2023-11-27T17:54:18.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:18.481 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.jkmd5q6IvPxfstests-dev) 2023-11-27T17:54:18.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:18.550 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.jkmd5q6IvPxfstests-dev) 2023-11-27T17:54:18.611 INFO:teuthology.orchestra.run.smithi176.stderr:Cloning into '/tmp/tmp.jkmd5q6IvPxfstests-dev'... 2023-11-27T17:54:19.471 DEBUG:teuthology.orchestra.run.smithi176:> mktemp -d --suffix=xfsprogs-dev 2023-11-27T17:54:19.521 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.3xbh07rOVlxfsprogs-dev 2023-11-27T17:54:19.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:19.521 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.3xbh07rOVlxfsprogs-dev) 2023-11-27T17:54:19.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:19.588 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.3xbh07rOVlxfsprogs-dev) 2023-11-27T17:54:19.650 INFO:teuthology.orchestra.run.smithi176.stderr:Cloning into '/tmp/tmp.3xbh07rOVlxfsprogs-dev'... 2023-11-27T17:54:20.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:20.215 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-11-27T17:54:20.283 DEBUG:teuthology.orchestra.run.smithi176:> mktemp -d --suffix=test 2023-11-27T17:54:20.332 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.DS4YhDEjUCtest 2023-11-27T17:54:20.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-27T17:54:20.332 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-11-27T17:54:20.389 DEBUG:teuthology.orchestra.run.smithi176:> mktemp -d --suffix=scratch 2023-11-27T17:54:20.444 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.6yd4yFmSwtscratch 2023-11-27T17:54:20.444 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-11-27T17:54:20.444 DEBUG:teuthology.orchestra.run.smithi176:> sudo apt-get install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc git indent libacl1-dev libaio-dev libcap-dev libgdbm-dev libtool libtool-bin liburing-dev libuuid1 lvm2 make psmisc python3 quota sed uuid-dev uuid-runtime xfsprogs sqlite3 exfatprogs f2fs-tools ocfs2-tools udftools xfsdump xfslibs-dev libinih-dev liburcu-dev libblkid-dev gettext libedit-dev libattr1-dev libdevmapper-dev libicu-dev pkg-config 2023-11-27T17:54:20.562 INFO:teuthology.orchestra.run.smithi176.stdout:Reading package lists... 2023-11-27T17:54:20.729 INFO:teuthology.orchestra.run.smithi176.stdout:Building dependency tree... 2023-11-27T17:54:20.729 INFO:teuthology.orchestra.run.smithi176.stdout:Reading state information... 2023-11-27T17:54:20.881 INFO:teuthology.orchestra.run.smithi176.stdout:acl is already the newest version (2.3.1-1). 2023-11-27T17:54:20.881 INFO:teuthology.orchestra.run.smithi176.stdout:acl set to manually installed. 2023-11-27T17:54:20.881 INFO:teuthology.orchestra.run.smithi176.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-11-27T17:54:20.881 INFO:teuthology.orchestra.run.smithi176.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-11-27T17:54:20.881 INFO:teuthology.orchestra.run.smithi176.stdout:bc is already the newest version (1.07.1-3build1). 2023-11-27T17:54:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-11-27T17:54:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:gcc set to manually installed. 2023-11-27T17:54:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:gettext is already the newest version (0.21-4ubuntu4). 2023-11-27T17:54:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-11-27T17:54:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-11-27T17:54:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:libattr1-dev is already the newest version (1:2.5.1-1build1). 2023-11-27T17:54:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:libtool is already the newest version (2.4.6-15build2). 2023-11-27T17:54:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-27T17:54:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-11-27T17:54:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:lvm2 is already the newest version (2.03.11-2.1ubuntu4). 2023-11-27T17:54:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:make is already the newest version (4.3-4.1build1). 2023-11-27T17:54:20.882 INFO:teuthology.orchestra.run.smithi176.stdout:make set to manually installed. 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:psmisc is already the newest version (23.4-2build3). 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:quota is already the newest version (4.06-1build2). 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:sed is already the newest version (4.8-1ubuntu2). 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:xfsdump is already the newest version (3.1.9+0+nmu2). 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:dbench is already the newest version (4.0-2build1). 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:dump is already the newest version (0.4b47-3). 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:git is already the newest version (1:2.34.1-1ubuntu1.10). 2023-11-27T17:54:20.883 INFO:teuthology.orchestra.run.smithi176.stdout:indent is already the newest version (2.2.12-1ubuntu0.22.04.1). 2023-11-27T17:54:20.884 INFO:teuthology.orchestra.run.smithi176.stdout:python3 is already the newest version (3.10.6-1~22.04). 2023-11-27T17:54:20.884 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages were automatically installed and are no longer required: 2023-11-27T17:54:20.884 INFO:teuthology.orchestra.run.smithi176.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-11-27T17:54:20.884 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2-dev libpython2-stdlib libpython2.7 libpython2.7-dev 2023-11-27T17:54:20.884 INFO:teuthology.orchestra.run.smithi176.stdout: libpython2.7-minimal libpython2.7-stdlib linux-image-5.4.0-135-generic 2023-11-27T17:54:20.884 INFO:teuthology.orchestra.run.smithi176.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2023-11-27T17:54:20.885 INFO:teuthology.orchestra.run.smithi176.stdout: python2.7 python2.7-dev python2.7-minimal 2023-11-27T17:54:20.885 INFO:teuthology.orchestra.run.smithi176.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-27T17:54:20.885 INFO:teuthology.orchestra.run.smithi176.stdout:The following additional packages will be installed: 2023-11-27T17:54:20.885 INFO:teuthology.orchestra.run.smithi176.stdout: icu-devtools libbsd-dev libcap2 libcmap4 libcorosync-common4 libdlm3 2023-11-27T17:54:20.885 INFO:teuthology.orchestra.run.smithi176.stdout: libinireader0 libmd-dev libnss-systemd libpam-systemd libpcre2-32-0 2023-11-27T17:54:20.885 INFO:teuthology.orchestra.run.smithi176.stdout: libpcre2-dev libpcre2-posix3 libpmemblk1 libqb100 libselinux1-dev 2023-11-27T17:54:20.886 INFO:teuthology.orchestra.run.smithi176.stdout: libsepol-dev libsystemd0 libudev-dev libudev1 systemd systemd-sysv udev 2023-11-27T17:54:20.886 INFO:teuthology.orchestra.run.smithi176.stdout:Suggested packages: 2023-11-27T17:54:20.886 INFO:teuthology.orchestra.run.smithi176.stdout: gnuplot gfio python-scipy gawk-doc icu-doc sqlite3-doc systemd-container 2023-11-27T17:54:20.886 INFO:teuthology.orchestra.run.smithi176.stdout: libtss2-esys-3.0.2-0 libtss2-mu0 libtss2-rc0 dvd+rw-tools udfclient 2023-11-27T17:54:20.936 INFO:teuthology.orchestra.run.smithi176.stdout:The following NEW packages will be installed: 2023-11-27T17:54:20.936 INFO:teuthology.orchestra.run.smithi176.stdout: exfatprogs f2fs-tools fio icu-devtools libblkid-dev libbsd-dev libcap-dev 2023-11-27T17:54:20.936 INFO:teuthology.orchestra.run.smithi176.stdout: libcmap4 libcorosync-common4 libdevmapper-dev libdlm3 libedit-dev 2023-11-27T17:54:20.936 INFO:teuthology.orchestra.run.smithi176.stdout: libgdbm-dev libicu-dev libinih-dev libinireader0 libmd-dev libpcre2-32-0 2023-11-27T17:54:20.936 INFO:teuthology.orchestra.run.smithi176.stdout: libpcre2-dev libpcre2-posix3 libpmemblk1 libqb100 libselinux1-dev 2023-11-27T17:54:20.937 INFO:teuthology.orchestra.run.smithi176.stdout: libsepol-dev libudev-dev liburcu-dev liburing-dev ocfs2-tools pkg-config 2023-11-27T17:54:20.937 INFO:teuthology.orchestra.run.smithi176.stdout: sqlite3 udftools 2023-11-27T17:54:20.937 INFO:teuthology.orchestra.run.smithi176.stdout:The following packages will be upgraded: 2023-11-27T17:54:20.938 INFO:teuthology.orchestra.run.smithi176.stdout: gawk libcap2 libnss-systemd libpam-systemd libsystemd0 libudev1 systemd 2023-11-27T17:54:20.938 INFO:teuthology.orchestra.run.smithi176.stdout: systemd-sysv udev 2023-11-27T17:54:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:9 upgraded, 31 newly installed, 0 to remove and 254 not upgraded. 2023-11-27T17:54:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:Need to get 27.6 MB of archives. 2023-11-27T17:54:21.026 INFO:teuthology.orchestra.run.smithi176.stdout:After this operation, 71.7 MB of additional disk space will be used. 2023-11-27T17:54:21.027 INFO:teuthology.orchestra.run.smithi176.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsystemd0 amd64 249.11-0ubuntu3.11 [318 kB] 2023-11-27T17:54:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd-sysv amd64 249.11-0ubuntu3.11 [10.5 kB] 2023-11-27T17:54:21.232 INFO:teuthology.orchestra.run.smithi176.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnss-systemd amd64 249.11-0ubuntu3.11 [133 kB] 2023-11-27T17:54:21.245 INFO:teuthology.orchestra.run.smithi176.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpam-systemd amd64 249.11-0ubuntu3.11 [203 kB] 2023-11-27T17:54:21.265 INFO:teuthology.orchestra.run.smithi176.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd amd64 249.11-0ubuntu3.11 [4,581 kB] 2023-11-27T17:54:21.442 INFO:teuthology.orchestra.run.smithi176.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 udev amd64 249.11-0ubuntu3.11 [1,557 kB] 2023-11-27T17:54:21.532 INFO:teuthology.orchestra.run.smithi176.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev1 amd64 249.11-0ubuntu3.11 [78.0 kB] 2023-11-27T17:54:21.533 INFO:teuthology.orchestra.run.smithi176.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap2 amd64 1:2.44-1ubuntu0.22.04.1 [18.3 kB] 2023-11-27T17:54:21.533 INFO:teuthology.orchestra.run.smithi176.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2023-11-27T17:54:21.539 INFO:teuthology.orchestra.run.smithi176.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcorosync-common4 amd64 3.1.6-1ubuntu1 [7,322 B] 2023-11-27T17:54:21.539 INFO:teuthology.orchestra.run.smithi176.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqb100 amd64 2.0.4-1ubuntu0.2 [74.2 kB] 2023-11-27T17:54:21.540 INFO:teuthology.orchestra.run.smithi176.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcmap4 amd64 3.1.6-1ubuntu1 [10.4 kB] 2023-11-27T17:54:21.541 INFO:teuthology.orchestra.run.smithi176.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdlm3 amd64 4.1.1-1build1 [14.4 kB] 2023-11-27T17:54:21.541 INFO:teuthology.orchestra.run.smithi176.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 ocfs2-tools amd64 1.8.7-1build1 [646 kB] 2023-11-27T17:54:21.557 INFO:teuthology.orchestra.run.smithi176.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 exfatprogs amd64 1.1.3-1 [40.3 kB] 2023-11-27T17:54:21.575 INFO:teuthology.orchestra.run.smithi176.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 f2fs-tools amd64 1.14.0-2build1 [169 kB] 2023-11-27T17:54:21.602 INFO:teuthology.orchestra.run.smithi176.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-11-27T17:54:21.602 INFO:teuthology.orchestra.run.smithi176.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-11-27T17:54:21.732 INFO:teuthology.orchestra.run.smithi176.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 icu-devtools amd64 70.1-2 [197 kB] 2023-11-27T17:54:21.734 INFO:teuthology.orchestra.run.smithi176.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmd-dev amd64 1.0.4-1build1 [40.0 kB] 2023-11-27T17:54:21.734 INFO:teuthology.orchestra.run.smithi176.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbsd-dev amd64 0.11.5-1 [168 kB] 2023-11-27T17:54:21.737 INFO:teuthology.orchestra.run.smithi176.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap-dev amd64 1:2.44-1ubuntu0.22.04.1 [39.4 kB] 2023-11-27T17:54:21.737 INFO:teuthology.orchestra.run.smithi176.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev-dev amd64 249.11-0ubuntu3.11 [20.7 kB] 2023-11-27T17:54:21.738 INFO:teuthology.orchestra.run.smithi176.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libsepol-dev amd64 3.3-1build1 [378 kB] 2023-11-27T17:54:21.741 INFO:teuthology.orchestra.run.smithi176.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-32-0 amd64 10.39-3ubuntu0.1 [194 kB] 2023-11-27T17:54:21.743 INFO:teuthology.orchestra.run.smithi176.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-posix3 amd64 10.39-3ubuntu0.1 [6,130 B] 2023-11-27T17:54:21.744 INFO:teuthology.orchestra.run.smithi176.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-dev amd64 10.39-3ubuntu0.1 [730 kB] 2023-11-27T17:54:21.768 INFO:teuthology.orchestra.run.smithi176.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 libselinux1-dev amd64 3.3-1build2 [158 kB] 2023-11-27T17:54:21.787 INFO:teuthology.orchestra.run.smithi176.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdevmapper-dev amd64 2:1.02.175-2.1ubuntu4 [36.6 kB] 2023-11-27T17:54:21.788 INFO:teuthology.orchestra.run.smithi176.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 libedit-dev amd64 3.1-20210910-1build1 [118 kB] 2023-11-27T17:54:21.789 INFO:teuthology.orchestra.run.smithi176.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-11-27T17:54:21.791 INFO:teuthology.orchestra.run.smithi176.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 libicu-dev amd64 70.1-2 [11.6 MB] 2023-11-27T17:54:22.093 INFO:teuthology.orchestra.run.smithi176.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinireader0 amd64 53-1ubuntu3 [9,636 B] 2023-11-27T17:54:22.093 INFO:teuthology.orchestra.run.smithi176.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinih-dev amd64 53-1ubuntu3 [20.6 kB] 2023-11-27T17:54:22.094 INFO:teuthology.orchestra.run.smithi176.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburing-dev amd64 2.1-2build1 [51.8 kB] 2023-11-27T17:54:22.094 INFO:teuthology.orchestra.run.smithi176.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-27T17:54:22.095 INFO:teuthology.orchestra.run.smithi176.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-11-27T17:54:22.102 INFO:teuthology.orchestra.run.smithi176.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 libblkid-dev amd64 2.37.2-4ubuntu3 [185 kB] 2023-11-27T17:54:22.103 INFO:teuthology.orchestra.run.smithi176.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburcu-dev amd64 0.13.1-1 [125 kB] 2023-11-27T17:54:22.105 INFO:teuthology.orchestra.run.smithi176.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 udftools amd64 2.3-1 [125 kB] 2023-11-27T17:54:22.363 INFO:teuthology.orchestra.run.smithi176.stderr:debconf: unable to initialize frontend: Dialog 2023-11-27T17:54:22.363 INFO:teuthology.orchestra.run.smithi176.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-27T17:54:22.363 INFO:teuthology.orchestra.run.smithi176.stderr:debconf: falling back to frontend: Readline 2023-11-27T17:54:22.381 INFO:teuthology.orchestra.run.smithi176.stderr:debconf: unable to initialize frontend: Readline 2023-11-27T17:54:22.381 INFO:teuthology.orchestra.run.smithi176.stderr:debconf: (This frontend requires a controlling tty.) 2023-11-27T17:54:22.381 INFO:teuthology.orchestra.run.smithi176.stderr:debconf: falling back to frontend: Teletype 2023-11-27T17:54:22.388 INFO:teuthology.orchestra.run.smithi176.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-11-27T17:54:22.426 INFO:teuthology.orchestra.run.smithi176.stdout:Fetched 27.6 MB in 1s (23.8 MB/s) 2023-11-27T17:54:22.678 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142646 files and directories currently installed.) 2023-11-27T17:54:22.681 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../libsystemd0_249.11-0ubuntu3.11_amd64.deb ... 2023-11-27T17:54:22.861 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libsystemd0:amd64 (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-27T17:54:23.191 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libsystemd0:amd64 (249.11-0ubuntu3.11) ... 2023-11-27T17:54:23.591 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142646 files and directories currently installed.) 2023-11-27T17:54:23.594 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../0-systemd-sysv_249.11-0ubuntu3.11_amd64.deb ... 2023-11-27T17:54:23.718 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking systemd-sysv (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-27T17:54:24.271 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../1-libnss-systemd_249.11-0ubuntu3.11_amd64.deb ... 2023-11-27T17:54:24.398 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libnss-systemd:amd64 (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-27T17:54:24.759 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../2-libpam-systemd_249.11-0ubuntu3.11_amd64.deb ... 2023-11-27T17:54:24.861 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpam-systemd:amd64 (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-27T17:54:25.306 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../3-systemd_249.11-0ubuntu3.11_amd64.deb ... 2023-11-27T17:54:25.490 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking systemd (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-27T17:54:26.519 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../4-udev_249.11-0ubuntu3.11_amd64.deb ... 2023-11-27T17:54:26.680 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking udev (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-27T17:54:27.279 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../5-libudev1_249.11-0ubuntu3.11_amd64.deb ... 2023-11-27T17:54:27.423 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libudev1:amd64 (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-27T17:54:27.730 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libudev1:amd64 (249.11-0ubuntu3.11) ... 2023-11-27T17:54:28.158 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142646 files and directories currently installed.) 2023-11-27T17:54:28.162 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../libcap2_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:54:28.297 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) over (1:2.44-1build3) ... 2023-11-27T17:54:28.611 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-27T17:54:29.056 INFO:teuthology.orchestra.run.smithi176.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142646 files and directories currently installed.) 2023-11-27T17:54:29.060 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../00-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2023-11-27T17:54:29.205 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2023-11-27T17:54:29.740 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcorosync-common4:amd64. 2023-11-27T17:54:29.754 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../01-libcorosync-common4_3.1.6-1ubuntu1_amd64.deb ... 2023-11-27T17:54:29.806 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2023-11-27T17:54:30.076 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libqb100:amd64. 2023-11-27T17:54:30.091 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../02-libqb100_2.0.4-1ubuntu0.2_amd64.deb ... 2023-11-27T17:54:30.126 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2023-11-27T17:54:30.462 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcmap4:amd64. 2023-11-27T17:54:30.477 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../03-libcmap4_3.1.6-1ubuntu1_amd64.deb ... 2023-11-27T17:54:30.554 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcmap4:amd64 (3.1.6-1ubuntu1) ... 2023-11-27T17:54:30.873 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libdlm3:amd64. 2023-11-27T17:54:30.888 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../04-libdlm3_4.1.1-1build1_amd64.deb ... 2023-11-27T17:54:30.932 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libdlm3:amd64 (4.1.1-1build1) ... 2023-11-27T17:54:31.285 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package ocfs2-tools. 2023-11-27T17:54:31.301 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../05-ocfs2-tools_1.8.7-1build1_amd64.deb ... 2023-11-27T17:54:31.335 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking ocfs2-tools (1.8.7-1build1) ... 2023-11-27T17:54:31.648 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package exfatprogs. 2023-11-27T17:54:31.664 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../06-exfatprogs_1.1.3-1_amd64.deb ... 2023-11-27T17:54:31.739 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking exfatprogs (1.1.3-1) ... 2023-11-27T17:54:32.001 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package f2fs-tools. 2023-11-27T17:54:32.017 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../07-f2fs-tools_1.14.0-2build1_amd64.deb ... 2023-11-27T17:54:32.059 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking f2fs-tools (1.14.0-2build1) ... 2023-11-27T17:54:32.412 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-11-27T17:54:32.428 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../08-libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-11-27T17:54:32.462 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-11-27T17:54:32.765 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package fio. 2023-11-27T17:54:32.781 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../09-fio_3.28-1_amd64.deb ... 2023-11-27T17:54:32.832 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking fio (3.28-1) ... 2023-11-27T17:54:33.227 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package icu-devtools. 2023-11-27T17:54:33.242 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../10-icu-devtools_70.1-2_amd64.deb ... 2023-11-27T17:54:33.277 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking icu-devtools (70.1-2) ... 2023-11-27T17:54:33.531 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libmd-dev:amd64. 2023-11-27T17:54:33.546 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../11-libmd-dev_1.0.4-1build1_amd64.deb ... 2023-11-27T17:54:33.589 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libmd-dev:amd64 (1.0.4-1build1) ... 2023-11-27T17:54:33.844 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libbsd-dev:amd64. 2023-11-27T17:54:33.859 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../12-libbsd-dev_0.11.5-1_amd64.deb ... 2023-11-27T17:54:33.902 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libbsd-dev:amd64 (0.11.5-1) ... 2023-11-27T17:54:34.208 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libcap-dev:amd64. 2023-11-27T17:54:34.223 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../13-libcap-dev_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2023-11-27T17:54:34.258 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-27T17:54:34.521 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libudev-dev:amd64. 2023-11-27T17:54:34.535 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../14-libudev-dev_249.11-0ubuntu3.11_amd64.deb ... 2023-11-27T17:54:34.579 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libudev-dev:amd64 (249.11-0ubuntu3.11) ... 2023-11-27T17:54:34.826 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libsepol-dev:amd64. 2023-11-27T17:54:34.840 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../15-libsepol-dev_3.3-1build1_amd64.deb ... 2023-11-27T17:54:34.876 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libsepol-dev:amd64 (3.3-1build1) ... 2023-11-27T17:54:35.220 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpcre2-32-0:amd64. 2023-11-27T17:54:35.235 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../16-libpcre2-32-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-27T17:54:35.301 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T17:54:35.640 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpcre2-posix3:amd64. 2023-11-27T17:54:35.654 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../17-libpcre2-posix3_10.39-3ubuntu0.1_amd64.deb ... 2023-11-27T17:54:35.698 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T17:54:35.942 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libpcre2-dev:amd64. 2023-11-27T17:54:35.957 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../18-libpcre2-dev_10.39-3ubuntu0.1_amd64.deb ... 2023-11-27T17:54:36.001 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T17:54:36.381 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libselinux1-dev:amd64. 2023-11-27T17:54:36.396 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../19-libselinux1-dev_3.3-1build2_amd64.deb ... 2023-11-27T17:54:36.448 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libselinux1-dev:amd64 (3.3-1build2) ... 2023-11-27T17:54:36.781 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libdevmapper-dev:amd64. 2023-11-27T17:54:36.795 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../20-libdevmapper-dev_2%3a1.02.175-2.1ubuntu4_amd64.deb ... 2023-11-27T17:54:36.839 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2023-11-27T17:54:37.083 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libedit-dev:amd64. 2023-11-27T17:54:37.098 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../21-libedit-dev_3.1-20210910-1build1_amd64.deb ... 2023-11-27T17:54:37.133 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libedit-dev:amd64 (3.1-20210910-1build1) ... 2023-11-27T17:54:37.404 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-11-27T17:54:37.419 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../22-libgdbm-dev_1.23-1_amd64.deb ... 2023-11-27T17:54:37.462 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-11-27T17:54:37.798 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libicu-dev:amd64. 2023-11-27T17:54:37.813 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../23-libicu-dev_70.1-2_amd64.deb ... 2023-11-27T17:54:37.857 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libicu-dev:amd64 (70.1-2) ... 2023-11-27T17:54:38.627 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libinireader0:amd64. 2023-11-27T17:54:38.643 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../24-libinireader0_53-1ubuntu3_amd64.deb ... 2023-11-27T17:54:38.686 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libinireader0:amd64 (53-1ubuntu3) ... 2023-11-27T17:54:38.938 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libinih-dev:amd64. 2023-11-27T17:54:38.953 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../25-libinih-dev_53-1ubuntu3_amd64.deb ... 2023-11-27T17:54:38.988 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libinih-dev:amd64 (53-1ubuntu3) ... 2023-11-27T17:54:39.240 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liburing-dev:amd64. 2023-11-27T17:54:39.255 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../26-liburing-dev_2.1-2build1_amd64.deb ... 2023-11-27T17:54:39.299 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liburing-dev:amd64 (2.1-2build1) ... 2023-11-27T17:54:39.636 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package pkg-config. 2023-11-27T17:54:39.651 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../27-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-27T17:54:39.694 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-27T17:54:39.947 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package sqlite3. 2023-11-27T17:54:39.962 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../28-sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-11-27T17:54:40.005 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-11-27T17:54:40.265 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package libblkid-dev:amd64. 2023-11-27T17:54:40.280 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../29-libblkid-dev_2.37.2-4ubuntu3_amd64.deb ... 2023-11-27T17:54:40.324 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2023-11-27T17:54:40.593 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package liburcu-dev:amd64. 2023-11-27T17:54:40.608 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../30-liburcu-dev_0.13.1-1_amd64.deb ... 2023-11-27T17:54:40.651 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking liburcu-dev:amd64 (0.13.1-1) ... 2023-11-27T17:54:41.039 INFO:teuthology.orchestra.run.smithi176.stdout:Selecting previously unselected package udftools. 2023-11-27T17:54:41.054 INFO:teuthology.orchestra.run.smithi176.stdout:Preparing to unpack .../31-udftools_2.3-1_amd64.deb ... 2023-11-27T17:54:41.102 INFO:teuthology.orchestra.run.smithi176.stdout:Unpacking udftools (2.3-1) ... 2023-11-27T17:54:41.413 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liburcu-dev:amd64 (0.13.1-1) ... 2023-11-27T17:54:41.536 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2023-11-27T17:54:41.662 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libinireader0:amd64 (53-1ubuntu3) ... 2023-11-27T17:54:41.780 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up exfatprogs (1.1.3-1) ... 2023-11-27T17:54:41.897 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2023-11-27T17:54:42.125 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up f2fs-tools (1.14.0-2build1) ... 2023-11-27T17:54:42.250 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2023-11-27T17:54:42.406 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2023-11-27T17:54:42.536 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up systemd (249.11-0ubuntu3.11) ... 2023-11-27T17:54:44.035 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T17:54:44.169 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up udev (249.11-0ubuntu3.11) ... 2023-11-27T17:54:45.630 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up icu-devtools (70.1-2) ... 2023-11-27T17:54:45.748 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-27T17:54:46.007 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libudev-dev:amd64 (249.11-0ubuntu3.11) ... 2023-11-27T17:54:46.134 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libsepol-dev:amd64 (3.3-1build1) ... 2023-11-27T17:54:46.268 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-11-27T17:54:46.411 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libinih-dev:amd64 (53-1ubuntu3) ... 2023-11-27T17:54:46.537 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T17:54:46.663 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libmd-dev:amd64 (1.0.4-1build1) ... 2023-11-27T17:54:46.780 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up udftools (2.3-1) ... 2023-11-27T17:54:47.118 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:54:47.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:54:47.123 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:54:47.290 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libdlm3:amd64 (4.1.1-1build1) ... 2023-11-27T17:54:47.416 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-11-27T17:54:47.558 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-27T17:54:47.684 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libicu-dev:amd64 (70.1-2) ... 2023-11-27T17:54:47.819 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libbsd-dev:amd64 (0.11.5-1) ... 2023-11-27T17:54:47.945 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-11-27T17:54:48.071 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up liburing-dev:amd64 (2.1-2build1) ... 2023-11-27T17:54:48.180 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up systemd-sysv (249.11-0ubuntu3.11) ... 2023-11-27T17:54:48.281 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2023-11-27T17:54:48.418 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libcmap4:amd64 (3.1.6-1ubuntu1) ... 2023-11-27T17:54:48.549 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libselinux1-dev:amd64 (3.3-1build2) ... 2023-11-27T17:54:48.675 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libnss-systemd:amd64 (249.11-0ubuntu3.11) ... 2023-11-27T17:54:48.810 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up fio (3.28-1) ... 2023-11-27T17:54:49.370 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libedit-dev:amd64 (3.1-20210910-1build1) ... 2023-11-27T17:54:49.621 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2023-11-27T17:54:49.747 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up ocfs2-tools (1.8.7-1build1) ... 2023-11-27T17:54:49.981 INFO:teuthology.orchestra.run.smithi176.stdout:debconf: unable to initialize frontend: Dialog 2023-11-27T17:54:49.981 INFO:teuthology.orchestra.run.smithi176.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-27T17:54:49.981 INFO:teuthology.orchestra.run.smithi176.stdout:debconf: falling back to frontend: Readline 2023-11-27T17:54:51.058 INFO:teuthology.orchestra.run.smithi176.stdout:Setting up libpam-systemd:amd64 (249.11-0ubuntu3.11) ... 2023-11-27T17:54:51.263 INFO:teuthology.orchestra.run.smithi176.stdout:debconf: unable to initialize frontend: Dialog 2023-11-27T17:54:51.263 INFO:teuthology.orchestra.run.smithi176.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-27T17:54:51.263 INFO:teuthology.orchestra.run.smithi176.stdout:debconf: falling back to frontend: Readline 2023-11-27T17:54:51.527 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2023-11-27T17:54:51.615 INFO:teuthology.orchestra.run.smithi176.stdout:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-27T17:55:05.689 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-27T17:55:05.841 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-27T17:55:07.375 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-27T17:55:07.469 INFO:teuthology.orchestra.run.smithi176.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-27T17:55:08.002 DEBUG:teuthology.orchestra.run.smithi176:> sudo useradd -m fsgqa 2023-11-27T17:55:08.063 INFO:teuthology.orchestra.run.smithi176.stderr:useradd: user 'fsgqa' already exists 2023-11-27T17:55:08.065 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-27T17:55:08.065 DEBUG:teuthology.orchestra.run.smithi176:> sudo groupadd fsgqa 2023-11-27T17:55:08.130 INFO:teuthology.orchestra.run.smithi176.stderr:groupadd: group 'fsgqa' already exists 2023-11-27T17:55:08.131 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-27T17:55:08.132 DEBUG:teuthology.orchestra.run.smithi176:> sudo useradd fsgqa2 2023-11-27T17:55:08.684 DEBUG:teuthology.orchestra.run.smithi176:> sudo useradd 123456-fsgqa 2023-11-27T17:55:09.046 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-27T17:55:09.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f613967b640 1 Processor -- start 2023-11-27T17:55:09.181 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f613967b640 1 -- start start 2023-11-27T17:55:09.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f613967b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61340bab00 0x7f61340b6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f613967b640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61340b6670 con 0x7f61340baee0 2023-11-27T17:55:09.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f613967b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61340b9570 con 0x7f61341491c0 2023-11-27T17:55:09.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f613967b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61340b6cf0 con 0x7f61340bab00 2023-11-27T17:55:09.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f61327fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f61340baee0 0x7f61341430b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44872/0 (socket says 172.21.15.31:44872) 2023-11-27T17:55:09.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f61327fc640 1 -- 172.21.15.31:0/1568468422 learned_addr learned my addr 172.21.15.31:0/1568468422 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:55:09.182 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6132ffd640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61340bab00 0x7f61340b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384589583 0 0) 0x7f61340b6670 con 0x7f61340baee0 2023-11-27T17:55:09.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6120003530 con 0x7f61340baee0 2023-11-27T17:55:09.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 308971897 0 0) 0x7f6120003530 con 0x7f61340baee0 2023-11-27T17:55:09.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61340bab00 msgr2=0x7f61340b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:55:09.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61340bab00 0x7f61340b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 >> v1:172.21.15.81:6789/0 conn(0x7f61341491c0 legacy=0x7f6134149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61340b9e10 con 0x7f61340baee0 2023-11-27T17:55:09.184 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f6124001a00 con 0x7f61340baee0 2023-11-27T17:55:09.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 >> v1:172.21.15.31:6789/0 conn(0x7f61340baee0 legacy=0x7f61341430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61340bab00 0x7f6120003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6120003f60 0x7f61200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6120004d10 0x7f6120005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61340b6cf0 con 0x7f6120003f60 2023-11-27T17:55:09.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612000ba70 con 0x7f6120004d10 2023-11-27T17:55:09.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612000bc30 con 0x7f61340bab00 2023-11-27T17:55:09.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f61327fc640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6120003f60 0x7f61200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f6132ffd640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61340bab00 0x7f6120003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f61337fe640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6120004d10 0x7f6120005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.185 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f61327fc640 1 -- 172.21.15.31:0/1568468422 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61340bab00 msgr2=0x7f6120003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:55:09.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f61327fc640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f61340bab00 0x7f6120003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f61327fc640 1 -- 172.21.15.31:0/1568468422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6120004d10 msgr2=0x7f6120005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:55:09.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f61327fc640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6120004d10 0x7f6120005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f61327fc640 1 -- 172.21.15.31:0/1568468422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6120003530 con 0x7f6120003f60 2023-11-27T17:55:09.186 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.175+0000 7f61337fe640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6120004d10 0x7f6120005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:55:09.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f61327fc640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6120003f60 0x7f61200047d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f612400a840 tx=0x7f612401d2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24985fbe8d41709 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:55:09.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61240ad630 con 0x7f6120003f60 2023-11-27T17:55:09.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61240a8070 con 0x7f6120003f60 2023-11-27T17:55:09.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f6131ffb640 1 -- 172.21.15.31:0/1568468422 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61240ada10 con 0x7f6120003f60 2023-11-27T17:55:09.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f613967b640 1 -- 172.21.15.31:0/1568468422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6120003f60 msgr2=0x7f61200047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f613967b640 1 --2- 172.21.15.31:0/1568468422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6120003f60 0x7f61200047d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f612400a840 tx=0x7f612401d2f0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f61337fe640 1 -- 172.21.15.31:0/1568468422 reap_dead start 2023-11-27T17:55:09.187 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f613967b640 1 -- 172.21.15.31:0/1568468422 shutdown_connections 2023-11-27T17:55:09.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f613967b640 1 -- 172.21.15.31:0/1568468422 >> 172.21.15.31:0/1568468422 conn(0x7f61340beb70 msgr2=0x7f61340bef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:55:09.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f613967b640 1 -- 172.21.15.31:0/1568468422 shutdown_connections 2023-11-27T17:55:09.188 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f613967b640 1 -- 172.21.15.31:0/1568468422 wait complete. 2023-11-27T17:55:09.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f613967b640 1 Processor -- start 2023-11-27T17:55:09.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.179+0000 7f613967b640 1 -- start start 2023-11-27T17:55:09.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f613967b640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613406bae0 0x7f613406bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f613967b640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f613406ce40 0x7f61340bd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f613967b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61340bdd50 0x7f61340b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f613967b640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61341e4250 con 0x7f613406bae0 2023-11-27T17:55:09.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f613967b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61340bd380 con 0x7f61340bdd50 2023-11-27T17:55:09.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f613967b640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61340be1d0 con 0x7f613406ce40 2023-11-27T17:55:09.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f6132ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613406bae0 0x7f613406bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f6132ffd640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613406bae0 0x7f613406bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44556/0 (socket says 172.21.15.31:44556) 2023-11-27T17:55:09.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f6132ffd640 1 -- 172.21.15.31:0/1674115622 learned_addr learned my addr 172.21.15.31:0/1674115622 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:55:09.190 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f61327fc640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f613406ce40 0x7f61340bd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f61337fe640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61340bdd50 0x7f61340b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f6132ffd640 1 -- 172.21.15.31:0/1674115622 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f613406ce40 msgr2=0x7f61340bd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f6132ffd640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f613406ce40 0x7f61340bd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f6132ffd640 1 -- 172.21.15.31:0/1674115622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61340bdd50 msgr2=0x7f61340b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f6132ffd640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61340bdd50 0x7f61340b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f6132ffd640 1 -- 172.21.15.31:0/1674115622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61340be890 con 0x7f613406bae0 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f61337fe640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61340bdd50 0x7f61340b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f6132ffd640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613406bae0 0x7f613406bec0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f611c011a00 tx=0x7f611c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f612b7fe640 1 -- 172.21.15.31:0/1674115622 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c00fb50 con 0x7f613406bae0 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f612b7fe640 1 -- 172.21.15.31:0/1674115622 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c00fcb0 con 0x7f613406bae0 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f612b7fe640 1 -- 172.21.15.31:0/1674115622 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c014440 con 0x7f613406bae0 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f613967b640 1 -- 172.21.15.31:0/1674115622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6134148e20 con 0x7f613406bae0 2023-11-27T17:55:09.191 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f613967b640 1 -- 172.21.15.31:0/1674115622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61341e4780 con 0x7f613406bae0 2023-11-27T17:55:09.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f613967b640 1 -- 172.21.15.31:0/1674115622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61340b68b0 con 0x7f613406bae0 2023-11-27T17:55:09.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f612b7fe640 1 -- 172.21.15.31:0/1674115622 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f611c0145a0 con 0x7f613406bae0 2023-11-27T17:55:09.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f612b7fe640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6114066820 0x7f6114068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.192 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f612b7fe640 1 -- 172.21.15.31:0/1674115622 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f611c084c40 con 0x7f613406bae0 2023-11-27T17:55:09.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.183+0000 7f61327fc640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6114066820 0x7f6114068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.193 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.187+0000 7f61327fc640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6114066820 0x7f6114068ce0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f61240ad000 tx=0x7f6124009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:55:09.196 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.191+0000 7f612b7fe640 1 -- 172.21.15.31:0/1674115622 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f611c051d60 con 0x7f613406bae0 2023-11-27T17:55:09.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.403+0000 7f613967b640 1 -- 172.21.15.31:0/1674115622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f613404e850 con 0x7f613406bae0 2023-11-27T17:55:09.411 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.403+0000 7f612b7fe640 1 -- 172.21.15.31:0/1674115622 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1277 (secure 0 0 0) 0x7f611c022020 con 0x7f613406bae0 2023-11-27T17:55:09.412 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:55:09.412 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":1,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","modified":"2023-11-27T17:52:18.491503Z","created":"2023-11-27T17:52:18.491503Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3301","nonce":0},{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-27T17:55:09.412 INFO:teuthology.orchestra.run.smithi031.stderr:dumped monmap epoch 1 2023-11-27T17:55:09.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.407+0000 7f613967b640 1 -- 172.21.15.31:0/1674115622 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6114066820 msgr2=0x7f6114068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.407+0000 7f613967b640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6114066820 0x7f6114068ce0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f61240ad000 tx=0x7f6124009040 comp rx=0 tx=0).stop 2023-11-27T17:55:09.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.407+0000 7f613967b640 1 -- 172.21.15.31:0/1674115622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613406bae0 msgr2=0x7f613406bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.407+0000 7f613967b640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613406bae0 0x7f613406bec0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f611c011a00 tx=0x7f611c011ec0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.407+0000 7f613967b640 1 -- 172.21.15.31:0/1674115622 shutdown_connections 2023-11-27T17:55:09.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.407+0000 7f613967b640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f6114066820 0x7f6114068ce0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.407+0000 7f613967b640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61340bdd50 0x7f61340b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.407+0000 7f613967b640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f613406ce40 0x7f61340bd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.407+0000 7f613967b640 1 --2- 172.21.15.31:0/1674115622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f613406bae0 0x7f613406bec0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.414 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.407+0000 7f613967b640 1 -- 172.21.15.31:0/1674115622 >> 172.21.15.31:0/1674115622 conn(0x7f61340beb70 msgr2=0x7f6134142cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:55:09.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.407+0000 7f613967b640 1 -- 172.21.15.31:0/1674115622 shutdown_connections 2023-11-27T17:55:09.415 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.407+0000 7f613967b640 1 -- 172.21.15.31:0/1674115622 wait complete. 2023-11-27T17:55:09.431 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-11-27T17:55:09.557 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31e177e640 1 Processor -- start 2023-11-27T17:55:09.558 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31e177e640 1 -- start start 2023-11-27T17:55:09.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31e177e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f31dc154b70 0x7f31dc156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.563 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31e177e640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31dc06baf0 con 0x7f31dc0bb0a0 2023-11-27T17:55:09.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31e177e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31dc0b9d00 con 0x7f31dc14bd50 2023-11-27T17:55:09.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31e177e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31dc0b9af0 con 0x7f31dc154b70 2023-11-27T17:55:09.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31da7fc640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f31dc0bb0a0 0x7f31dc06b3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:44876/0 (socket says 172.21.15.31:44876) 2023-11-27T17:55:09.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31da7fc640 1 -- 172.21.15.31:0/92145032 learned_addr learned my addr 172.21.15.31:0/92145032 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:55:09.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31db7fe640 1 --2- 172.21.15.31:0/92145032 >> v2:172.21.15.81:3300/0 conn(0x7f31dc154b70 0x7f31dc156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.564 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975702191 0 0) 0x7f31dc06baf0 con 0x7f31dc0bb0a0 2023-11-27T17:55:09.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c8003530 con 0x7f31dc0bb0a0 2023-11-27T17:55:09.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2646656483 0 0) 0x7f31c8003530 con 0x7f31dc0bb0a0 2023-11-27T17:55:09.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 >> v2:172.21.15.81:3300/0 conn(0x7f31dc154b70 msgr2=0x7f31dc156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:55:09.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 --2- 172.21.15.31:0/92145032 >> v2:172.21.15.81:3300/0 conn(0x7f31dc154b70 0x7f31dc156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 >> v1:172.21.15.81:6789/0 conn(0x7f31dc14bd50 legacy=0x7f31dc0b88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.565 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc0b9fe0 con 0x7f31dc0bb0a0 2023-11-27T17:55:09.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f31cc001680 con 0x7f31dc0bb0a0 2023-11-27T17:55:09.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 >> v1:172.21.15.31:6789/0 conn(0x7f31dc0bb0a0 legacy=0x7f31dc06b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 --2- 172.21.15.31:0/92145032 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f31c80039f0 0x7f31c8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 --2- 172.21.15.31:0/92145032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c80047d0 0x7f31c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.566 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 --2- 172.21.15.31:0/92145032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8005200 0x7f31c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc0b9af0 con 0x7f31c8005200 2023-11-27T17:55:09.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c800c160 con 0x7f31c80047d0 2023-11-27T17:55:09.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c800c320 con 0x7f31c80039f0 2023-11-27T17:55:09.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31db7fe640 1 --2- 172.21.15.31:0/92145032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8005200 0x7f31c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31da7fc640 1 --2- 172.21.15.31:0/92145032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c80047d0 0x7f31c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.551+0000 7f31daffd640 1 --2- 172.21.15.31:0/92145032 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f31c80039f0 0x7f31c8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.567 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31db7fe640 1 -- 172.21.15.31:0/92145032 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f31c80039f0 msgr2=0x7f31c8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:55:09.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31db7fe640 1 --2- 172.21.15.31:0/92145032 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f31c80039f0 0x7f31c8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31db7fe640 1 -- 172.21.15.31:0/92145032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c80047d0 msgr2=0x7f31c8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:55:09.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31db7fe640 1 --2- 172.21.15.31:0/92145032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c80047d0 0x7f31c8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31db7fe640 1 -- 172.21.15.31:0/92145032 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c8003530 con 0x7f31c8005200 2023-11-27T17:55:09.568 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31da7fc640 1 --2- 172.21.15.31:0/92145032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c80047d0 0x7f31c8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:55:09.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31db7fe640 1 -- 172.21.15.31:0/92145032 reap_dead start 2023-11-27T17:55:09.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31db7fe640 1 --2- 172.21.15.31:0/92145032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8005200 0x7f31c800b990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009fc0 tx=0x7f31d401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c885571c35d009 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:55:09.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d40a5bf0 con 0x7f31c8005200 2023-11-27T17:55:09.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d400f040 con 0x7f31c8005200 2023-11-27T17:55:09.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31d9ffb640 1 -- 172.21.15.31:0/92145032 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d40039a0 con 0x7f31c8005200 2023-11-27T17:55:09.569 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31e177e640 1 -- 172.21.15.31:0/92145032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8005200 msgr2=0x7f31c800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31e177e640 1 --2- 172.21.15.31:0/92145032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8005200 0x7f31c800b990 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f31d4009fc0 tx=0x7f31d401cbe0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31e177e640 1 -- 172.21.15.31:0/92145032 shutdown_connections 2023-11-27T17:55:09.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31e177e640 1 --2- 172.21.15.31:0/92145032 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31c8005200 0x7f31c800b990 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31e177e640 1 -- 172.21.15.31:0/92145032 >> 172.21.15.31:0/92145032 conn(0x7f31dc0beb00 msgr2=0x7f31dc0bef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:55:09.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31e177e640 1 -- 172.21.15.31:0/92145032 shutdown_connections 2023-11-27T17:55:09.570 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.555+0000 7f31e177e640 1 -- 172.21.15.31:0/92145032 wait complete. 2023-11-27T17:55:09.575 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31e177e640 1 Processor -- start 2023-11-27T17:55:09.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31e177e640 1 -- start start 2023-11-27T17:55:09.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31e177e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c8005200 0x7f31dc1412f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31e177e640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f31dc0b7af0 0x7f31dc148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31e177e640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31dc13ed40 0x7f31dc13f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31e177e640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc141830 con 0x7f31dc13ed40 2023-11-27T17:55:09.576 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31e177e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc13f710 con 0x7f31c8005200 2023-11-27T17:55:09.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31e177e640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc1485b0 con 0x7f31dc0b7af0 2023-11-27T17:55:09.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31db7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31dc13ed40 0x7f31dc13f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31db7fe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31dc13ed40 0x7f31dc13f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44582/0 (socket says 172.21.15.31:44582) 2023-11-27T17:55:09.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31db7fe640 1 -- 172.21.15.31:0/3945842996 learned_addr learned my addr 172.21.15.31:0/3945842996 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:55:09.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31da7fc640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f31dc0b7af0 0x7f31dc148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.577 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31daffd640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c8005200 0x7f31dc1412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31db7fe640 1 -- 172.21.15.31:0/3945842996 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f31dc0b7af0 msgr2=0x7f31dc148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31db7fe640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f31dc0b7af0 0x7f31dc148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31db7fe640 1 -- 172.21.15.31:0/3945842996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c8005200 msgr2=0x7f31dc1412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31db7fe640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c8005200 0x7f31dc1412f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31db7fe640 1 -- 172.21.15.31:0/3945842996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc0b8020 con 0x7f31dc13ed40 2023-11-27T17:55:09.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31db7fe640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31dc13ed40 0x7f31dc13f1d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f31d401c650 tx=0x7f31d4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:55:09.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31d37fe640 1 -- 172.21.15.31:0/3945842996 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4003db0 con 0x7f31dc13ed40 2023-11-27T17:55:09.578 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31d37fe640 1 -- 172.21.15.31:0/3945842996 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d4004030 con 0x7f31dc13ed40 2023-11-27T17:55:09.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31e177e640 1 -- 172.21.15.31:0/3945842996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31dc146ff0 con 0x7f31dc13ed40 2023-11-27T17:55:09.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31d37fe640 1 -- 172.21.15.31:0/3945842996 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d40043a0 con 0x7f31dc13ed40 2023-11-27T17:55:09.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31e177e640 1 -- 172.21.15.31:0/3945842996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31dc1475b0 con 0x7f31dc13ed40 2023-11-27T17:55:09.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31e177e640 1 -- 172.21.15.31:0/3945842996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31dc04e850 con 0x7f31dc13ed40 2023-11-27T17:55:09.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31d37fe640 1 -- 172.21.15.31:0/3945842996 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f31d4004500 con 0x7f31dc13ed40 2023-11-27T17:55:09.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31d37fe640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f31bc066820 0x7f31bc068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:55:09.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31d37fe640 1 -- 172.21.15.31:0/3945842996 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31d411fc90 con 0x7f31dc13ed40 2023-11-27T17:55:09.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.559+0000 7f31daffd640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f31bc066820 0x7f31bc068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:55:09.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.563+0000 7f31daffd640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f31bc066820 0x7f31bc068ce0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f31c4000c10 tx=0x7f31c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:55:09.579 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.563+0000 7f31d37fe640 1 -- 172.21.15.31:0/3945842996 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f31d40ecd90 con 0x7f31dc13ed40 2023-11-27T17:55:09.785 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.779+0000 7f31e177e640 1 -- 172.21.15.31:0/3945842996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f31dc146ca0 con 0x7f31dc13ed40 2023-11-27T17:55:09.786 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.779+0000 7f31d37fe640 1 -- 172.21.15.31:0/3945842996 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v9) v1 ==== 92+0+63 (secure 0 0 0) 0x7f31d40f03b0 con 0x7f31dc13ed40 2023-11-27T17:55:09.786 INFO:teuthology.orchestra.run.smithi031.stdout:[client.admin] 2023-11-27T17:55:09.786 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBS12RlWiRfKBAARLbvO/ZW3NBv6Trdj6bXGw== 2023-11-27T17:55:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.779+0000 7f31e177e640 1 -- 172.21.15.31:0/3945842996 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f31bc066820 msgr2=0x7f31bc068ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.779+0000 7f31e177e640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f31bc066820 0x7f31bc068ce0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f31c4000c10 tx=0x7f31c4009040 comp rx=0 tx=0).stop 2023-11-27T17:55:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.779+0000 7f31e177e640 1 -- 172.21.15.31:0/3945842996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31dc13ed40 msgr2=0x7f31dc13f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:55:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.779+0000 7f31e177e640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31dc13ed40 0x7f31dc13f1d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f31d401c650 tx=0x7f31d4009750 comp rx=0 tx=0).stop 2023-11-27T17:55:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.779+0000 7f31e177e640 1 -- 172.21.15.31:0/3945842996 shutdown_connections 2023-11-27T17:55:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.779+0000 7f31e177e640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f31bc066820 0x7f31bc068ce0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.779+0000 7f31e177e640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f31dc13ed40 0x7f31dc13f1d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.779+0000 7f31e177e640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f31dc0b7af0 0x7f31dc148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.788 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.779+0000 7f31e177e640 1 --2- 172.21.15.31:0/3945842996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31c8005200 0x7f31dc1412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:55:09.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.779+0000 7f31e177e640 1 -- 172.21.15.31:0/3945842996 >> 172.21.15.31:0/3945842996 conn(0x7f31dc0beb00 msgr2=0x7f31dc1423f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:55:09.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.783+0000 7f31e177e640 1 -- 172.21.15.31:0/3945842996 shutdown_connections 2023-11-27T17:55:09.789 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:55:09.783+0000 7f31e177e640 1 -- 172.21.15.31:0/3945842996 wait complete. 2023-11-27T17:55:09.805 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:55:09.805 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/tmp/tmp.jkmd5q6IvPxfstests-dev/local.config 2023-11-27T17:55:09.825 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.31:6789:/test export TEST_DIR=/tmp/tmp.DS4YhDEjUCtest export SCRATCH_DEV=172.21.15.31:6789:/scratch export SCRATCH_MNT=/tmp/tmp.6yd4yFmSwtscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBS12RlWiRfKBAARLbvO/ZW3NBv6Trdj6bXGw==" 2023-11-27T17:55:09.826 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:55:09.826 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/tmp/tmp.jkmd5q6IvPxfstests-dev/ceph.exclude 2023-11-27T17:55:09.892 DEBUG:teuthology.orchestra.run.smithi176:> (cd /tmp/tmp.jkmd5q6IvPxfstests-dev && exec sudo make) 2023-11-27T17:55:09.960 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize -cfi 2023-11-27T17:55:10.298 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: putting auxiliary files in '.'. 2023-11-27T17:55:10.298 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file './config.guess' 2023-11-27T17:55:10.307 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file './config.sub' 2023-11-27T17:55:10.327 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file './install-sh' 2023-11-27T17:55:10.338 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file './ltmain.sh' 2023-11-27T17:55:10.381 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-27T17:55:10.382 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-27T17:55:10.393 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-27T17:55:10.404 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-27T17:55:10.414 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-27T17:55:10.425 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-27T17:55:10.435 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-27T17:55:10.437 INFO:teuthology.orchestra.run.smithi176.stdout:cp include/install-sh . 2023-11-27T17:55:10.439 INFO:teuthology.orchestra.run.smithi176.stdout:aclocal -I m4 2023-11-27T17:55:11.574 INFO:teuthology.orchestra.run.smithi176.stdout:autoheader 2023-11-27T17:55:11.930 INFO:teuthology.orchestra.run.smithi176.stdout:autoconf 2023-11-27T17:55:12.333 INFO:teuthology.orchestra.run.smithi176.stdout:./configure \ 2023-11-27T17:55:12.333 INFO:teuthology.orchestra.run.smithi176.stdout: --libexecdir=/usr/lib \ 2023-11-27T17:55:12.334 INFO:teuthology.orchestra.run.smithi176.stdout: --exec_prefix=/var/lib 2023-11-27T17:55:12.861 INFO:teuthology.orchestra.run.smithi176.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-27T17:55:12.862 INFO:teuthology.orchestra.run.smithi176.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-27T17:55:12.909 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to print strings... printf 2023-11-27T17:55:12.910 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc... gcc 2023-11-27T17:55:13.141 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether the C compiler works... yes 2023-11-27T17:55:13.141 INFO:teuthology.orchestra.run.smithi176.stdout:checking for C compiler default output file name... a.out 2023-11-27T17:55:13.183 INFO:teuthology.orchestra.run.smithi176.stdout:checking for suffix of executables... 2023-11-27T17:55:13.259 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether we are cross compiling... no 2023-11-27T17:55:13.286 INFO:teuthology.orchestra.run.smithi176.stdout:checking for suffix of object files... o 2023-11-27T17:55:13.310 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether the compiler supports GNU C... yes 2023-11-27T17:55:13.334 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether gcc accepts -g... yes 2023-11-27T17:55:13.453 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc option to enable C11 features... none needed 2023-11-27T17:55:13.460 INFO:teuthology.orchestra.run.smithi176.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-11-27T17:55:13.465 INFO:teuthology.orchestra.run.smithi176.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-11-27T17:55:13.468 INFO:teuthology.orchestra.run.smithi176.stdout:checking for egrep... /usr/bin/grep -E 2023-11-27T17:55:13.470 INFO:teuthology.orchestra.run.smithi176.stdout:checking for fgrep... /usr/bin/grep -F 2023-11-27T17:55:13.478 INFO:teuthology.orchestra.run.smithi176.stdout:checking for ld used by gcc... /usr/bin/ld 2023-11-27T17:55:13.482 INFO:teuthology.orchestra.run.smithi176.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-11-27T17:55:13.493 INFO:teuthology.orchestra.run.smithi176.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-11-27T17:55:13.524 INFO:teuthology.orchestra.run.smithi176.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-11-27T17:55:13.524 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether ln -s works... yes 2023-11-27T17:55:13.538 INFO:teuthology.orchestra.run.smithi176.stdout:checking the maximum length of command line arguments... 1572864 2023-11-27T17:55:13.544 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-27T17:55:13.544 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-27T17:55:13.544 INFO:teuthology.orchestra.run.smithi176.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-11-27T17:55:13.544 INFO:teuthology.orchestra.run.smithi176.stdout:checking for objdump... objdump 2023-11-27T17:55:13.545 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to recognize dependent libraries... pass_all 2023-11-27T17:55:13.545 INFO:teuthology.orchestra.run.smithi176.stdout:checking for dlltool... no 2023-11-27T17:55:13.546 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-27T17:55:13.546 INFO:teuthology.orchestra.run.smithi176.stdout:checking for ar... ar 2023-11-27T17:55:13.584 INFO:teuthology.orchestra.run.smithi176.stdout:checking for archiver @FILE support... @ 2023-11-27T17:55:13.584 INFO:teuthology.orchestra.run.smithi176.stdout:checking for strip... strip 2023-11-27T17:55:13.584 INFO:teuthology.orchestra.run.smithi176.stdout:checking for ranlib... ranlib 2023-11-27T17:55:13.585 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gawk... gawk 2023-11-27T17:55:13.674 INFO:teuthology.orchestra.run.smithi176.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-11-27T17:55:13.677 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sysroot... no 2023-11-27T17:55:13.684 INFO:teuthology.orchestra.run.smithi176.stdout:checking for a working dd... /usr/bin/dd 2023-11-27T17:55:13.691 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-11-27T17:55:13.711 INFO:teuthology.orchestra.run.smithi176.stdout:checking for mt... mt 2023-11-27T17:55:13.731 INFO:teuthology.orchestra.run.smithi176.stdout:checking if mt is a manifest tool... no 2023-11-27T17:55:13.759 INFO:teuthology.orchestra.run.smithi176.stdout:checking for stdio.h... yes 2023-11-27T17:55:13.810 INFO:teuthology.orchestra.run.smithi176.stdout:checking for stdlib.h... yes 2023-11-27T17:55:13.845 INFO:teuthology.orchestra.run.smithi176.stdout:checking for string.h... yes 2023-11-27T17:55:13.892 INFO:teuthology.orchestra.run.smithi176.stdout:checking for inttypes.h... yes 2023-11-27T17:55:13.924 INFO:teuthology.orchestra.run.smithi176.stdout:checking for stdint.h... yes 2023-11-27T17:55:13.957 INFO:teuthology.orchestra.run.smithi176.stdout:checking for strings.h... yes 2023-11-27T17:55:13.992 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/stat.h... yes 2023-11-27T17:55:14.025 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/types.h... yes 2023-11-27T17:55:14.086 INFO:teuthology.orchestra.run.smithi176.stdout:checking for unistd.h... yes 2023-11-27T17:55:14.125 INFO:teuthology.orchestra.run.smithi176.stdout:checking for dlfcn.h... yes 2023-11-27T17:55:14.131 INFO:teuthology.orchestra.run.smithi176.stdout:checking for objdir... .libs 2023-11-27T17:55:14.243 INFO:teuthology.orchestra.run.smithi176.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-27T17:55:14.243 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-27T17:55:14.271 INFO:teuthology.orchestra.run.smithi176.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-27T17:55:14.509 INFO:teuthology.orchestra.run.smithi176.stdout:checking if gcc static flag -static works... yes 2023-11-27T17:55:14.550 INFO:teuthology.orchestra.run.smithi176.stdout:checking if gcc supports -c -o file.o... yes 2023-11-27T17:55:14.550 INFO:teuthology.orchestra.run.smithi176.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-27T17:55:14.564 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-27T17:55:14.601 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether -lc should be explicitly linked in... no 2023-11-27T17:55:14.703 INFO:teuthology.orchestra.run.smithi176.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-27T17:55:14.704 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to hardcode library paths into programs... immediate 2023-11-27T17:55:14.728 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether stripping libraries is possible... yes 2023-11-27T17:55:14.728 INFO:teuthology.orchestra.run.smithi176.stdout:checking if libtool supports shared libraries... yes 2023-11-27T17:55:14.728 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether to build shared libraries... yes 2023-11-27T17:55:14.728 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether to build static libraries... yes 2023-11-27T17:55:14.743 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc... (cached) gcc 2023-11-27T17:55:14.786 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-27T17:55:14.787 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-27T17:55:14.787 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-27T17:55:14.787 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gmake... /usr/bin/gmake 2023-11-27T17:55:14.787 INFO:teuthology.orchestra.run.smithi176.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-11-27T17:55:14.788 INFO:teuthology.orchestra.run.smithi176.stdout:checking for tar... /bin/tar 2023-11-27T17:55:14.788 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gzip... /bin/gzip 2023-11-27T17:55:14.814 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether gcc -MM is supported... yes 2023-11-27T17:55:14.814 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sort... /bin/sort 2023-11-27T17:55:14.814 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether ln -s works... yes 2023-11-27T17:55:14.814 INFO:teuthology.orchestra.run.smithi176.stdout:checking for rpm... no 2023-11-27T17:55:14.851 INFO:teuthology.orchestra.run.smithi176.stdout:checking for assert.h... yes 2023-11-27T17:55:14.893 INFO:teuthology.orchestra.run.smithi176.stdout:checking for bstring.h... no 2023-11-27T17:55:14.931 INFO:teuthology.orchestra.run.smithi176.stdout:checking for libgen.h... yes 2023-11-27T17:55:15.004 INFO:teuthology.orchestra.run.smithi176.stdout:checking for dirent.h... yes 2023-11-27T17:55:15.077 INFO:teuthology.orchestra.run.smithi176.stdout:checking for errno.h... yes 2023-11-27T17:55:15.115 INFO:teuthology.orchestra.run.smithi176.stdout:checking for malloc.h... yes 2023-11-27T17:55:15.157 INFO:teuthology.orchestra.run.smithi176.stdout:checking for uuid.h... no 2023-11-27T17:55:15.221 INFO:teuthology.orchestra.run.smithi176.stdout:checking for uuid/uuid.h... yes 2023-11-27T17:55:15.262 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/uuid.h... no 2023-11-27T17:55:15.302 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/file.h... yes 2023-11-27T17:55:15.341 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/fcntl.h... yes 2023-11-27T17:55:15.382 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/syssgi.h... no 2023-11-27T17:55:15.446 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/param.h... yes 2023-11-27T17:55:15.447 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/stat.h... (cached) yes 2023-11-27T17:55:15.485 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/statvfs.h... yes 2023-11-27T17:55:15.523 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/time.h... yes 2023-11-27T17:55:15.569 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/ioctl.h... yes 2023-11-27T17:55:15.610 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/wait.h... yes 2023-11-27T17:55:15.610 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/types.h... (cached) yes 2023-11-27T17:55:15.610 INFO:teuthology.orchestra.run.smithi176.stdout:checking for strings.h... (cached) yes 2023-11-27T17:55:15.648 INFO:teuthology.orchestra.run.smithi176.stdout:checking for err.h... yes 2023-11-27T17:55:15.686 INFO:teuthology.orchestra.run.smithi176.stdout:checking for linux/falloc.h... yes 2023-11-27T17:55:15.728 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/fs/xfs_fsops.h... no 2023-11-27T17:55:15.770 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/fs/xfs_itable.h... no 2023-11-27T17:55:15.820 INFO:teuthology.orchestra.run.smithi176.stdout:checking for xfs/platform_defs.h... no 2023-11-27T17:55:15.861 INFO:teuthology.orchestra.run.smithi176.stdout:checking for btrfs/ioctl.h... no 2023-11-27T17:55:15.903 INFO:teuthology.orchestra.run.smithi176.stdout:checking for cifs/ioctl.h... no 2023-11-27T17:55:15.954 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/mman.h... yes 2023-11-27T17:55:15.978 INFO:teuthology.orchestra.run.smithi176.stdout:checking for xfs/xfs_log_format.h... no 2023-11-27T17:55:16.036 INFO:teuthology.orchestra.run.smithi176.stdout:checking for uuid_compare... no 2023-11-27T17:55:16.084 INFO:teuthology.orchestra.run.smithi176.stdout:checking for uuid_compare in -luuid... yes 2023-11-27T17:55:16.260 INFO:teuthology.orchestra.run.smithi176.stdout:checking for xfs/xfs.h... yes 2023-11-27T17:55:16.283 INFO:teuthology.orchestra.run.smithi176.stdout:checking for xfs/libxfs.h... no 2023-11-27T17:55:16.331 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-11-27T17:55:16.364 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether xlog_assign_lsn is declared... no 2023-11-27T17:55:16.411 INFO:teuthology.orchestra.run.smithi176.stdout:checking for xfs/xqm.h... yes 2023-11-27T17:55:16.484 INFO:teuthology.orchestra.run.smithi176.stdout:checking xfsctl from xfs/xfs.h... ok 2023-11-27T17:55:16.525 INFO:teuthology.orchestra.run.smithi176.stdout:checking for xfs/handle.h... yes 2023-11-27T17:55:16.575 INFO:teuthology.orchestra.run.smithi176.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-11-27T17:55:16.616 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/acl.h... yes 2023-11-27T17:55:16.654 INFO:teuthology.orchestra.run.smithi176.stdout:checking for acl/libacl.h... yes 2023-11-27T17:55:16.704 INFO:teuthology.orchestra.run.smithi176.stdout:checking for acl_init in -lacl... yes 2023-11-27T17:55:16.745 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gdbm-ndbm.h... no 2023-11-27T17:55:16.786 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gdbm/ndbm.h... no 2023-11-27T17:55:16.828 INFO:teuthology.orchestra.run.smithi176.stdout:checking for ndbm.h... no 2023-11-27T17:55:16.869 INFO:teuthology.orchestra.run.smithi176.stdout:checking for libaio.h... yes 2023-11-27T17:55:16.946 INFO:teuthology.orchestra.run.smithi176.stdout:checking for liburing.h... yes 2023-11-27T17:55:16.993 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/capability.h... yes 2023-11-27T17:55:17.031 INFO:teuthology.orchestra.run.smithi176.stdout:checking for linux/fiemap.h... yes 2023-11-27T17:55:17.082 INFO:teuthology.orchestra.run.smithi176.stdout:checking for fallocate... yes 2023-11-27T17:55:17.135 INFO:teuthology.orchestra.run.smithi176.stdout:checking for open_by_handle_at... yes 2023-11-27T17:55:17.176 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/prctl.h... yes 2023-11-27T17:55:17.215 INFO:teuthology.orchestra.run.smithi176.stdout:checking for linux/fs.h... yes 2023-11-27T17:55:17.257 INFO:teuthology.orchestra.run.smithi176.stdout:checking for btrfsutil.h... no 2023-11-27T17:55:17.277 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:55:17.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:55:17.282 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:55:17.314 INFO:teuthology.orchestra.run.smithi176.stdout:checking for copy_file_range... yes 2023-11-27T17:55:17.371 INFO:teuthology.orchestra.run.smithi176.stdout:checking for SEEK_DATA... yes 2023-11-27T17:55:17.447 INFO:teuthology.orchestra.run.smithi176.stdout:checking for BMV_OF_SHARED... yes 2023-11-27T17:55:17.502 INFO:teuthology.orchestra.run.smithi176.stdout:checking for nftw... yes 2023-11-27T17:55:17.557 INFO:teuthology.orchestra.run.smithi176.stdout:checking for RLIMIT_NOFILE... yes 2023-11-27T17:55:17.593 INFO:teuthology.orchestra.run.smithi176.stdout:checking for FIEXCHANGE_RANGE... no 2023-11-27T17:55:17.645 INFO:teuthology.orchestra.run.smithi176.stdout:checking for renameat2... yes 2023-11-27T17:55:17.697 INFO:teuthology.orchestra.run.smithi176.stdout:checking for reallocarray... yes 2023-11-27T17:55:17.748 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct mount_attr... yes 2023-11-27T17:55:17.815 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct btrfs_qgroup_limit... yes 2023-11-27T17:55:17.869 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-11-27T17:55:17.922 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-11-27T17:55:17.975 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-11-27T17:55:18.030 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-11-27T17:55:18.082 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-11-27T17:55:18.134 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-11-27T17:55:18.174 INFO:teuthology.orchestra.run.smithi176.stdout:checking for linux/btrfs.h... yes 2023-11-27T17:55:18.215 INFO:teuthology.orchestra.run.smithi176.stdout:checking for linux/btrfs_tree.h... yes 2023-11-27T17:55:18.243 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-11-27T17:55:18.270 INFO:teuthology.orchestra.run.smithi176.stdout:configure: creating ./config.status 2023-11-27T17:55:19.111 INFO:teuthology.orchestra.run.smithi176.stdout:config.status: creating include/builddefs 2023-11-27T17:55:19.139 INFO:teuthology.orchestra.run.smithi176.stdout:config.status: creating include/config.h 2023-11-27T17:55:19.161 INFO:teuthology.orchestra.run.smithi176.stdout:config.status: executing libtool commands 2023-11-27T17:55:19.230 INFO:teuthology.orchestra.run.smithi176.stdout:Building include 2023-11-27T17:55:19.237 INFO:teuthology.orchestra.run.smithi176.stdout:Building lib 2023-11-27T17:55:19.242 INFO:teuthology.orchestra.run.smithi176.stdout: [LTDEP] 2023-11-27T17:55:19.443 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dataascii.lo 2023-11-27T17:55:19.590 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] databin.lo 2023-11-27T17:55:19.776 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] datapid.lo 2023-11-27T17:55:19.916 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] file_lock.lo 2023-11-27T17:55:20.107 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] forker.lo 2023-11-27T17:55:20.282 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] pattern.lo 2023-11-27T17:55:20.431 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] open_flags.lo 2023-11-27T17:55:20.605 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] random_range.lo 2023-11-27T17:55:20.863 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] string_to_tokens.lo 2023-11-27T17:55:20.992 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] str_to_bytes.lo 2023-11-27T17:55:21.161 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] tlibio.lo 2023-11-27T17:55:21.446 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] write_log.lo 2023-11-27T17:55:21.533 INFO:teuthology.orchestra.run.smithi176.stderr:write_log.c: In function 'wlog_record_write': 2023-11-27T17:55:21.533 INFO:teuthology.orchestra.run.smithi176.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:21.533 INFO:teuthology.orchestra.run.smithi176.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-11-27T17:55:21.533 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:55:21.533 INFO:teuthology.orchestra.run.smithi176.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:21.533 INFO:teuthology.orchestra.run.smithi176.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-11-27T17:55:21.533 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:55:21.724 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] random.lo 2023-11-27T17:55:21.852 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] 2023-11-27T17:55:21.999 INFO:teuthology.orchestra.run.smithi176.stdout:Building ltp 2023-11-27T17:55:22.004 INFO:teuthology.orchestra.run.smithi176.stdout: [DEP] 2023-11-27T17:55:22.199 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] doio 2023-11-27T17:55:22.934 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fsstress 2023-11-27T17:55:24.498 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fsx 2023-11-27T17:55:25.324 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] growfiles 2023-11-27T17:55:25.910 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] iogen 2023-11-27T17:55:26.077 INFO:teuthology.orchestra.run.smithi176.stderr:iogen.c: In function 'main': 2023-11-27T17:55:26.078 INFO:teuthology.orchestra.run.smithi176.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:26.078 INFO:teuthology.orchestra.run.smithi176.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-11-27T17:55:26.078 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:55:26.080 INFO:teuthology.orchestra.run.smithi176.stderr:iogen.c: In function 'parse_cmdline': 2023-11-27T17:55:26.081 INFO:teuthology.orchestra.run.smithi176.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:26.081 INFO:teuthology.orchestra.run.smithi176.stderr: 1535 | getcwd(fptr->f_path, 2023-11-27T17:55:26.081 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:55:26.081 INFO:teuthology.orchestra.run.smithi176.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-11-27T17:55:26.081 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:55:26.362 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-stress 2023-11-27T17:55:26.523 INFO:teuthology.orchestra.run.smithi176.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-11-27T17:55:26.524 INFO:teuthology.orchestra.run.smithi176.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:26.524 INFO:teuthology.orchestra.run.smithi176.stderr: 1013 | ftruncate(fd, total_ram); 2023-11-27T17:55:26.524 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:55:26.838 INFO:teuthology.orchestra.run.smithi176.stdout:Building src 2023-11-27T17:55:26.846 INFO:teuthology.orchestra.run.smithi176.stdout: [DEP] 2023-11-27T17:55:29.232 INFO:teuthology.orchestra.run.smithi176.stdout: [DEP] 2023-11-27T17:55:29.279 INFO:teuthology.orchestra.run.smithi176.stdout: [DEP] 2023-11-27T17:55:29.293 INFO:teuthology.orchestra.run.smithi176.stdout: [DEP] 2023-11-27T17:55:29.623 INFO:teuthology.orchestra.run.smithi176.stdout: [DEP] 2023-11-27T17:55:29.659 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dirstress 2023-11-27T17:55:29.952 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fill 2023-11-27T17:55:30.147 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fill2 2023-11-27T17:55:30.424 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] getpagesize 2023-11-27T17:55:30.599 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] holes 2023-11-27T17:55:30.841 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] lstat64 2023-11-27T17:55:31.069 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] nametest 2023-11-27T17:55:31.234 INFO:teuthology.orchestra.run.smithi176.stderr:nametest.c: In function 'main': 2023-11-27T17:55:31.234 INFO:teuthology.orchestra.run.smithi176.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:31.234 INFO:teuthology.orchestra.run.smithi176.stderr: 236 | write(1, "\n", 1); 2023-11-27T17:55:31.234 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-27T17:55:31.235 INFO:teuthology.orchestra.run.smithi176.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:31.235 INFO:teuthology.orchestra.run.smithi176.stderr: 238 | write(1, ".", 1); 2023-11-27T17:55:31.235 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-27T17:55:31.235 INFO:teuthology.orchestra.run.smithi176.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:31.235 INFO:teuthology.orchestra.run.smithi176.stderr: 288 | write(1, ".", 1); 2023-11-27T17:55:31.235 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-27T17:55:31.358 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] permname 2023-11-27T17:55:31.607 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] randholes 2023-11-27T17:55:31.908 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] runas 2023-11-27T17:55:32.129 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] truncfile 2023-11-27T17:55:32.355 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] usemem 2023-11-27T17:55:32.551 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] mmapcat 2023-11-27T17:55:32.698 INFO:teuthology.orchestra.run.smithi176.stderr:mmapcat.c: In function 'main': 2023-11-27T17:55:32.699 INFO:teuthology.orchestra.run.smithi176.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:32.699 INFO:teuthology.orchestra.run.smithi176.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-11-27T17:55:32.699 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:55:32.742 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] append_reader 2023-11-27T17:55:32.938 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] append_writer 2023-11-27T17:55:33.134 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dirperf 2023-11-27T17:55:33.400 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] metaperf 2023-11-27T17:55:33.556 INFO:teuthology.orchestra.run.smithi176.stderr:metaperf.c: In function 'crfiles': 2023-11-27T17:55:33.556 INFO:teuthology.orchestra.run.smithi176.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:33.556 INFO:teuthology.orchestra.run.smithi176.stderr: 166 | write(fd, buf, fsize); 2023-11-27T17:55:33.556 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:55:33.556 INFO:teuthology.orchestra.run.smithi176.stderr:metaperf.c: In function 't_linkun': 2023-11-27T17:55:33.557 INFO:teuthology.orchestra.run.smithi176.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:33.557 INFO:teuthology.orchestra.run.smithi176.stderr: 454 | link("a", *fnp); 2023-11-27T17:55:33.557 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~ 2023-11-27T17:55:33.558 INFO:teuthology.orchestra.run.smithi176.stderr:metaperf.c: In function 't_chown': 2023-11-27T17:55:33.558 INFO:teuthology.orchestra.run.smithi176.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:33.558 INFO:teuthology.orchestra.run.smithi176.stderr: 404 | chown(*fnp, 2, -1); 2023-11-27T17:55:33.558 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-27T17:55:33.558 INFO:teuthology.orchestra.run.smithi176.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:33.558 INFO:teuthology.orchestra.run.smithi176.stderr: 406 | chown(*fnp, 1, -1); 2023-11-27T17:55:33.558 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-27T17:55:33.558 INFO:teuthology.orchestra.run.smithi176.stderr:metaperf.c: In function 'i_chown': 2023-11-27T17:55:33.558 INFO:teuthology.orchestra.run.smithi176.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:33.558 INFO:teuthology.orchestra.run.smithi176.stderr: 291 | chown(*fnp, 1, -1); 2023-11-27T17:55:33.558 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-27T17:55:33.558 INFO:teuthology.orchestra.run.smithi176.stderr:metaperf.c: In function 'main': 2023-11-27T17:55:33.559 INFO:teuthology.orchestra.run.smithi176.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:33.559 INFO:teuthology.orchestra.run.smithi176.stderr: 152 | chdir(".."); 2023-11-27T17:55:33.559 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~ 2023-11-27T17:55:33.731 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] devzero 2023-11-27T17:55:33.954 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] feature 2023-11-27T17:55:34.226 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] alloc 2023-11-27T17:55:34.390 INFO:teuthology.orchestra.run.smithi176.stderr:alloc.c: In function 'main': 2023-11-27T17:55:34.390 INFO:teuthology.orchestra.run.smithi176.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:34.391 INFO:teuthology.orchestra.run.smithi176.stderr: 247 | mkstemp(tmpfile); 2023-11-27T17:55:34.391 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-27T17:55:34.487 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fault 2023-11-27T17:55:34.694 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fstest 2023-11-27T17:55:34.985 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_access_root 2023-11-27T17:55:35.133 INFO:teuthology.orchestra.run.smithi176.stderr:t_access_root.c: In function 'main': 2023-11-27T17:55:35.133 INFO:teuthology.orchestra.run.smithi176.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:55:35.133 INFO:teuthology.orchestra.run.smithi176.stderr: 55 | system(cmd); 2023-11-27T17:55:35.133 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~ 2023-11-27T17:55:35.183 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] godown 2023-11-27T17:55:35.402 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] resvtest 2023-11-27T17:55:35.636 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] writemod 2023-11-27T17:55:35.825 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] writev_on_pagefault 2023-11-27T17:55:36.029 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] makeextents 2023-11-27T17:55:36.254 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] itrash 2023-11-27T17:55:36.449 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] rename 2023-11-27T17:55:36.627 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] multi_open_unlink 2023-11-27T17:55:36.839 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] unwritten_sync 2023-11-27T17:55:37.066 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] genhashnames 2023-11-27T17:55:37.296 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_holes 2023-11-27T17:55:37.487 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_mmap_writev 2023-11-27T17:55:37.679 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_truncate_cmtime 2023-11-27T17:55:37.882 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dirhash_collide 2023-11-27T17:55:38.108 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_rename_overwrite 2023-11-27T17:56:56.961 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:56:56.970 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] holetest 2023-11-27T17:56:56.970 INFO:teuthology.orchestra.run.smithi176.stderr:holetest.c: In function 'pt_write_marker': 2023-11-27T17:56:56.970 INFO:teuthology.orchestra.run.smithi176.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:56.971 INFO:teuthology.orchestra.run.smithi176.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-11-27T17:56:56.971 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:56.971 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_truncate_self 2023-11-27T17:56:56.971 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] af_unix 2023-11-27T17:56:56.971 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_mmap_stale_pmd 2023-11-27T17:56:56.972 INFO:teuthology.orchestra.run.smithi176.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-11-27T17:56:56.972 INFO:teuthology.orchestra.run.smithi176.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:56.972 INFO:teuthology.orchestra.run.smithi176.stderr: 42 | ftruncate(fd, 0); 2023-11-27T17:56:56.972 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-27T17:56:56.972 INFO:teuthology.orchestra.run.smithi176.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:56.972 INFO:teuthology.orchestra.run.smithi176.stderr: 43 | ftruncate(fd, MiB(4)); 2023-11-27T17:56:56.972 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:56.972 INFO:teuthology.orchestra.run.smithi176.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:56.972 INFO:teuthology.orchestra.run.smithi176.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-11-27T17:56:56.972 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:56.973 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_mmap_cow_race 2023-11-27T17:56:56.973 INFO:teuthology.orchestra.run.smithi176.stderr:t_mmap_cow_race.c: In function 'main': 2023-11-27T17:56:56.973 INFO:teuthology.orchestra.run.smithi176.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:56.973 INFO:teuthology.orchestra.run.smithi176.stderr: 61 | ftruncate(fd, 0); 2023-11-27T17:56:56.973 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-27T17:56:56.973 INFO:teuthology.orchestra.run.smithi176.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:56.974 INFO:teuthology.orchestra.run.smithi176.stderr: 62 | ftruncate(fd, MiB(2)); 2023-11-27T17:56:56.974 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.014 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_mmap_fallocate 2023-11-27T17:56:57.014 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fsync-err 2023-11-27T17:56:57.014 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_mmap_write_ro 2023-11-27T17:56:57.014 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_ext4_dax_journal_corruption 2023-11-27T17:56:57.019 INFO:teuthology.orchestra.run.smithi176.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-11-27T17:56:57.019 INFO:teuthology.orchestra.run.smithi176.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.019 INFO:teuthology.orchestra.run.smithi176.stderr: 61 | ftruncate(fd, 0); 2023-11-27T17:56:57.019 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.035 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_ext4_dax_inline_corruption 2023-11-27T17:56:57.035 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_ofd_locks 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_mmap_collision 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] mmap-write-concurrent 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_get_file_time 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_create_short_dirs 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_create_long_dirs 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_enospc 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_mmap_writev_overlap 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] checkpoint_journal 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] mmap-rw-fault 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] allocstale 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_mmap_cow_memory_failure 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fake-dump-rootino 2023-11-27T17:56:57.036 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dio-buf-fault 2023-11-27T17:56:57.037 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] rewinddir-test 2023-11-27T17:56:57.037 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfsctl 2023-11-27T17:56:57.037 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bstat 2023-11-27T17:56:57.037 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_mtab 2023-11-27T17:56:57.037 INFO:teuthology.orchestra.run.smithi176.stderr:t_mtab.c: In function 'update_mtab': 2023-11-27T17:56:57.037 INFO:teuthology.orchestra.run.smithi176.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.037 INFO:teuthology.orchestra.run.smithi176.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-11-27T17:56:57.038 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.038 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] getdevicesize 2023-11-27T17:56:57.038 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] preallo_rw_pattern_reader 2023-11-27T17:56:57.039 INFO:teuthology.orchestra.run.smithi176.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-11-27T17:56:57.039 INFO:teuthology.orchestra.run.smithi176.stderr:iopat.c: In function 'main': 2023-11-27T17:56:57.039 INFO:teuthology.orchestra.run.smithi176.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.039 INFO:teuthology.orchestra.run.smithi176.stderr: 38 | read(fd, &x, 1048576); 2023-11-27T17:56:57.039 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.039 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] preallo_rw_pattern_writer 2023-11-27T17:56:57.039 INFO:teuthology.orchestra.run.smithi176.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-11-27T17:56:57.040 INFO:teuthology.orchestra.run.smithi176.stderr:iopat.c: In function 'main': 2023-11-27T17:56:57.040 INFO:teuthology.orchestra.run.smithi176.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.040 INFO:teuthology.orchestra.run.smithi176.stderr: 34 | write(fd, &x, 1048576); 2023-11-27T17:56:57.040 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:56:57.041 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] ftrunc 2023-11-27T17:56:57.041 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] trunc 2023-11-27T17:56:57.041 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fs_perms 2023-11-27T17:56:57.042 INFO:teuthology.orchestra.run.smithi176.stderr:fs_perms.c: In function 'main': 2023-11-27T17:56:57.042 INFO:teuthology.orchestra.run.smithi176.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.043 INFO:teuthology.orchestra.run.smithi176.stderr: 54 | system("rm -f test.file"); 2023-11-27T17:56:57.043 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.043 INFO:teuthology.orchestra.run.smithi176.stderr:fs_perms.c: In function 'testsetup': 2023-11-27T17:56:57.043 INFO:teuthology.orchestra.run.smithi176.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.043 INFO:teuthology.orchestra.run.smithi176.stderr: 67 | system("cp testx.file test.file"); 2023-11-27T17:56:57.043 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.043 INFO:teuthology.orchestra.run.smithi176.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.043 INFO:teuthology.orchestra.run.smithi176.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-11-27T17:56:57.043 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.043 INFO:teuthology.orchestra.run.smithi176.stderr:fs_perms.c: In function 'testfperm': 2023-11-27T17:56:57.043 INFO:teuthology.orchestra.run.smithi176.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.044 INFO:teuthology.orchestra.run.smithi176.stderr: 123 | seteuid(0); 2023-11-27T17:56:57.044 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~ 2023-11-27T17:56:57.044 INFO:teuthology.orchestra.run.smithi176.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.044 INFO:teuthology.orchestra.run.smithi176.stderr: 124 | setegid(0); 2023-11-27T17:56:57.044 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~ 2023-11-27T17:56:57.044 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] testx 2023-11-27T17:56:57.045 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] looptest 2023-11-27T17:56:57.045 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] locktest 2023-11-27T17:56:57.045 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] unwritten_mmap 2023-11-27T17:56:57.045 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bulkstat_unlink_test 2023-11-27T17:56:57.045 INFO:teuthology.orchestra.run.smithi176.stderr:bulkstat_unlink_test.c: In function 'main': 2023-11-27T17:56:57.045 INFO:teuthology.orchestra.run.smithi176.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.045 INFO:teuthology.orchestra.run.smithi176.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-11-27T17:56:57.045 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.046 INFO:teuthology.orchestra.run.smithi176.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.046 INFO:teuthology.orchestra.run.smithi176.stderr: 178 | system(fname); 2023-11-27T17:56:57.046 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~ 2023-11-27T17:56:57.046 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] deduperace 2023-11-27T17:56:57.046 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bulkstat_unlink_test_modified 2023-11-27T17:56:57.046 INFO:teuthology.orchestra.run.smithi176.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-11-27T17:56:57.047 INFO:teuthology.orchestra.run.smithi176.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.047 INFO:teuthology.orchestra.run.smithi176.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-11-27T17:56:57.047 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.047 INFO:teuthology.orchestra.run.smithi176.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.047 INFO:teuthology.orchestra.run.smithi176.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-11-27T17:56:57.047 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.047 INFO:teuthology.orchestra.run.smithi176.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.047 INFO:teuthology.orchestra.run.smithi176.stderr: 185 | system(fname); 2023-11-27T17:56:57.047 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~ 2023-11-27T17:56:57.048 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_dir_offset 2023-11-27T17:56:57.048 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_futimens 2023-11-27T17:56:57.048 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_immutable 2023-11-27T17:56:57.054 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c: In function 'create_test_area': 2023-11-27T17:56:57.054 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.054 INFO:teuthology.orchestra.run.smithi176.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-11-27T17:56:57.054 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.054 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.054 INFO:teuthology.orchestra.run.smithi176.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-11-27T17:56:57.054 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.054 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c: In function 'remove_test_area': 2023-11-27T17:56:57.054 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.054 INFO:teuthology.orchestra.run.smithi176.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-11-27T17:56:57.054 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.054 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.055 INFO:teuthology.orchestra.run.smithi176.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c: In function 'check_test_area': 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.056 INFO:teuthology.orchestra.run.smithi176.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-11-27T17:56:57.057 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c: In function 'test_immutable': 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr: 408 | chown(path, 0, 0); 2023-11-27T17:56:57.058 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.059 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.059 INFO:teuthology.orchestra.run.smithi176.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-11-27T17:56:57.059 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.059 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.059 INFO:teuthology.orchestra.run.smithi176.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-11-27T17:56:57.059 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.059 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.059 INFO:teuthology.orchestra.run.smithi176.stderr: 553 | chown(path, 0, 0); 2023-11-27T17:56:57.059 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.059 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.059 INFO:teuthology.orchestra.run.smithi176.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-11-27T17:56:57.059 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.060 INFO:teuthology.orchestra.run.smithi176.stderr: 653 | chown(path, 0, 0); 2023-11-27T17:56:57.061 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.061 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.061 INFO:teuthology.orchestra.run.smithi176.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-11-27T17:56:57.061 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.061 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.061 INFO:teuthology.orchestra.run.smithi176.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-11-27T17:56:57.061 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.061 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.061 INFO:teuthology.orchestra.run.smithi176.stderr: 705 | chown(path, 0, 0); 2023-11-27T17:56:57.061 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.061 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c: In function 'test_append': 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr: 1051 | chown(path, 0, 0); 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.062 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.063 INFO:teuthology.orchestra.run.smithi176.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-11-27T17:56:57.063 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.063 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.063 INFO:teuthology.orchestra.run.smithi176.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-11-27T17:56:57.063 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.063 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.063 INFO:teuthology.orchestra.run.smithi176.stderr: 1516 | chown(path, 0, 0); 2023-11-27T17:56:57.063 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.063 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.063 INFO:teuthology.orchestra.run.smithi176.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-11-27T17:56:57.063 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.063 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.064 INFO:teuthology.orchestra.run.smithi176.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-11-27T17:56:57.065 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.065 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.065 INFO:teuthology.orchestra.run.smithi176.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-11-27T17:56:57.065 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.065 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.065 INFO:teuthology.orchestra.run.smithi176.stderr: 1618 | chown(path, 0, 0); 2023-11-27T17:56:57.065 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.065 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.065 INFO:teuthology.orchestra.run.smithi176.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-11-27T17:56:57.065 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.065 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.066 INFO:teuthology.orchestra.run.smithi176.stderr: 1644 | chown(path, 0, 0); 2023-11-27T17:56:57.066 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.066 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.066 INFO:teuthology.orchestra.run.smithi176.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-11-27T17:56:57.066 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.066 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.066 INFO:teuthology.orchestra.run.smithi176.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-11-27T17:56:57.066 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.066 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.066 INFO:teuthology.orchestra.run.smithi176.stderr: 1692 | chown(path, 0, 0); 2023-11-27T17:56:57.066 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.066 INFO:teuthology.orchestra.run.smithi176.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.067 INFO:teuthology.orchestra.run.smithi176.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-11-27T17:56:57.067 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.067 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] stale_handle 2023-11-27T17:56:57.067 INFO:teuthology.orchestra.run.smithi176.stderr:stale_handle.c: In function 'main': 2023-11-27T17:56:57.067 INFO:teuthology.orchestra.run.smithi176.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.067 INFO:teuthology.orchestra.run.smithi176.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-11-27T17:56:57.068 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.068 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] pwrite_mmap_blocked 2023-11-27T17:56:57.068 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_dir_offset2 2023-11-27T17:56:57.068 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] seek_sanity_test 2023-11-27T17:56:57.070 INFO:teuthology.orchestra.run.smithi176.stderr:seek_sanity_test.c: In function 'test18': 2023-11-27T17:56:57.070 INFO:teuthology.orchestra.run.smithi176.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.070 INFO:teuthology.orchestra.run.smithi176.stderr: 460 | ftruncate(fd, 0); 2023-11-27T17:56:57.070 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.070 INFO:teuthology.orchestra.run.smithi176.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-11-27T17:56:57.070 INFO:teuthology.orchestra.run.smithi176.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.070 INFO:teuthology.orchestra.run.smithi176.stderr: 1207 | ftruncate(fd, 0); 2023-11-27T17:56:57.070 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.070 INFO:teuthology.orchestra.run.smithi176.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.070 INFO:teuthology.orchestra.run.smithi176.stderr: 1256 | ftruncate(fd, 0); 2023-11-27T17:56:57.070 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.071 INFO:teuthology.orchestra.run.smithi176.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-11-27T17:56:57.071 INFO:teuthology.orchestra.run.smithi176.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.071 INFO:teuthology.orchestra.run.smithi176.stderr: 88 | ftruncate(fd, 0); 2023-11-27T17:56:57.071 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.071 INFO:teuthology.orchestra.run.smithi176.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.071 INFO:teuthology.orchestra.run.smithi176.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-11-27T17:56:57.071 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.071 INFO:teuthology.orchestra.run.smithi176.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.071 INFO:teuthology.orchestra.run.smithi176.stderr: 98 | ftruncate(fd, 0); 2023-11-27T17:56:57.071 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.071 INFO:teuthology.orchestra.run.smithi176.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.072 INFO:teuthology.orchestra.run.smithi176.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-11-27T17:56:57.072 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.072 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:56:57.073 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] seek_copy_test 2023-11-27T17:56:57.073 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_readdir_1 2023-11-27T17:56:57.073 INFO:teuthology.orchestra.run.smithi176.stderr:t_readdir_1.c: In function 'main': 2023-11-27T17:56:57.073 INFO:teuthology.orchestra.run.smithi176.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.073 INFO:teuthology.orchestra.run.smithi176.stderr: 30 | read(fd, buf, 100); 2023-11-27T17:56:57.074 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.074 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_readdir_2 2023-11-27T17:56:57.074 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fsync-tester 2023-11-27T17:56:57.075 INFO:teuthology.orchestra.run.smithi176.stderr:fsync-tester.c: In function 'main': 2023-11-27T17:56:57.075 INFO:teuthology.orchestra.run.smithi176.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.075 INFO:teuthology.orchestra.run.smithi176.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-11-27T17:56:57.075 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.075 INFO:teuthology.orchestra.run.smithi176.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.075 INFO:teuthology.orchestra.run.smithi176.stderr: 541 | system("reboot -fn"); 2023-11-27T17:56:57.075 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.075 INFO:teuthology.orchestra.run.smithi176.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-11-27T17:56:57.075 INFO:teuthology.orchestra.run.smithi176.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.075 INFO:teuthology.orchestra.run.smithi176.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-11-27T17:56:57.076 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.076 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] nsexec 2023-11-27T17:56:57.076 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] cloner 2023-11-27T17:56:57.076 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] renameat2 2023-11-27T17:56:57.076 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_getcwd 2023-11-27T17:56:57.077 INFO:teuthology.orchestra.run.smithi176.stderr:t_getcwd.c: In function 'test_getcwd': 2023-11-27T17:56:57.077 INFO:teuthology.orchestra.run.smithi176.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.077 INFO:teuthology.orchestra.run.smithi176.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-11-27T17:56:57.077 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.078 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] e4compact 2023-11-27T17:56:57.078 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] test-nextquota 2023-11-27T17:56:57.078 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] punch-alternating 2023-11-27T17:56:57.078 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] attr-list-by-handle-cursor-test 2023-11-27T17:56:57.078 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] listxattr 2023-11-27T17:56:57.078 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dio-interleaved 2023-11-27T17:56:57.078 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_dir_type 2023-11-27T17:56:57.078 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dio-invalidate-cache 2023-11-27T17:56:57.079 INFO:teuthology.orchestra.run.smithi176.stderr:dio-invalidate-cache.c: In function 'main': 2023-11-27T17:56:57.079 INFO:teuthology.orchestra.run.smithi176.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.104 INFO:teuthology.orchestra.run.smithi176.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-11-27T17:56:57.104 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.106 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] stat_test 2023-11-27T17:56:57.106 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_encrypted_d_revalidate 2023-11-27T17:56:57.106 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] attr_replace_test 2023-11-27T17:56:57.106 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] swapon 2023-11-27T17:56:57.106 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] mkswap 2023-11-27T17:56:57.106 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_attr_corruption 2023-11-27T17:56:57.106 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_open_tmpfiles 2023-11-27T17:56:57.107 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fscrypt-crypt-util 2023-11-27T17:56:57.107 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bulkstat_null_ocount 2023-11-27T17:56:57.107 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] splice-test 2023-11-27T17:56:57.107 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] chprojid_fail 2023-11-27T17:56:57.107 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] detached_mounts_propagation 2023-11-27T17:56:57.107 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] ext4_resize 2023-11-27T17:56:57.107 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_readdir_3 2023-11-27T17:56:57.107 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] splice2pipe 2023-11-27T17:56:57.107 INFO:teuthology.orchestra.run.smithi176.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-11-27T17:56:57.107 INFO:teuthology.orchestra.run.smithi176.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.108 INFO:teuthology.orchestra.run.smithi176.stderr: 57 | write(p[1], buffer, n); 2023-11-27T17:56:57.108 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.108 INFO:teuthology.orchestra.run.smithi176.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.108 INFO:teuthology.orchestra.run.smithi176.stderr: 65 | read(p[0], buffer, n); 2023-11-27T17:56:57.136 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.139 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] uuid_ioctl 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fiemap-tester 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_stripealign 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] open_by_handle 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] t_mmap_dio 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] uring_read_fault 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfsfind 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fssum 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout:Building log-writes 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] replay-log 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout:Building perf 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout:Building aio-dio-regress 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aiocp 2023-11-27T17:56:57.140 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-dio-append-write-fallocate-race 2023-11-27T17:56:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-dio-append-write-read-race 2023-11-27T17:56:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-dio-cow-race 2023-11-27T17:56:57.141 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-dio-cycle-write 2023-11-27T17:56:57.141 INFO:teuthology.orchestra.run.smithi176.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-11-27T17:56:57.141 INFO:teuthology.orchestra.run.smithi176.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.141 INFO:teuthology.orchestra.run.smithi176.stderr: 83 | ftruncate(fd, buf_size); 2023-11-27T17:56:57.141 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-dio-eof-race 2023-11-27T17:56:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-dio-extend-stat 2023-11-27T17:56:57.144 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-dio-fcntl-race 2023-11-27T17:56:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-dio-hole-filling-race 2023-11-27T17:56:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-dio-invalidate-failure 2023-11-27T17:56:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-dio-invalidate-readahead 2023-11-27T17:56:57.145 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aiodio_sparse2 2023-11-27T17:56:57.145 INFO:teuthology.orchestra.run.smithi176.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-11-27T17:56:57.145 INFO:teuthology.orchestra.run.smithi176.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.145 INFO:teuthology.orchestra.run.smithi176.stderr: 111 | ftruncate(fd, filesize); 2023-11-27T17:56:57.145 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.146 INFO:teuthology.orchestra.run.smithi176.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-11-27T17:56:57.146 INFO:teuthology.orchestra.run.smithi176.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-27T17:56:57.146 INFO:teuthology.orchestra.run.smithi176.stderr: 274 | ftruncate(fd, size); 2023-11-27T17:56:57.146 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-11-27T17:56:57.151 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-dio-subblock-eof-read 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-dio-write-verify 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] aio-last-ref-held-by-io 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout:Building vfs 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] vfstest 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] mount-idmapped 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout:Building m4 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout:Building common 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout:Building tests 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout:Building btrfs 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/btrfs/group.list 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout:Building ceph 2023-11-27T17:56:57.152 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/ceph/group.list 2023-11-27T17:56:57.153 INFO:teuthology.orchestra.run.smithi176.stdout:Building cifs 2023-11-27T17:56:57.259 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/cifs/group.list 2023-11-27T17:56:57.259 INFO:teuthology.orchestra.run.smithi176.stdout:Building ext4 2023-11-27T17:56:57.259 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/ext4/group.list 2023-11-27T17:56:57.259 INFO:teuthology.orchestra.run.smithi176.stdout:Building f2fs 2023-11-27T17:56:57.259 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/f2fs/group.list 2023-11-27T17:56:57.259 INFO:teuthology.orchestra.run.smithi176.stdout:Building generic 2023-11-27T17:56:57.260 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/generic/group.list 2023-11-27T17:56:57.296 INFO:teuthology.orchestra.run.smithi176.stdout:Building nfs 2023-11-27T17:56:57.296 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/nfs/group.list 2023-11-27T17:56:57.296 INFO:teuthology.orchestra.run.smithi176.stdout:Building ocfs2 2023-11-27T17:56:57.296 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/ocfs2/group.list 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout:Building overlay 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/overlay/group.list 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout:Building perf 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/perf/group.list 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout:Building selftest 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/selftest/group.list 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout:Building shared 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/shared/group.list 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout:Building tmpfs 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/tmpfs/group.list 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout:Building udf 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/udf/group.list 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout:Building xfs 2023-11-27T17:56:57.297 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/xfs/group.list 2023-11-27T17:56:57.298 DEBUG:teuthology.orchestra.run.smithi176:> (cd /tmp/tmp.jkmd5q6IvPxfstests-dev && exec sudo make install) 2023-11-27T17:56:57.346 INFO:teuthology.orchestra.run.smithi176.stdout:Building include 2023-11-27T17:56:57.354 INFO:teuthology.orchestra.run.smithi176.stdout:Building lib 2023-11-27T17:56:57.361 INFO:teuthology.orchestra.run.smithi176.stdout:Building ltp 2023-11-27T17:56:57.369 INFO:teuthology.orchestra.run.smithi176.stdout:Building src 2023-11-27T17:56:57.425 INFO:teuthology.orchestra.run.smithi176.stdout:Building log-writes 2023-11-27T17:56:57.431 INFO:teuthology.orchestra.run.smithi176.stdout:Building perf 2023-11-27T17:56:57.438 INFO:teuthology.orchestra.run.smithi176.stdout:Building aio-dio-regress 2023-11-27T17:56:57.445 INFO:teuthology.orchestra.run.smithi176.stdout:Building vfs 2023-11-27T17:56:57.452 INFO:teuthology.orchestra.run.smithi176.stdout:Building m4 2023-11-27T17:56:57.458 INFO:teuthology.orchestra.run.smithi176.stdout:Building common 2023-11-27T17:56:57.465 INFO:teuthology.orchestra.run.smithi176.stdout:Building tests 2023-11-27T17:56:57.474 INFO:teuthology.orchestra.run.smithi176.stdout:Building btrfs 2023-11-27T17:56:57.483 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/btrfs/group.list 2023-11-27T17:56:57.613 INFO:teuthology.orchestra.run.smithi176.stdout:Building ceph 2023-11-27T17:56:57.622 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/ceph/group.list 2023-11-27T17:56:57.654 INFO:teuthology.orchestra.run.smithi176.stdout:Building cifs 2023-11-27T17:56:57.663 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/cifs/group.list 2023-11-27T17:56:57.691 INFO:teuthology.orchestra.run.smithi176.stdout:Building ext4 2023-11-27T17:56:57.700 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/ext4/group.list 2023-11-27T17:56:57.784 INFO:teuthology.orchestra.run.smithi176.stdout:Building f2fs 2023-11-27T17:56:57.792 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/f2fs/group.list 2023-11-27T17:56:57.831 INFO:teuthology.orchestra.run.smithi176.stdout:Building generic 2023-11-27T17:56:57.842 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/generic/group.list 2023-11-27T17:56:58.050 INFO:teuthology.orchestra.run.smithi176.stdout:Building nfs 2023-11-27T17:56:58.059 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/nfs/group.list 2023-11-27T17:56:58.091 INFO:teuthology.orchestra.run.smithi176.stdout:Building ocfs2 2023-11-27T17:56:58.100 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/ocfs2/group.list 2023-11-27T17:56:58.131 INFO:teuthology.orchestra.run.smithi176.stdout:Building overlay 2023-11-27T17:56:58.140 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/overlay/group.list 2023-11-27T17:56:58.229 INFO:teuthology.orchestra.run.smithi176.stdout:Building perf 2023-11-27T17:56:58.238 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/perf/group.list 2023-11-27T17:56:58.264 INFO:teuthology.orchestra.run.smithi176.stdout:Building selftest 2023-11-27T17:56:58.272 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/selftest/group.list 2023-11-27T17:56:58.300 INFO:teuthology.orchestra.run.smithi176.stdout:Building shared 2023-11-27T17:56:58.309 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/shared/group.list 2023-11-27T17:56:58.347 INFO:teuthology.orchestra.run.smithi176.stdout:Building tmpfs 2023-11-27T17:56:58.356 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/tmpfs/group.list 2023-11-27T17:56:58.386 INFO:teuthology.orchestra.run.smithi176.stdout:Building udf 2023-11-27T17:56:58.395 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/udf/group.list 2023-11-27T17:56:58.421 INFO:teuthology.orchestra.run.smithi176.stdout:Building xfs 2023-11-27T17:56:58.432 INFO:teuthology.orchestra.run.smithi176.stdout: [GROUP] /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/xfs/group.list 2023-11-27T17:56:58.640 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-11-27T17:56:58.644 INFO:teuthology.orchestra.run.smithi176.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-27T17:56:58.644 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-11-27T17:56:58.649 INFO:teuthology.orchestra.run.smithi176.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-27T17:56:58.649 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-11-27T17:56:58.653 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-11-27T17:56:58.675 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-11-27T17:56:58.833 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-11-27T17:56:58.853 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-11-27T17:56:58.882 INFO:teuthology.orchestra.run.smithi176.stdout:Building log-writes 2023-11-27T17:56:58.888 INFO:teuthology.orchestra.run.smithi176.stdout:Building perf 2023-11-27T17:56:58.895 INFO:teuthology.orchestra.run.smithi176.stdout:Building aio-dio-regress 2023-11-27T17:56:58.902 INFO:teuthology.orchestra.run.smithi176.stdout:Building vfs 2023-11-27T17:56:58.907 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake -C log-writes install 2023-11-27T17:56:58.911 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-11-27T17:56:58.931 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-11-27T17:56:58.951 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake -C perf install 2023-11-27T17:56:58.955 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-11-27T17:56:58.975 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-11-27T17:56:59.024 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-11-27T17:56:59.028 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-11-27T17:56:59.048 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-11-27T17:56:59.160 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake -C vfs install 2023-11-27T17:56:59.164 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-11-27T17:56:59.184 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-11-27T17:56:59.213 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-11-27T17:56:59.233 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio uring_read_fault xfsfind fssum /var/lib/xfstests/src 2023-11-27T17:57:02.012 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-11-27T17:57:02.234 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-11-27T17:57:02.284 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-11-27T17:57:02.285 INFO:teuthology.orchestra.run.smithi176.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-27T17:57:02.285 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-11-27T17:57:02.288 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-11-27T17:57:02.308 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-11-27T17:57:02.590 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-11-27T17:57:02.594 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/btrfs/ install 2023-11-27T17:57:02.599 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-11-27T17:57:02.620 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 /var/lib/xfstests/tests/btrfs 2023-11-27T17:57:04.362 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-11-27T17:57:04.383 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out /var/lib/xfstests/tests/btrfs 2023-11-27T17:57:06.118 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/ceph/ install 2023-11-27T17:57:06.122 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-11-27T17:57:06.142 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-11-27T17:57:06.185 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-11-27T17:57:06.205 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-11-27T17:57:06.248 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/cifs/ install 2023-11-27T17:57:06.252 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-11-27T17:57:06.272 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-11-27T17:57:06.292 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-11-27T17:57:06.312 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-11-27T17:57:06.332 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/ext4/ install 2023-11-27T17:57:06.336 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-11-27T17:57:06.356 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-11-27T17:57:06.757 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-11-27T17:57:06.778 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-11-27T17:57:07.196 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/f2fs/ install 2023-11-27T17:57:07.200 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-11-27T17:57:07.221 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-11-27T17:57:07.246 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-11-27T17:57:07.266 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-11-27T17:57:07.293 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/generic/ install 2023-11-27T17:57:07.300 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-11-27T17:57:07.320 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-11-27T17:57:11.531 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-11-27T17:57:11.551 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out /var/lib/xfstests/tests/generic 2023-11-27T17:57:15.761 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/nfs/ install 2023-11-27T17:57:15.765 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-11-27T17:57:15.785 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-11-27T17:57:15.805 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-11-27T17:57:15.825 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-11-27T17:57:15.845 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/ocfs2/ install 2023-11-27T17:57:15.849 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-11-27T17:57:15.869 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-11-27T17:57:15.890 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-11-27T17:57:15.910 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-11-27T17:57:15.931 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/overlay/ install 2023-11-27T17:57:15.935 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-11-27T17:57:15.956 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-11-27T17:57:16.543 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-11-27T17:57:16.564 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-11-27T17:57:17.154 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/perf/ install 2023-11-27T17:57:17.158 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-11-27T17:57:17.178 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-11-27T17:57:17.199 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-11-27T17:57:17.219 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-11-27T17:57:17.240 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/selftest/ install 2023-11-27T17:57:17.243 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-11-27T17:57:17.263 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-11-27T17:57:17.312 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-11-27T17:57:17.332 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-11-27T17:57:17.383 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/shared/ install 2023-11-27T17:57:17.387 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-11-27T17:57:17.407 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-11-27T17:57:17.438 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-11-27T17:57:17.458 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-11-27T17:57:17.490 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/tmpfs/ install 2023-11-27T17:57:17.494 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-11-27T17:57:17.514 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-11-27T17:57:17.534 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-11-27T17:57:17.554 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-11-27T17:57:17.574 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/udf/ install 2023-11-27T17:57:17.578 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-11-27T17:57:17.599 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-11-27T17:57:17.619 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-11-27T17:57:17.640 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-11-27T17:57:17.661 INFO:teuthology.orchestra.run.smithi176.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jkmd5q6IvPxfstests-dev/tests/xfs/ install 2023-11-27T17:57:17.667 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-11-27T17:57:17.688 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-11-27T17:57:21.640 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-11-27T17:57:21.660 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-11-27T17:57:25.661 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-11-27T17:57:25.681 INFO:teuthology.orchestra.run.smithi176.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-11-27T17:57:25.701 INFO:teuthology.orchestra.run.smithi176.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-11-27T17:57:25.721 INFO:teuthology.orchestra.run.smithi176.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-11-27T17:57:25.744 DEBUG:teuthology.orchestra.run.smithi176:> (cd /tmp/tmp.3xbh07rOVlxfsprogs-dev && exec sudo make) 2023-11-27T17:57:25.817 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize -c -i -f 2023-11-27T17:57:26.028 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-11-27T17:57:26.028 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file './config.guess' 2023-11-27T17:57:26.037 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file './config.sub' 2023-11-27T17:57:26.046 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file './install-sh' 2023-11-27T17:57:26.056 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file './ltmain.sh' 2023-11-27T17:57:26.098 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-27T17:57:26.098 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-27T17:57:26.109 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-27T17:57:26.119 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-27T17:57:26.129 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-27T17:57:26.139 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-27T17:57:26.150 INFO:teuthology.orchestra.run.smithi176.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-27T17:57:26.152 INFO:teuthology.orchestra.run.smithi176.stdout:cp include/install-sh . 2023-11-27T17:57:26.154 INFO:teuthology.orchestra.run.smithi176.stdout:aclocal -I m4 2023-11-27T17:57:27.172 INFO:teuthology.orchestra.run.smithi176.stdout:autoconf 2023-11-27T17:57:27.354 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:57:27.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:57:27.359 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:57:27.610 INFO:teuthology.orchestra.run.smithi176.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-11-27T17:57:27.764 INFO:teuthology.orchestra.run.smithi176.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-11-27T17:57:27.836 INFO:teuthology.orchestra.run.smithi176.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-27T17:57:27.836 INFO:teuthology.orchestra.run.smithi176.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-27T17:57:27.867 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to print strings... printf 2023-11-27T17:57:27.867 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc... gcc 2023-11-27T17:57:27.954 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether the C compiler works... yes 2023-11-27T17:57:27.954 INFO:teuthology.orchestra.run.smithi176.stdout:checking for C compiler default output file name... a.out 2023-11-27T17:57:27.996 INFO:teuthology.orchestra.run.smithi176.stdout:checking for suffix of executables... 2023-11-27T17:57:28.044 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether we are cross compiling... no 2023-11-27T17:57:28.072 INFO:teuthology.orchestra.run.smithi176.stdout:checking for suffix of object files... o 2023-11-27T17:57:28.095 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether the compiler supports GNU C... yes 2023-11-27T17:57:28.119 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether gcc accepts -g... yes 2023-11-27T17:57:28.171 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc option to enable C11 features... none needed 2023-11-27T17:57:28.177 INFO:teuthology.orchestra.run.smithi176.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-11-27T17:57:28.182 INFO:teuthology.orchestra.run.smithi176.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-11-27T17:57:28.185 INFO:teuthology.orchestra.run.smithi176.stdout:checking for egrep... /usr/bin/grep -E 2023-11-27T17:57:28.187 INFO:teuthology.orchestra.run.smithi176.stdout:checking for fgrep... /usr/bin/grep -F 2023-11-27T17:57:28.194 INFO:teuthology.orchestra.run.smithi176.stdout:checking for ld used by gcc... /usr/bin/ld 2023-11-27T17:57:28.198 INFO:teuthology.orchestra.run.smithi176.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-11-27T17:57:28.202 INFO:teuthology.orchestra.run.smithi176.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-11-27T17:57:28.232 INFO:teuthology.orchestra.run.smithi176.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-11-27T17:57:28.233 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether ln -s works... yes 2023-11-27T17:57:28.239 INFO:teuthology.orchestra.run.smithi176.stdout:checking the maximum length of command line arguments... 1572864 2023-11-27T17:57:28.245 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-27T17:57:28.245 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-27T17:57:28.245 INFO:teuthology.orchestra.run.smithi176.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-11-27T17:57:28.245 INFO:teuthology.orchestra.run.smithi176.stdout:checking for objdump... objdump 2023-11-27T17:57:28.246 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to recognize dependent libraries... pass_all 2023-11-27T17:57:28.247 INFO:teuthology.orchestra.run.smithi176.stdout:checking for dlltool... no 2023-11-27T17:57:28.247 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-27T17:57:28.247 INFO:teuthology.orchestra.run.smithi176.stdout:checking for ar... ar 2023-11-27T17:57:28.283 INFO:teuthology.orchestra.run.smithi176.stdout:checking for archiver @FILE support... @ 2023-11-27T17:57:28.283 INFO:teuthology.orchestra.run.smithi176.stdout:checking for strip... strip 2023-11-27T17:57:28.284 INFO:teuthology.orchestra.run.smithi176.stdout:checking for ranlib... ranlib 2023-11-27T17:57:28.284 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gawk... gawk 2023-11-27T17:57:28.373 INFO:teuthology.orchestra.run.smithi176.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-11-27T17:57:28.376 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sysroot... no 2023-11-27T17:57:28.383 INFO:teuthology.orchestra.run.smithi176.stdout:checking for a working dd... /usr/bin/dd 2023-11-27T17:57:28.390 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-11-27T17:57:28.409 INFO:teuthology.orchestra.run.smithi176.stdout:checking for mt... mt 2023-11-27T17:57:28.417 INFO:teuthology.orchestra.run.smithi176.stdout:checking if mt is a manifest tool... no 2023-11-27T17:57:28.443 INFO:teuthology.orchestra.run.smithi176.stdout:checking for stdio.h... yes 2023-11-27T17:57:28.473 INFO:teuthology.orchestra.run.smithi176.stdout:checking for stdlib.h... yes 2023-11-27T17:57:28.505 INFO:teuthology.orchestra.run.smithi176.stdout:checking for string.h... yes 2023-11-27T17:57:28.538 INFO:teuthology.orchestra.run.smithi176.stdout:checking for inttypes.h... yes 2023-11-27T17:57:28.570 INFO:teuthology.orchestra.run.smithi176.stdout:checking for stdint.h... yes 2023-11-27T17:57:28.603 INFO:teuthology.orchestra.run.smithi176.stdout:checking for strings.h... yes 2023-11-27T17:57:28.636 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/stat.h... yes 2023-11-27T17:57:28.669 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/types.h... yes 2023-11-27T17:57:28.706 INFO:teuthology.orchestra.run.smithi176.stdout:checking for unistd.h... yes 2023-11-27T17:57:28.744 INFO:teuthology.orchestra.run.smithi176.stdout:checking for dlfcn.h... yes 2023-11-27T17:57:28.749 INFO:teuthology.orchestra.run.smithi176.stdout:checking for objdir... .libs 2023-11-27T17:57:28.850 INFO:teuthology.orchestra.run.smithi176.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-27T17:57:28.850 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-27T17:57:28.878 INFO:teuthology.orchestra.run.smithi176.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-27T17:57:28.982 INFO:teuthology.orchestra.run.smithi176.stdout:checking if gcc static flag -static works... yes 2023-11-27T17:57:29.024 INFO:teuthology.orchestra.run.smithi176.stdout:checking if gcc supports -c -o file.o... yes 2023-11-27T17:57:29.024 INFO:teuthology.orchestra.run.smithi176.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-27T17:57:29.038 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-27T17:57:29.074 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether -lc should be explicitly linked in... no 2023-11-27T17:57:29.166 INFO:teuthology.orchestra.run.smithi176.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-27T17:57:29.166 INFO:teuthology.orchestra.run.smithi176.stdout:checking how to hardcode library paths into programs... immediate 2023-11-27T17:57:29.169 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether stripping libraries is possible... yes 2023-11-27T17:57:29.169 INFO:teuthology.orchestra.run.smithi176.stdout:checking if libtool supports shared libraries... yes 2023-11-27T17:57:29.169 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether to build shared libraries... yes 2023-11-27T17:57:29.170 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether to build static libraries... yes 2023-11-27T17:57:29.170 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc... (cached) gcc 2023-11-27T17:57:29.213 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-27T17:57:29.213 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-27T17:57:29.213 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-27T17:57:29.226 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc... (cached) gcc 2023-11-27T17:57:29.269 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-27T17:57:29.269 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-27T17:57:29.270 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-27T17:57:29.277 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc... (cached) gcc 2023-11-27T17:57:29.320 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-27T17:57:29.320 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-27T17:57:29.320 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-27T17:57:29.321 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gmake... /usr/bin/gmake 2023-11-27T17:57:29.321 INFO:teuthology.orchestra.run.smithi176.stdout:checking for tar... /usr/bin/tar 2023-11-27T17:57:29.321 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gzip... /usr/bin/gzip 2023-11-27T17:57:29.335 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether gcc -MM is supported... yes 2023-11-27T17:57:29.336 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sort... /bin/sort 2023-11-27T17:57:29.336 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether ln -s works... yes 2023-11-27T17:57:29.337 INFO:teuthology.orchestra.run.smithi176.stdout:checking for msgfmt... /usr/bin/msgfmt 2023-11-27T17:57:29.337 INFO:teuthology.orchestra.run.smithi176.stdout:checking for msgmerge... /usr/bin/msgmerge 2023-11-27T17:57:29.337 INFO:teuthology.orchestra.run.smithi176.stdout:checking for xgettext... /usr/bin/xgettext 2023-11-27T17:57:29.337 INFO:teuthology.orchestra.run.smithi176.stdout:checking for rpm... no 2023-11-27T17:57:29.391 INFO:teuthology.orchestra.run.smithi176.stdout:checking for ini.h... yes 2023-11-27T17:57:29.439 INFO:teuthology.orchestra.run.smithi176.stdout:checking for ini_parse in -linih... yes 2023-11-27T17:57:29.481 INFO:teuthology.orchestra.run.smithi176.stdout:checking for uuid.h... no 2023-11-27T17:57:29.522 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sys/uuid.h... no 2023-11-27T17:57:29.560 INFO:teuthology.orchestra.run.smithi176.stdout:checking for uuid/uuid.h... yes 2023-11-27T17:57:29.620 INFO:teuthology.orchestra.run.smithi176.stdout:checking for uuid_compare... no 2023-11-27T17:57:29.668 INFO:teuthology.orchestra.run.smithi176.stdout:checking for uuid_compare in -luuid... yes 2023-11-27T17:57:29.708 INFO:teuthology.orchestra.run.smithi176.stdout:checking for pthread.h... yes 2023-11-27T17:57:29.757 INFO:teuthology.orchestra.run.smithi176.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-11-27T17:57:29.802 INFO:teuthology.orchestra.run.smithi176.stdout:checking for urcu.h... yes 2023-11-27T17:57:29.840 INFO:teuthology.orchestra.run.smithi176.stdout:checking for liburcu... yes 2023-11-27T17:57:29.869 INFO:teuthology.orchestra.run.smithi176.stdout:checking for fadvise ... yes 2023-11-27T17:57:29.897 INFO:teuthology.orchestra.run.smithi176.stdout:checking for madvise ... yes 2023-11-27T17:57:29.925 INFO:teuthology.orchestra.run.smithi176.stdout:checking for mincore ... yes 2023-11-27T17:57:29.962 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sendfile ... yes 2023-11-27T17:57:29.994 INFO:teuthology.orchestra.run.smithi176.stdout:checking for getmntent ... yes 2023-11-27T17:57:30.046 INFO:teuthology.orchestra.run.smithi176.stdout:checking for fallocate... yes 2023-11-27T17:57:30.098 INFO:teuthology.orchestra.run.smithi176.stdout:checking for fiemap... yes 2023-11-27T17:57:30.157 INFO:teuthology.orchestra.run.smithi176.stdout:checking for pwritev2... yes 2023-11-27T17:57:30.215 INFO:teuthology.orchestra.run.smithi176.stdout:checking for preadv... yes 2023-11-27T17:57:30.272 INFO:teuthology.orchestra.run.smithi176.stdout:checking for copy_file_range... yes 2023-11-27T17:57:30.323 INFO:teuthology.orchestra.run.smithi176.stdout:checking for sync_file_range... yes 2023-11-27T17:57:30.378 INFO:teuthology.orchestra.run.smithi176.stdout:checking for syncfs... yes 2023-11-27T17:57:30.418 INFO:teuthology.orchestra.run.smithi176.stdout:checking for mntent.h... yes 2023-11-27T17:57:30.467 INFO:teuthology.orchestra.run.smithi176.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-11-27T17:57:30.502 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether fls is declared... no 2023-11-27T17:57:30.558 INFO:teuthology.orchestra.run.smithi176.stdout:checking for readdir... yes 2023-11-27T17:57:30.596 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether fsetxattr is declared... yes 2023-11-27T17:57:30.632 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether mremap is declared... yes 2023-11-27T17:57:30.684 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct fsxattr... yes 2023-11-27T17:57:30.711 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-11-27T17:57:30.764 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct fscrypt_add_key_arg... yes 2023-11-27T17:57:30.791 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2023-11-27T17:57:30.867 INFO:teuthology.orchestra.run.smithi176.stdout:checking for GETFSMAP... yes 2023-11-27T17:57:30.921 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct statfs... yes 2023-11-27T17:57:30.949 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct statfs.f_flags... yes 2023-11-27T17:57:30.974 INFO:teuthology.orchestra.run.smithi176.stdout:checking for MAP_SYNC... yes 2023-11-27T17:57:31.088 INFO:teuthology.orchestra.run.smithi176.stdout:checking for library containing dm_task_create... -ldevmapper 2023-11-27T17:57:31.125 INFO:teuthology.orchestra.run.smithi176.stdout:checking for mallinfo ... yes 2023-11-27T17:57:31.157 INFO:teuthology.orchestra.run.smithi176.stdout:checking for mallinfo2 ... yes 2023-11-27T17:57:31.197 INFO:teuthology.orchestra.run.smithi176.stdout:checking for attr/attributes.h... yes 2023-11-27T17:57:31.225 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct attrlist_cursor... yes 2023-11-27T17:57:31.227 INFO:teuthology.orchestra.run.smithi176.stdout:checking for pkg-config... /usr/bin/pkg-config 2023-11-27T17:57:31.229 INFO:teuthology.orchestra.run.smithi176.stdout:checking pkg-config is at least version 0.9.0... yes 2023-11-27T17:57:31.241 INFO:teuthology.orchestra.run.smithi176.stdout:checking for icu-i18n... yes 2023-11-27T17:57:31.280 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether openat is declared... yes 2023-11-27T17:57:31.324 INFO:teuthology.orchestra.run.smithi176.stdout:checking whether fstatat is declared... yes 2023-11-27T17:57:31.360 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct sg_io_hdr ... yes 2023-11-27T17:57:31.391 INFO:teuthology.orchestra.run.smithi176.stdout:checking for struct hd_geometry ... yes 2023-11-27T17:57:31.405 INFO:teuthology.orchestra.run.smithi176.stdout:checking for systemd... yes 2023-11-27T17:57:31.409 INFO:teuthology.orchestra.run.smithi176.stdout:checking for systemd system unit dir... /lib/systemd/system 2023-11-27T17:57:31.409 INFO:teuthology.orchestra.run.smithi176.stdout:checking for system crontab dir... /etc/cron.d 2023-11-27T17:57:31.421 INFO:teuthology.orchestra.run.smithi176.stdout:checking for udev... yes 2023-11-27T17:57:31.424 INFO:teuthology.orchestra.run.smithi176.stdout:checking for udev rule dir... /lib/udev/rules.d 2023-11-27T17:57:31.533 INFO:teuthology.orchestra.run.smithi176.stdout:checking for library containing blkid_probe_all... -lblkid 2023-11-27T17:57:31.586 INFO:teuthology.orchestra.run.smithi176.stdout:checking for blkid_probe_get_topology... yes 2023-11-27T17:57:31.660 INFO:teuthology.orchestra.run.smithi176.stdout:checking size of long... 8 2023-11-27T17:57:31.734 INFO:teuthology.orchestra.run.smithi176.stdout:checking size of char *... 8 2023-11-27T17:57:31.756 INFO:teuthology.orchestra.run.smithi176.stdout:checking for umode_t... no 2023-11-27T17:57:31.822 INFO:teuthology.orchestra.run.smithi176.stdout:checking for atomic64_t support in liburcu... yes 2023-11-27T17:57:31.853 INFO:teuthology.orchestra.run.smithi176.stdout:configure: creating ./config.status 2023-11-27T17:57:32.710 INFO:teuthology.orchestra.run.smithi176.stdout:config.status: creating include/builddefs 2023-11-27T17:57:32.736 INFO:teuthology.orchestra.run.smithi176.stdout:config.status: creating include/platform_defs.h 2023-11-27T17:57:32.757 INFO:teuthology.orchestra.run.smithi176.stdout:config.status: executing libtool commands 2023-11-27T17:57:32.837 INFO:teuthology.orchestra.run.smithi176.stdout: [HEADERS] include 2023-11-27T17:57:32.862 INFO:teuthology.orchestra.run.smithi176.stdout: [HEADERS] libxfs 2023-11-27T17:57:32.897 INFO:teuthology.orchestra.run.smithi176.stdout:Building include 2023-11-27T17:57:32.906 INFO:teuthology.orchestra.run.smithi176.stdout: [LN] disk 2023-11-27T17:57:32.911 INFO:teuthology.orchestra.run.smithi176.stdout:Building libfrog 2023-11-27T17:57:32.917 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] gen_crc32table 2023-11-27T17:57:32.984 INFO:teuthology.orchestra.run.smithi176.stdout: [GENERATE] crc32table.h 2023-11-27T17:57:33.461 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] avl64.lo 2023-11-27T17:57:33.930 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bitmap.lo 2023-11-27T17:57:34.274 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bulkstat.lo 2023-11-27T17:57:34.667 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] convert.lo 2023-11-27T17:57:35.038 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] crc32.lo 2023-11-27T17:57:35.272 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fsgeom.lo 2023-11-27T17:57:35.607 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] list_sort.lo 2023-11-27T17:57:35.830 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] linux.lo 2023-11-27T17:57:36.176 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] logging.lo 2023-11-27T17:57:36.345 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] paths.lo 2023-11-27T17:57:36.795 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] projects.lo 2023-11-27T17:57:37.116 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] ptvar.lo 2023-11-27T17:57:37.384 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] radix-tree.lo 2023-11-27T17:57:37.910 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] randbytes.lo 2023-11-27T17:57:38.136 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] scrub.lo 2023-11-27T17:57:38.352 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] util.lo 2023-11-27T17:57:38.588 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] workqueue.lo 2023-11-27T17:57:38.881 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] libfrog.la 2023-11-27T17:57:39.005 INFO:teuthology.orchestra.run.smithi176.stdout:Building libxfs 2023-11-27T17:57:40.674 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] cache.lo 2023-11-27T17:57:41.214 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] defer_item.lo 2023-11-27T17:57:41.666 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] init.lo 2023-11-27T17:57:42.388 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] kmem.lo 2023-11-27T17:57:42.700 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] logitem.lo 2023-11-27T17:57:43.033 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] rdwr.lo 2023-11-27T17:57:43.879 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] topology.lo 2023-11-27T17:57:44.273 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] trans.lo 2023-11-27T17:57:44.808 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] util.lo 2023-11-27T17:57:45.338 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_ag.lo 2023-11-27T17:57:46.142 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_ag_resv.lo 2023-11-27T17:57:46.513 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_alloc.lo 2023-11-27T17:57:48.075 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_alloc_btree.lo 2023-11-27T17:57:48.570 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_attr.lo 2023-11-27T17:57:49.193 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_attr_leaf.lo 2023-11-27T17:57:50.598 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_attr_remote.lo 2023-11-27T17:57:51.151 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_bit.lo 2023-11-27T17:57:51.457 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_bmap.lo 2023-11-27T17:57:54.213 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_bmap_btree.lo 2023-11-27T17:57:54.759 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_btree.lo 2023-11-27T17:57:56.939 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_btree_staging.lo 2023-11-27T17:57:57.414 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:57:57.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:57:57.420 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:57:57.426 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_da_btree.lo 2023-11-27T17:57:58.717 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_defer.lo 2023-11-27T17:57:59.234 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_dir2.lo 2023-11-27T17:57:59.770 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_dir2_block.lo 2023-11-27T17:58:00.634 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_dir2_data.lo 2023-11-27T17:58:01.413 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_dir2_leaf.lo 2023-11-27T17:58:02.340 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_dir2_node.lo 2023-11-27T17:58:03.405 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_dir2_sf.lo 2023-11-27T17:58:04.214 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_dquot_buf.lo 2023-11-27T17:58:04.618 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_ialloc.lo 2023-11-27T17:58:05.947 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_iext_tree.lo 2023-11-27T17:58:06.678 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_inode_buf.lo 2023-11-27T17:58:07.333 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_inode_fork.lo 2023-11-27T17:58:07.970 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_ialloc_btree.lo 2023-11-27T17:58:08.503 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_log_rlimit.lo 2023-11-27T17:58:08.834 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_refcount.lo 2023-11-27T17:58:09.688 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_refcount_btree.lo 2023-11-27T17:58:10.154 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_rmap.lo 2023-11-27T17:58:11.353 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_rmap_btree.lo 2023-11-27T17:58:11.904 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_rtbitmap.lo 2023-11-27T17:58:12.550 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_sb.lo 2023-11-27T17:58:13.377 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_symlink_remote.lo 2023-11-27T17:58:13.758 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_trans_inode.lo 2023-11-27T17:58:14.067 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_trans_resv.lo 2023-11-27T17:58:14.644 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_types.lo 2023-11-27T17:58:15.018 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] libxfs.la 2023-11-27T17:58:15.236 INFO:teuthology.orchestra.run.smithi176.stdout:Building libxlog 2023-11-27T17:58:15.330 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_log_recover.lo 2023-11-27T17:58:16.148 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] util.lo 2023-11-27T17:58:16.539 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] libxlog.la 2023-11-27T17:58:16.641 INFO:teuthology.orchestra.run.smithi176.stdout:Building libxcmd 2023-11-27T17:58:16.777 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] command.lo 2023-11-27T17:58:17.129 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] input.lo 2023-11-27T17:58:17.450 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] help.lo 2023-11-27T17:58:17.710 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] quit.lo 2023-11-27T17:58:17.945 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] libxcmd.la 2023-11-27T17:58:18.048 INFO:teuthology.orchestra.run.smithi176.stdout:Building libhandle 2023-11-27T17:58:18.130 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] handle.lo 2023-11-27T17:58:18.522 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] jdm.lo 2023-11-27T17:58:18.815 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] libhandle.la 2023-11-27T17:58:18.965 INFO:teuthology.orchestra.run.smithi176.stdout:Building copy 2023-11-27T17:58:19.022 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_copy.o 2023-11-27T17:58:19.469 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_copy 2023-11-27T17:58:19.656 INFO:teuthology.orchestra.run.smithi176.stdout:Building db 2023-11-27T17:58:21.717 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] addr.o 2023-11-27T17:58:21.830 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] agf.o 2023-11-27T17:58:21.946 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] agfl.o 2023-11-27T17:58:22.063 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] agi.o 2023-11-27T17:58:22.178 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] attr.o 2023-11-27T17:58:22.386 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] attrshort.o 2023-11-27T17:58:22.520 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bit.o 2023-11-27T17:58:22.655 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] block.o 2023-11-27T17:58:22.806 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bmap.o 2023-11-27T17:58:23.015 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] btblock.o 2023-11-27T17:58:23.159 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bmroot.o 2023-11-27T17:58:23.335 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] check.o 2023-11-27T17:58:25.152 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] command.o 2023-11-27T17:58:25.273 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] crc.o 2023-11-27T17:58:25.410 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] debug.o 2023-11-27T17:58:25.515 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dir2.o 2023-11-27T17:58:25.810 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dir2sf.o 2023-11-27T17:58:25.959 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dquot.o 2023-11-27T17:58:26.089 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] echo.o 2023-11-27T17:58:26.185 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] faddr.o 2023-11-27T17:58:26.382 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] field.o 2023-11-27T17:58:26.501 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] flist.o 2023-11-27T17:58:26.742 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fprint.o 2023-11-27T17:58:26.919 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] frag.o 2023-11-27T17:58:27.172 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] freesp.o 2023-11-27T17:58:27.380 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] hash.o 2023-11-27T17:58:27.464 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c: In function 'hash_f': 2023-11-27T17:58:27.465 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:76:58: warning: pointer targets in passing argument 1 of 'libxfs_da_hashname' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.465 INFO:teuthology.orchestra.run.smithi176.stderr: 76 | hashval = libxfs_da_hashname(argv[c], strlen(argv[c])); 2023-11-27T17:58:27.465 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~^~~ 2023-11-27T17:58:27.465 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.465 INFO:teuthology.orchestra.run.smithi176.stderr: | char * 2023-11-27T17:58:27.465 INFO:teuthology.orchestra.run.smithi176.stderr:In file included from ../include/libxfs.h:59, 2023-11-27T17:58:27.465 INFO:teuthology.orchestra.run.smithi176.stderr: from hash.c:7: 2023-11-27T17:58:27.465 INFO:teuthology.orchestra.run.smithi176.stderr:../libxfs/xfs_da_btree.h:223:37: note: expected 'const uint8_t *' {aka 'const unsigned char *'} but argument is of type 'char *' 2023-11-27T17:58:27.465 INFO:teuthology.orchestra.run.smithi176.stderr: 223 | uint xfs_da_hashname(const uint8_t *name_string, int name_length); 2023-11-27T17:58:27.465 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~~~~~~~~~~~~^~~~~~~~~~~ 2023-11-27T17:58:27.468 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c: In function 'collide_dirents': 2023-11-27T17:58:27.468 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:258:36: warning: pointer targets in passing argument 2 of 'openat' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.468 INFO:teuthology.orchestra.run.smithi176.stderr: 258 | newfd = openat(fd, name, O_CREAT, 0600); 2023-11-27T17:58:27.468 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~ 2023-11-27T17:58:27.468 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr: | const unsigned char * 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr:In file included from /usr/include/fcntl.h:314, 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr: from ../include/platform_defs.h:12, 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr: from ../include/libxfs.h:11, 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr: from hash.c:7: 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr:/usr/include/x86_64-linux-gnu/bits/fcntl2.h:117:31: note: expected 'const char *' but argument is of type 'const unsigned char *' 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr: 117 | openat (int __fd, const char *__path, int __oflag, ...) 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:273:25: warning: pointer targets in passing argument 1 of 'strncpy' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~ 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr: | unsigned char * 2023-11-27T17:58:27.469 INFO:teuthology.orchestra.run.smithi176.stderr:In file included from /usr/include/features.h:486, 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr: from /usr/include/stdio.h:27, 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr: from ../include/platform_defs.h:10, 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr: from ../include/libxfs.h:11, 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr: from hash.c:7: 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:92:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr: 92 | __NTH (strncpy (char *__restrict __dest, const char *__restrict __src, 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~ 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:273:37: warning: pointer targets in passing argument 2 of 'strncpy' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~ 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr: | const unsigned char * 2023-11-27T17:58:27.470 INFO:teuthology.orchestra.run.smithi176.stderr:In file included from /usr/include/features.h:486, 2023-11-27T17:58:27.471 INFO:teuthology.orchestra.run.smithi176.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-11-27T17:58:27.471 INFO:teuthology.orchestra.run.smithi176.stderr: from /usr/include/stdio.h:27, 2023-11-27T17:58:27.471 INFO:teuthology.orchestra.run.smithi176.stderr: from ../include/platform_defs.h:10, 2023-11-27T17:58:27.471 INFO:teuthology.orchestra.run.smithi176.stderr: from ../include/libxfs.h:11, 2023-11-27T17:58:27.471 INFO:teuthology.orchestra.run.smithi176.stderr: from hash.c:7: 2023-11-27T17:58:27.471 INFO:teuthology.orchestra.run.smithi176.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:92:1: note: expected 'const char * restrict' but argument is of type 'const unsigned char *' 2023-11-27T17:58:27.471 INFO:teuthology.orchestra.run.smithi176.stderr: 92 | __NTH (strncpy (char *__restrict __dest, const char *__restrict __src, 2023-11-27T17:58:27.471 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~ 2023-11-27T17:58:27.471 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:278:44: warning: pointer targets in passing argument 2 of 'linkat' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.471 INFO:teuthology.orchestra.run.smithi176.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-11-27T17:58:27.471 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~ 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr: | const unsigned char * 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr:In file included from ../include/platform_defs.h:19, 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr: from ../include/libxfs.h:11, 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr: from hash.c:7: 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr:/usr/include/unistd.h:825:46: note: expected 'const char *' but argument is of type 'const unsigned char *' 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr: 825 | extern int linkat (int __fromfd, const char *__from, int __tofd, 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:278:54: warning: pointer targets in passing argument 4 of 'linkat' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~~ 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr: | unsigned char * 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr:In file included from ../include/platform_defs.h:19, 2023-11-27T17:58:27.472 INFO:teuthology.orchestra.run.smithi176.stderr: from ../include/libxfs.h:11, 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr: from hash.c:7: 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr:/usr/include/unistd.h:826:32: note: expected 'const char *' but argument is of type 'unsigned char *' 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr: 826 | const char *__to, int __flags) 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~~~~~~~~~^~~~ 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c: In function 'collide_xattrs': 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:318:26: warning: pointer targets in passing argument 1 of 'snprintf' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr: 318 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~ 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr: | unsigned char * 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr:In file included from /usr/include/features.h:486, 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr: from /usr/include/stdio.h:27, 2023-11-27T17:58:27.473 INFO:teuthology.orchestra.run.smithi176.stderr: from ../include/platform_defs.h:10, 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr: from ../include/libxfs.h:11, 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr: from hash.c:7: 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:68:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr: 68 | __NTH (snprintf (char *__restrict __s, size_t __n, 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~ 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:319:39: warning: pointer targets in passing argument 2 of 'fsetxattr' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr: 319 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~ 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr: | unsigned char * 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr:In file included from hash.c:16: 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr:/usr/include/x86_64-linux-gnu/sys/xattr.h:54:45: note: expected 'const char *' but argument is of type 'unsigned char *' 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-11-27T17:58:27.474 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:332:26: warning: pointer targets in passing argument 1 of 'snprintf' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr: 332 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~ 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr: | unsigned char * 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr:In file included from /usr/include/features.h:486, 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr: from /usr/include/stdio.h:27, 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr: from ../include/platform_defs.h:10, 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr: from ../include/libxfs.h:11, 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr: from hash.c:7: 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:68:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr: 68 | __NTH (snprintf (char *__restrict __s, size_t __n, 2023-11-27T17:58:27.475 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~ 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:337:47: warning: pointer targets in passing argument 2 of 'fsetxattr' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr: 337 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~~~~~~~ 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr: | unsigned char * 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr:In file included from hash.c:16: 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr:/usr/include/x86_64-linux-gnu/sys/xattr.h:54:45: note: expected 'const char *' but argument is of type 'unsigned char *' 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c: In function 'hashcoll_f': 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:417:52: warning: pointer targets in passing argument 2 of 'collide_xattrs' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr: 417 | error = collide_xattrs(nr, buf, len, fd); 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~ 2023-11-27T17:58:27.476 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr: | char * 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:300:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr: 300 | const unsigned char *name, 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:419:53: warning: pointer targets in passing argument 2 of 'collide_dirents' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr: 419 | error = collide_dirents(nr, buf, len, fd); 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr: | ^~~ 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr: | char * 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:234:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr: 234 | const unsigned char *name, 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:431:56: warning: pointer targets in passing argument 2 of 'collide_xattrs' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr: 431 | error = collide_xattrs(nr, argv[c], len, fd); 2023-11-27T17:58:27.477 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~^~~ 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr: | char * 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:300:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr: 300 | const unsigned char *name, 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:433:57: warning: pointer targets in passing argument 2 of 'collide_dirents' differ in signedness [-Wpointer-sign] 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr: 433 | error = collide_dirents(nr, argv[c], len, fd); 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~^~~ 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr: | | 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr: | char * 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr:hash.c:234:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr: 234 | const unsigned char *name, 2023-11-27T17:58:27.478 INFO:teuthology.orchestra.run.smithi176.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-11-27T17:58:27.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:58:27.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:58:27.484 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:58:27.570 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] help.o 2023-11-27T17:58:27.675 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] init.o 2023-11-27T17:58:27.814 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] inode.o 2023-11-27T17:58:28.103 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] input.o 2023-11-27T17:58:28.255 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] io.o 2023-11-27T17:58:28.474 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] logformat.o 2023-11-27T17:58:28.606 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] malloc.o 2023-11-27T17:58:28.714 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] metadump.o 2023-11-27T17:58:29.529 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] output.o 2023-11-27T17:58:29.649 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] print.o 2023-11-27T17:58:29.816 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] quit.o 2023-11-27T17:58:29.916 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] sb.o 2023-11-27T17:58:30.169 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] sig.o 2023-11-27T17:58:30.273 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] strvec.o 2023-11-27T17:58:30.391 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] text.o 2023-11-27T17:58:30.505 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] type.o 2023-11-27T17:58:30.639 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] write.o 2023-11-27T17:58:30.890 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] attrset.o 2023-11-27T17:58:31.032 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] symlink.o 2023-11-27T17:58:31.137 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fsmap.o 2023-11-27T17:58:31.273 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fuzz.o 2023-11-27T17:58:31.443 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] obfuscate.o 2023-11-27T17:58:31.588 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] btdump.o 2023-11-27T17:58:31.777 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] btheight.o 2023-11-27T17:58:31.965 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] convert.o 2023-11-27T17:58:32.124 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] info.o 2023-11-27T17:58:32.253 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] iunlink.o 2023-11-27T17:58:32.435 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] namei.o 2023-11-27T17:58:32.655 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] timelimit.o 2023-11-27T17:58:32.780 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_db 2023-11-27T17:58:33.028 INFO:teuthology.orchestra.run.smithi176.stdout:Building estimate 2023-11-27T17:58:33.084 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_estimate.o 2023-11-27T17:58:33.230 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_estimate 2023-11-27T17:58:33.317 INFO:teuthology.orchestra.run.smithi176.stdout:Building fsck 2023-11-27T17:58:33.323 INFO:teuthology.orchestra.run.smithi176.stdout:Building fsr 2023-11-27T17:58:33.381 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_fsr.o 2023-11-27T17:58:33.810 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_fsr 2023-11-27T17:58:33.937 INFO:teuthology.orchestra.run.smithi176.stdout:Building growfs 2023-11-27T17:58:33.994 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_growfs.o 2023-11-27T17:58:34.181 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_growfs 2023-11-27T17:58:34.367 INFO:teuthology.orchestra.run.smithi176.stdout:Building io 2023-11-27T17:58:35.753 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] init.o 2023-11-27T17:58:35.869 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] attr.o 2023-11-27T17:58:36.012 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bmap.o 2023-11-27T17:58:36.190 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bulkstat.o 2023-11-27T17:58:36.357 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] crc32cselftest.o 2023-11-27T17:58:36.444 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] cowextsize.o 2023-11-27T17:58:36.556 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] encrypt.o 2023-11-27T17:58:36.775 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] file.o 2023-11-27T17:58:36.880 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] freeze.o 2023-11-27T17:58:36.967 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fsuuid.o 2023-11-27T17:58:37.071 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fsync.o 2023-11-27T17:58:37.151 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] getrusage.o 2023-11-27T17:58:37.243 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] imap.o 2023-11-27T17:58:37.332 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] inject.o 2023-11-27T17:58:37.428 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] label.o 2023-11-27T17:58:37.541 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] link.o 2023-11-27T17:58:37.623 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] mmap.o 2023-11-27T17:58:37.833 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] open.o 2023-11-27T17:58:38.117 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] parent.o 2023-11-27T17:58:38.279 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] pread.o 2023-11-27T17:58:38.452 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] prealloc.o 2023-11-27T17:58:38.597 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] pwrite.o 2023-11-27T17:58:38.748 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] reflink.o 2023-11-27T17:58:38.882 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] resblks.o 2023-11-27T17:58:38.965 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] scrub.o 2023-11-27T17:58:39.097 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] seek.o 2023-11-27T17:58:39.205 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] shutdown.o 2023-11-27T17:58:39.290 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] stat.o 2023-11-27T17:58:39.498 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] swapext.o 2023-11-27T17:58:39.586 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] sync.o 2023-11-27T17:58:39.664 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] truncate.o 2023-11-27T17:58:39.746 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] utimes.o 2023-11-27T17:58:39.828 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fadvise.o 2023-11-27T17:58:39.920 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] madvise.o 2023-11-27T17:58:40.013 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] mincore.o 2023-11-27T17:58:40.110 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] sendfile.o 2023-11-27T17:58:40.215 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fiemap.o 2023-11-27T17:58:40.367 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] copy_file_range.o 2023-11-27T17:58:40.468 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] sync_file_range.o 2023-11-27T17:58:40.558 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] readdir.o 2023-11-27T17:58:40.659 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] log_writes.o 2023-11-27T17:58:40.751 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fsmap.o 2023-11-27T17:58:40.990 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_io 2023-11-27T17:58:41.175 INFO:teuthology.orchestra.run.smithi176.stdout:Building logprint 2023-11-27T17:58:41.454 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] logprint.o 2023-11-27T17:58:41.593 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] log_copy.o 2023-11-27T17:58:41.708 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] log_dump.o 2023-11-27T17:58:41.832 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] log_misc.o 2023-11-27T17:58:42.355 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] log_print_all.o 2023-11-27T17:58:42.618 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] log_print_trans.o 2023-11-27T17:58:42.734 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] log_redo.o 2023-11-27T17:58:42.987 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_logprint 2023-11-27T17:58:43.179 INFO:teuthology.orchestra.run.smithi176.stdout:Building mkfs 2023-11-27T17:58:43.275 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] proto.o 2023-11-27T17:58:43.555 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_mkfs.o 2023-11-27T17:58:44.293 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] mkfs.xfs 2023-11-27T17:58:44.489 INFO:teuthology.orchestra.run.smithi176.stdout:Building quota 2023-11-27T17:58:44.869 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] init.o 2023-11-27T17:58:44.971 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] util.o 2023-11-27T17:58:45.134 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] edit.o 2023-11-27T17:58:45.330 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] free.o 2023-11-27T17:58:45.482 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] linux.o 2023-11-27T17:58:45.558 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] path.o 2023-11-27T17:58:45.671 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] project.o 2023-11-27T17:58:45.815 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] quot.o 2023-11-27T17:58:45.975 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] quota.o 2023-11-27T17:58:46.145 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] report.o 2023-11-27T17:58:46.369 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] state.o 2023-11-27T17:58:46.548 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_quota 2023-11-27T17:58:46.681 INFO:teuthology.orchestra.run.smithi176.stdout:Building mdrestore 2023-11-27T17:58:46.737 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_mdrestore.o 2023-11-27T17:58:46.903 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_mdrestore 2023-11-27T17:58:47.071 INFO:teuthology.orchestra.run.smithi176.stdout:Building repair 2023-11-27T17:58:48.395 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] agheader.o 2023-11-27T17:58:48.613 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] agbtree.o 2023-11-27T17:58:48.858 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] attr_repair.o 2023-11-27T17:58:49.209 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] avl.o 2023-11-27T17:58:49.425 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bulkload.o 2023-11-27T17:58:49.550 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] bmap.o 2023-11-27T17:58:49.703 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] btree.o 2023-11-27T17:58:50.050 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] da_util.o 2023-11-27T17:58:50.277 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dino_chunks.o 2023-11-27T17:58:50.660 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dinode.o 2023-11-27T17:58:51.389 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] dir2.o 2023-11-27T17:58:51.812 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] globals.o 2023-11-27T17:58:51.907 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] incore_bmc.o 2023-11-27T17:58:52.017 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] incore.o 2023-11-27T17:58:52.159 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] incore_ext.o 2023-11-27T17:58:52.383 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] incore_ino.o 2023-11-27T17:58:52.657 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] init.o 2023-11-27T17:58:52.796 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase1.o 2023-11-27T17:58:52.923 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase2.o 2023-11-27T17:58:53.116 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase3.o 2023-11-27T17:58:53.251 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase4.o 2023-11-27T17:58:53.442 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase5.o 2023-11-27T17:58:53.697 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase6.o 2023-11-27T17:58:54.557 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase7.o 2023-11-27T17:58:54.695 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] prefetch.o 2023-11-27T17:58:55.039 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] progress.o 2023-11-27T17:58:55.240 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] quotacheck.o 2023-11-27T17:58:55.451 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] rmap.o 2023-11-27T17:58:55.851 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] rt.o 2023-11-27T17:58:56.018 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] sb.o 2023-11-27T17:58:56.245 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] scan.o 2023-11-27T17:58:57.012 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] slab.o 2023-11-27T17:58:57.174 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] threads.o 2023-11-27T17:58:59.477 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:58:59.479 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] versions.o 2023-11-27T17:58:59.479 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_repair.o 2023-11-27T17:58:59.479 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_repair 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout:Building rtcp 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_rtcp.o 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_rtcp 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout:Building m4 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout:Building man 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout:Building man2 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout:Building man3 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout:Building man5 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout:Building man8 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout: [SED] mkfs.xfs.8 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout:Building doc 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout: [ZIP] CHANGES.gz 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout:Building debian 2023-11-27T17:58:59.480 INFO:teuthology.orchestra.run.smithi176.stdout:Building spaceman 2023-11-27T17:58:59.481 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] info.o 2023-11-27T17:58:59.481 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] init.o 2023-11-27T17:58:59.481 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] file.o 2023-11-27T17:58:59.481 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] health.o 2023-11-27T17:58:59.481 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] prealloc.o 2023-11-27T17:58:59.481 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] trim.o 2023-11-27T17:58:59.481 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] freesp.o 2023-11-27T17:58:59.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:58:59.489 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:58:59.643 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_spaceman 2023-11-27T17:58:59.771 INFO:teuthology.orchestra.run.smithi176.stdout:Building scrub 2023-11-27T17:59:00.493 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] common.o 2023-11-27T17:59:00.639 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] counter.o 2023-11-27T17:59:00.712 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] descr.o 2023-11-27T17:59:00.798 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] disk.o 2023-11-27T17:59:00.920 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] filemap.o 2023-11-27T17:59:01.014 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] fscounters.o 2023-11-27T17:59:01.114 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] inodes.o 2023-11-27T17:59:01.262 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase1.o 2023-11-27T17:59:01.375 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase2.o 2023-11-27T17:59:01.482 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase3.o 2023-11-27T17:59:01.599 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase4.o 2023-11-27T17:59:01.697 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase5.o 2023-11-27T17:59:01.843 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase6.o 2023-11-27T17:59:02.024 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] phase7.o 2023-11-27T17:59:02.143 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] progress.o 2023-11-27T17:59:02.254 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] read_verify.o 2023-11-27T17:59:02.381 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] repair.o 2023-11-27T17:59:02.504 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] scrub.o 2023-11-27T17:59:02.711 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] spacemap.o 2023-11-27T17:59:02.828 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] vfs.o 2023-11-27T17:59:02.951 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] xfs_scrub.o 2023-11-27T17:59:03.152 INFO:teuthology.orchestra.run.smithi176.stdout: [CC] unicrash.o 2023-11-27T17:59:03.338 INFO:teuthology.orchestra.run.smithi176.stdout: [LD] xfs_scrub 2023-11-27T17:59:03.535 INFO:teuthology.orchestra.run.smithi176.stdout: [SED] xfs_scrub_all 2023-11-27T17:59:03.544 INFO:teuthology.orchestra.run.smithi176.stdout: [SED] xfs_scrub@.service 2023-11-27T17:59:03.550 INFO:teuthology.orchestra.run.smithi176.stdout: [SED] xfs_scrub_all.service 2023-11-27T17:59:03.556 INFO:teuthology.orchestra.run.smithi176.stdout: [SED] xfs_scrub_fail@.service 2023-11-27T17:59:03.562 INFO:teuthology.orchestra.run.smithi176.stdout: [SED] xfs_scrub_all.cron 2023-11-27T17:59:03.569 INFO:teuthology.orchestra.run.smithi176.stdout:Building po 2023-11-27T17:59:03.596 INFO:teuthology.orchestra.run.smithi176.stdout: [GETTXT] xfsprogs.pot 2023-11-27T17:59:03.821 INFO:teuthology.orchestra.run.smithi176.stdout: [MSGFMT] de.mo 2023-11-27T17:59:03.867 INFO:teuthology.orchestra.run.smithi176.stderr:2345 translated messages. 2023-11-27T17:59:03.869 INFO:teuthology.orchestra.run.smithi176.stdout: [MSGFMT] pl.mo 2023-11-27T17:59:03.914 INFO:teuthology.orchestra.run.smithi176.stderr:3104 translated messages. 2023-11-27T17:59:03.915 INFO:teuthology.orchestra.run.smithi176.stdout:gmake[2]: Nothing to be done for 'include'. 2023-11-27T17:59:03.919 DEBUG:teuthology.orchestra.run.smithi176:> (cd /tmp/tmp.3xbh07rOVlxfsprogs-dev && exec sudo make install) 2023-11-27T17:59:03.950 INFO:teuthology.orchestra.run.smithi176.stdout:Installing libfrog-install 2023-11-27T17:59:04.392 INFO:teuthology.orchestra.run.smithi176.stdout:Installing libxfs-install 2023-11-27T17:59:06.051 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-11-27T17:59:06.073 INFO:teuthology.orchestra.run.smithi176.stdout:Installing libxlog-install 2023-11-27T17:59:06.163 INFO:teuthology.orchestra.run.smithi176.stdout:Installing libxcmd-install 2023-11-27T17:59:06.298 INFO:teuthology.orchestra.run.smithi176.stdout:Installing libhandle-install 2023-11-27T17:59:06.374 INFO:teuthology.orchestra.run.smithi176.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib 2023-11-27T17:59:06.442 INFO:teuthology.orchestra.run.smithi176.stdout:Installing copy-install 2023-11-27T17:59:06.494 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-27T17:59:06.513 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-11-27T17:59:06.568 INFO:teuthology.orchestra.run.smithi176.stdout:Installing db-install 2023-11-27T17:59:08.622 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-27T17:59:08.643 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-11-27T17:59:08.698 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-11-27T17:59:08.719 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-11-27T17:59:08.739 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-11-27T17:59:08.761 INFO:teuthology.orchestra.run.smithi176.stdout:Installing estimate-install 2023-11-27T17:59:08.812 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-27T17:59:08.833 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-11-27T17:59:08.881 INFO:teuthology.orchestra.run.smithi176.stdout:Installing fsck-install 2023-11-27T17:59:08.885 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-11-27T17:59:08.905 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-11-27T17:59:08.927 INFO:teuthology.orchestra.run.smithi176.stdout:Installing fsr-install 2023-11-27T17:59:08.980 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-27T17:59:09.000 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-11-27T17:59:09.049 INFO:teuthology.orchestra.run.smithi176.stdout:Installing growfs-install 2023-11-27T17:59:09.101 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-27T17:59:09.122 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-11-27T17:59:09.176 INFO:teuthology.orchestra.run.smithi176.stdout:Installing io-install 2023-11-27T17:59:10.556 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-27T17:59:10.576 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-11-27T17:59:10.624 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-11-27T17:59:10.671 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-11-27T17:59:10.717 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-11-27T17:59:10.765 INFO:teuthology.orchestra.run.smithi176.stdout:Installing logprint-install 2023-11-27T17:59:11.038 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-27T17:59:11.058 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-11-27T17:59:11.113 INFO:teuthology.orchestra.run.smithi176.stdout:Installing mkfs-install 2023-11-27T17:59:11.205 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-11-27T17:59:11.224 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-11-27T17:59:11.278 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-11-27T17:59:11.298 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf lts_6.6.conf /usr/share/xfsprogs/mkfs 2023-11-27T17:59:11.353 INFO:teuthology.orchestra.run.smithi176.stdout:Installing quota-install 2023-11-27T17:59:11.718 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-27T17:59:11.737 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-11-27T17:59:11.787 INFO:teuthology.orchestra.run.smithi176.stdout:Installing mdrestore-install 2023-11-27T17:59:11.839 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-27T17:59:11.858 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-11-27T17:59:11.912 INFO:teuthology.orchestra.run.smithi176.stdout:Installing repair-install 2023-11-27T17:59:13.231 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-11-27T17:59:13.251 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-11-27T17:59:13.309 INFO:teuthology.orchestra.run.smithi176.stdout:Installing rtcp-install 2023-11-27T17:59:13.360 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-27T17:59:13.379 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-11-27T17:59:13.428 INFO:teuthology.orchestra.run.smithi176.stdout:Installing m4-install 2023-11-27T17:59:13.432 INFO:teuthology.orchestra.run.smithi176.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-27T17:59:13.434 INFO:teuthology.orchestra.run.smithi176.stdout:Installing man-install 2023-11-27T17:59:13.444 INFO:teuthology.orchestra.run.smithi176.stdout:gmake[2]: Nothing to be done for 'install'. 2023-11-27T17:59:13.450 INFO:teuthology.orchestra.run.smithi176.stdout:gmake[2]: Nothing to be done for 'install'. 2023-11-27T17:59:13.458 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-11-27T17:59:13.484 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-11-27T17:59:13.508 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-11-27T17:59:13.531 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-11-27T17:59:13.561 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-11-27T17:59:13.587 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-11-27T17:59:13.611 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-11-27T17:59:13.635 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-11-27T17:59:13.658 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-11-27T17:59:13.682 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-11-27T17:59:13.706 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-11-27T17:59:13.730 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-11-27T17:59:13.754 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-11-27T17:59:13.778 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-11-27T17:59:13.802 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-11-27T17:59:13.825 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-11-27T17:59:13.850 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-11-27T17:59:13.873 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-11-27T17:59:13.897 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-11-27T17:59:13.921 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-11-27T17:59:13.945 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-11-27T17:59:13.968 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-11-27T17:59:13.992 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-11-27T17:59:14.016 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-11-27T17:59:14.039 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-11-27T17:59:14.063 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-11-27T17:59:14.087 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-11-27T17:59:14.111 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-11-27T17:59:14.134 INFO:teuthology.orchestra.run.smithi176.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-11-27T17:59:14.156 INFO:teuthology.orchestra.run.smithi176.stdout:Installing doc-install 2023-11-27T17:59:14.160 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-11-27T17:59:14.180 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-11-27T17:59:14.213 INFO:teuthology.orchestra.run.smithi176.stdout:Installing debian-install 2023-11-27T17:59:14.217 INFO:teuthology.orchestra.run.smithi176.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-27T17:59:14.219 INFO:teuthology.orchestra.run.smithi176.stdout:Installing spaceman-install 2023-11-27T17:59:14.498 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-27T17:59:14.518 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-11-27T17:59:14.565 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-11-27T17:59:14.587 INFO:teuthology.orchestra.run.smithi176.stdout:Installing scrub-install 2023-11-27T17:59:15.306 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-27T17:59:15.325 INFO:teuthology.orchestra.run.smithi176.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-11-27T17:59:15.373 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-11-27T17:59:15.394 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /lib/systemd/system 2023-11-27T17:59:15.414 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /lib/systemd/system 2023-11-27T17:59:15.451 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2023-11-27T17:59:15.471 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib/xfsprogs 2023-11-27T17:59:15.506 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2023-11-27T17:59:15.526 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib/xfsprogs 2023-11-27T17:59:15.546 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /lib/udev/rules.d 2023-11-27T17:59:15.566 INFO:teuthology.orchestra.run.smithi176.stdout:for i in xfs.rules; do \ 2023-11-27T17:59:15.566 INFO:teuthology.orchestra.run.smithi176.stdout: ../install-sh -o root -g root -m 644 $i /lib/udev/rules.d/64-$i; \ 2023-11-27T17:59:15.566 INFO:teuthology.orchestra.run.smithi176.stdout:done 2023-11-27T17:59:15.589 INFO:teuthology.orchestra.run.smithi176.stdout:Installing po-install 2023-11-27T17:59:15.684 INFO:teuthology.orchestra.run.smithi176.stdout:Installing include-install 2023-11-27T17:59:15.688 INFO:teuthology.orchestra.run.smithi176.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-11-27T17:59:15.708 INFO:teuthology.orchestra.run.smithi176.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-11-27T17:59:15.728 INFO:teuthology.orchestra.run.smithi176.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-11-27T17:59:15.751 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-27T17:59:15.886 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.880+0000 7f2f30cfe640 1 Processor -- start 2023-11-27T17:59:15.908 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.880+0000 7f2f30cfe640 1 -- start start 2023-11-27T17:59:15.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.880+0000 7f2f30cfe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f2c06dfd0 0x7f2f2c06b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:15.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.880+0000 7f2f30cfe640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c06db40 con 0x7f2f2c0bcfe0 2023-11-27T17:59:15.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.880+0000 7f2f30cfe640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c0b7f80 con 0x7f2f2c141e00 2023-11-27T17:59:15.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.880+0000 7f2f30cfe640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0b8770 con 0x7f2f2c06dfd0 2023-11-27T17:59:15.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.880+0000 7f2f2ad9d640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2f2c0bcfe0 0x7f2f2c1520d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42078/0 (socket says 172.21.15.31:42078) 2023-11-27T17:59:15.915 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.880+0000 7f2f2ad9d640 1 -- 172.21.15.31:0/374006807 learned_addr learned my addr 172.21.15.31:0/374006807 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:59:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.880+0000 7f2f23fff640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f2c06dfd0 0x7f2f2c06b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784595626 0 0) 0x7f2f2c06db40 con 0x7f2f2c0bcfe0 2023-11-27T17:59:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f18003530 con 0x7f2f2c0bcfe0 2023-11-27T17:59:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281841512 0 0) 0x7f2f2c0b7f80 con 0x7f2f2c141e00 2023-11-27T17:59:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f2c06db40 con 0x7f2f2c141e00 2023-11-27T17:59:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3736889037 0 0) 0x7f2f18003530 con 0x7f2f2c0bcfe0 2023-11-27T17:59:15.916 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f2c06dfd0 msgr2=0x7f2f2c06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:59:15.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f2c06dfd0 0x7f2f2c06b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:15.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 >> v1:172.21.15.81:6789/0 conn(0x7f2f2c141e00 legacy=0x7f2f2c0b9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:15.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c0b8a50 con 0x7f2f2c0bcfe0 2023-11-27T17:59:15.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f2f24001a00 con 0x7f2f2c0bcfe0 2023-11-27T17:59:15.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 >> v1:172.21.15.31:6789/0 conn(0x7f2f2c0bcfe0 legacy=0x7f2f2c1520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:15.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f18003bb0 0x7f2f18003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:15.917 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f180047d0 0x7f2f18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:15.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f2c06dfd0 0x7f2f18005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:15.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0b8770 con 0x7f2f180047d0 2023-11-27T17:59:15.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1800dc80 con 0x7f2f18003bb0 2023-11-27T17:59:15.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1800de40 con 0x7f2f2c06dfd0 2023-11-27T17:59:15.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f23fff640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f180047d0 0x7f2f18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:15.918 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f2a59c640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f18003bb0 0x7f2f18003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f2ad9d640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f2c06dfd0 0x7f2f18005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f23fff640 1 -- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f2c06dfd0 msgr2=0x7f2f18005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:59:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f23fff640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f2c06dfd0 0x7f2f18005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f23fff640 1 -- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f18003bb0 msgr2=0x7f2f18003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:59:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f23fff640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f18003bb0 0x7f2f18003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:15.919 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f23fff640 1 -- 172.21.15.31:0/374006807 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f18003530 con 0x7f2f180047d0 2023-11-27T17:59:15.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f2ad9d640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f2c06dfd0 0x7f2f18005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:59:15.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f2a59c640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f18003bb0 0x7f2f18003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-27T17:59:15.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.884+0000 7f2f23fff640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f180047d0 0x7f2f18004c50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c06e3d0 tx=0x7f2f1401cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c52b84a04398f48 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:59:15.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f140a5bb0 con 0x7f2f180047d0 2023-11-27T17:59:15.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f140a5d10 con 0x7f2f180047d0 2023-11-27T17:59:15.920 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f29d9b640 1 -- 172.21.15.31:0/374006807 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14005be0 con 0x7f2f180047d0 2023-11-27T17:59:15.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 -- 172.21.15.31:0/374006807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f180047d0 msgr2=0x7f2f18004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:15.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 --2- 172.21.15.31:0/374006807 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f180047d0 0x7f2f18004c50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c06e3d0 tx=0x7f2f1401cb70 comp rx=0 tx=0).stop 2023-11-27T17:59:15.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f2ad9d640 1 -- 172.21.15.31:0/374006807 reap_dead start 2023-11-27T17:59:15.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 -- 172.21.15.31:0/374006807 shutdown_connections 2023-11-27T17:59:15.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 -- 172.21.15.31:0/374006807 >> 172.21.15.31:0/374006807 conn(0x7f2f2c0b9f60 msgr2=0x7f2f2c0ba370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:59:15.921 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 -- 172.21.15.31:0/374006807 shutdown_connections 2023-11-27T17:59:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 -- 172.21.15.31:0/374006807 wait complete. 2023-11-27T17:59:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 Processor -- start 2023-11-27T17:59:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 -- start start 2023-11-27T17:59:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f180047d0 0x7f2f2c09ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c070770 0x7f2f2c1dfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c139cb0 0x7f2f2c139180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:15.922 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c070e90 con 0x7f2f2c139cb0 2023-11-27T17:59:15.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c09efb0 con 0x7f2f2c070770 2023-11-27T17:59:15.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c072aa0 con 0x7f2f180047d0 2023-11-27T17:59:15.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f2ad9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c139cb0 0x7f2f2c139180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:15.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f2ad9d640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c139cb0 0x7f2f2c139180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44918/0 (socket says 172.21.15.31:44918) 2023-11-27T17:59:15.923 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f2ad9d640 1 -- 172.21.15.31:0/2899784508 learned_addr learned my addr 172.21.15.31:0/2899784508 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:59:15.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f2a59c640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f180047d0 0x7f2f2c09ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:15.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f23fff640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c070770 0x7f2f2c1dfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:15.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f2ad9d640 1 -- 172.21.15.31:0/2899784508 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f180047d0 msgr2=0x7f2f2c09ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:15.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f2ad9d640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f180047d0 0x7f2f2c09ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:15.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f2ad9d640 1 -- 172.21.15.31:0/2899784508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c070770 msgr2=0x7f2f2c1dfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:15.924 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f2ad9d640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c070770 0x7f2f2c1dfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:15.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f2ad9d640 1 -- 172.21.15.31:0/2899784508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c06fc90 con 0x7f2f2c139cb0 2023-11-27T17:59:15.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f23fff640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c070770 0x7f2f2c1dfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:59:15.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f2a59c640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f180047d0 0x7f2f2c09ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:59:15.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f2ad9d640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c139cb0 0x7f2f2c139180 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c09d050 tx=0x7f2f2400b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:59:15.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f22ffd640 1 -- 172.21.15.31:0/2899784508 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2400b8d0 con 0x7f2f2c139cb0 2023-11-27T17:59:15.925 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f22ffd640 1 -- 172.21.15.31:0/2899784508 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2400ba30 con 0x7f2f2c139cb0 2023-11-27T17:59:15.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 -- 172.21.15.31:0/2899784508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c06ff70 con 0x7f2f2c139cb0 2023-11-27T17:59:15.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f22ffd640 1 -- 172.21.15.31:0/2899784508 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2400bde0 con 0x7f2f2c139cb0 2023-11-27T17:59:15.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.888+0000 7f2f30cfe640 1 -- 172.21.15.31:0/2899784508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c1dffc0 con 0x7f2f2c139cb0 2023-11-27T17:59:15.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.892+0000 7f2f30cfe640 1 -- 172.21.15.31:0/2899784508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c04e850 con 0x7f2f2c139cb0 2023-11-27T17:59:15.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.892+0000 7f2f22ffd640 1 -- 172.21.15.31:0/2899784508 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f2f24007070 con 0x7f2f2c139cb0 2023-11-27T17:59:15.926 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.892+0000 7f2f22ffd640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2f0c0667f0 0x7f2f0c068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:15.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.892+0000 7f2f22ffd640 1 -- 172.21.15.31:0/2899784508 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f240845b0 con 0x7f2f2c139cb0 2023-11-27T17:59:15.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.892+0000 7f2f2a59c640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2f0c0667f0 0x7f2f0c068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:15.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.892+0000 7f2f2a59c640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2f0c0667f0 0x7f2f0c068cb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0079b0 tx=0x7f2f1c007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:59:15.927 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:15.896+0000 7f2f22ffd640 1 -- 172.21.15.31:0/2899784508 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f2f240516b0 con 0x7f2f2c139cb0 2023-11-27T17:59:16.114 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.108+0000 7f2f30cfe640 1 -- 172.21.15.31:0/2899784508 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2f2c070420 con 0x7f2f2c139cb0 2023-11-27T17:59:16.115 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f22ffd640 1 -- 172.21.15.31:0/2899784508 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1277 (secure 0 0 0) 0x7f2f24054cd0 con 0x7f2f2c139cb0 2023-11-27T17:59:16.115 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-11-27T17:59:16.115 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":1,"fsid":"d7e0ec54-b878-4521-a03f-3b848cceedea","modified":"2023-11-27T17:52:18.491503Z","created":"2023-11-27T17:52:18.491503Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:3300","nonce":0},{"type":"v1","addr":"172.21.15.31:6789","nonce":0}]},"addr":"172.21.15.31:6789/0","public_addr":"172.21.15.31:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3301","nonce":0},{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-27T17:59:16.116 INFO:teuthology.orchestra.run.smithi031.stderr:dumped monmap epoch 1 2023-11-27T17:59:16.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f30cfe640 1 -- 172.21.15.31:0/2899784508 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2f0c0667f0 msgr2=0x7f2f0c068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:16.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f30cfe640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2f0c0667f0 0x7f2f0c068cb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0079b0 tx=0x7f2f1c007920 comp rx=0 tx=0).stop 2023-11-27T17:59:16.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f30cfe640 1 -- 172.21.15.31:0/2899784508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c139cb0 msgr2=0x7f2f2c139180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:16.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f30cfe640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c139cb0 0x7f2f2c139180 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c09d050 tx=0x7f2f2400b0d0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.117 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f30cfe640 1 -- 172.21.15.31:0/2899784508 shutdown_connections 2023-11-27T17:59:16.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f30cfe640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f2f0c0667f0 0x7f2f0c068cb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f30cfe640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f2c139cb0 0x7f2f2c139180 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f30cfe640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c070770 0x7f2f2c1dfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f30cfe640 1 --2- 172.21.15.31:0/2899784508 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f2f180047d0 0x7f2f2c09ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f30cfe640 1 -- 172.21.15.31:0/2899784508 >> 172.21.15.31:0/2899784508 conn(0x7f2f2c0b9f60 msgr2=0x7f2f2c0a1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:59:16.118 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f30cfe640 1 -- 172.21.15.31:0/2899784508 shutdown_connections 2023-11-27T17:59:16.119 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.112+0000 7f2f30cfe640 1 -- 172.21.15.31:0/2899784508 wait complete. 2023-11-27T17:59:16.133 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-11-27T17:59:16.255 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e2bf9640 1 Processor -- start 2023-11-27T17:59:16.256 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e2bf9640 1 -- start start 2023-11-27T17:59:16.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e2bf9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f29dc14b6b0 0x7f29dc14bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:16.258 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e2bf9640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc06bc80 con 0x7f29dc070c90 2023-11-27T17:59:16.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e2bf9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc14c060 con 0x7f29dc145650 2023-11-27T17:59:16.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e2bf9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc071bb0 con 0x7f29dc14b6b0 2023-11-27T17:59:16.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29dbfff640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f29dc070c90 0x7f29dc06b570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42092/0 (socket says 172.21.15.31:42092) 2023-11-27T17:59:16.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29dbfff640 1 -- 172.21.15.31:0/2085909242 learned_addr learned my addr 172.21.15.31:0/2085909242 (peer_addr_for_me v1:172.21.15.31:0/0) 2023-11-27T17:59:16.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e1196640 1 --2- 172.21.15.31:0/2085909242 >> v2:172.21.15.81:3300/0 conn(0x7f29dc14b6b0 0x7f29dc14bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:16.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792859076 0 0) 0x7f29dc06bc80 con 0x7f29dc070c90 2023-11-27T17:59:16.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29c4003530 con 0x7f29dc070c90 2023-11-27T17:59:16.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 <== mon.1 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251829734 0 0) 0x7f29dc14c060 con 0x7f29dc145650 2023-11-27T17:59:16.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29dc06bc80 con 0x7f29dc145650 2023-11-27T17:59:16.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3114593822 0 0) 0x7f29c4003530 con 0x7f29dc070c90 2023-11-27T17:59:16.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 >> v2:172.21.15.81:3300/0 conn(0x7f29dc14b6b0 msgr2=0x7f29dc14bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:59:16.259 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 --2- 172.21.15.31:0/2085909242 >> v2:172.21.15.81:3300/0 conn(0x7f29dc14b6b0 0x7f29dc14bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 >> v1:172.21.15.81:6789/0 conn(0x7f29dc145650 legacy=0x7f29dc06fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:16.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc145a30 con 0x7f29dc070c90 2023-11-27T17:59:16.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1396312490 0 0) 0x7f29d0001680 con 0x7f29dc070c90 2023-11-27T17:59:16.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e1196640 1 --2- 172.21.15.31:0/2085909242 >> v2:172.21.15.81:3300/0 conn(0x7f29dc14b6b0 0x7f29dc14bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-27T17:59:16.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 >> v1:172.21.15.31:6789/0 conn(0x7f29dc070c90 legacy=0x7f29dc06b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:16.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 --2- 172.21.15.31:0/2085909242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 0x7f29c4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:16.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 --2- 172.21.15.31:0/2085909242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29c40047d0 0x7f29c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:16.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 --2- 172.21.15.31:0/2085909242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29c40051e0 0x7f29c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:16.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c400c100 con 0x7f29c4003b80 2023-11-27T17:59:16.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c400c270 con 0x7f29c40051e0 2023-11-27T17:59:16.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c400c430 con 0x7f29c40047d0 2023-11-27T17:59:16.260 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e0995640 1 --2- 172.21.15.31:0/2085909242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 0x7f29c4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:16.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e1196640 1 --2- 172.21.15.31:0/2085909242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29c40051e0 0x7f29c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:16.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29dbfff640 1 --2- 172.21.15.31:0/2085909242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29c40047d0 0x7f29c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:16.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e0995640 1 -- 172.21.15.31:0/2085909242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29c40047d0 msgr2=0x7f29c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:59:16.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e0995640 1 --2- 172.21.15.31:0/2085909242 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29c40047d0 0x7f29c4004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e0995640 1 -- 172.21.15.31:0/2085909242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29c40051e0 msgr2=0x7f29c400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-27T17:59:16.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e0995640 1 --2- 172.21.15.31:0/2085909242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29c40051e0 0x7f29c400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e1196640 1 -- 172.21.15.31:0/2085909242 reap_dead start 2023-11-27T17:59:16.261 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.252+0000 7f29e0995640 1 -- 172.21.15.31:0/2085909242 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c4003530 con 0x7f29c4003b80 2023-11-27T17:59:16.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29e0995640 1 --2- 172.21.15.31:0/2085909242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 0x7f29c4003f80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f29d4007fd0 tx=0x7f29d401c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a0e12fa9bfc069 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:59:16.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4003b80 con 0x7f29c4003b80 2023-11-27T17:59:16.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d4003d00 con 0x7f29c4003b80 2023-11-27T17:59:16.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29db7fe640 1 -- 172.21.15.31:0/2085909242 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4005310 con 0x7f29c4003b80 2023-11-27T17:59:16.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29e2bf9640 1 -- 172.21.15.31:0/2085909242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 msgr2=0x7f29c4003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:16.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29e2bf9640 1 --2- 172.21.15.31:0/2085909242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 0x7f29c4003f80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f29d4007fd0 tx=0x7f29d401c810 comp rx=0 tx=0).stop 2023-11-27T17:59:16.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29e2bf9640 1 -- 172.21.15.31:0/2085909242 shutdown_connections 2023-11-27T17:59:16.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29e2bf9640 1 --2- 172.21.15.31:0/2085909242 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 0x7f29c4003f80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.264 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29e2bf9640 1 -- 172.21.15.31:0/2085909242 >> 172.21.15.31:0/2085909242 conn(0x7f29dc0b9dc0 msgr2=0x7f29dc0ba1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:59:16.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29e2bf9640 1 -- 172.21.15.31:0/2085909242 shutdown_connections 2023-11-27T17:59:16.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29e2bf9640 1 -- 172.21.15.31:0/2085909242 wait complete. 2023-11-27T17:59:16.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29e2bf9640 1 Processor -- start 2023-11-27T17:59:16.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.256+0000 7f29e2bf9640 1 -- start start 2023-11-27T17:59:16.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e2bf9640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 0x7f29dc142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:16.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e2bf9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29dc0b5340 0x7f29dc1da060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:16.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e2bf9640 1 --2- >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29dc0b57a0 0x7f29dc1e4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:16.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e2bf9640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0b4f20 con 0x7f29c4003b80 2023-11-27T17:59:16.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e2bf9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc1e56d0 con 0x7f29dc0b5340 2023-11-27T17:59:16.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e2bf9640 1 -- --> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc1426c0 con 0x7f29dc0b57a0 2023-11-27T17:59:16.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e0995640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 0x7f29dc142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:16.265 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e0995640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 0x7f29dc142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44940/0 (socket says 172.21.15.31:44940) 2023-11-27T17:59:16.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e0995640 1 -- 172.21.15.31:0/724508602 learned_addr learned my addr 172.21.15.31:0/724508602 (peer_addr_for_me v2:172.21.15.31:0/0) 2023-11-27T17:59:16.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e1196640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29dc0b57a0 0x7f29dc1e4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:16.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29dbfff640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29dc0b5340 0x7f29dc1da060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:16.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e0995640 1 -- 172.21.15.31:0/724508602 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29dc0b57a0 msgr2=0x7f29dc1e4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:16.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e0995640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29dc0b57a0 0x7f29dc1e4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e0995640 1 -- 172.21.15.31:0/724508602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29dc0b5340 msgr2=0x7f29dc1da060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:16.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e0995640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29dc0b5340 0x7f29dc1da060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e0995640 1 -- 172.21.15.31:0/724508602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc14bed0 con 0x7f29c4003b80 2023-11-27T17:59:16.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29dbfff640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29dc0b5340 0x7f29dc1da060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:59:16.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e1196640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29dc0b57a0 0x7f29dc1e4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-27T17:59:16.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e0995640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 0x7f29dc142180 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f29d401c640 tx=0x7f29c4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:59:16.266 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29d97fa640 1 -- 172.21.15.31:0/724508602 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d40b5070 con 0x7f29c4003b80 2023-11-27T17:59:16.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29d97fa640 1 -- 172.21.15.31:0/724508602 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d4003e70 con 0x7f29c4003b80 2023-11-27T17:59:16.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e2bf9640 1 -- 172.21.15.31:0/724508602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc0b4860 con 0x7f29c4003b80 2023-11-27T17:59:16.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29d97fa640 1 -- 172.21.15.31:0/724508602 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4003980 con 0x7f29c4003b80 2023-11-27T17:59:16.267 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e2bf9640 1 -- 172.21.15.31:0/724508602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc0b6440 con 0x7f29c4003b80 2023-11-27T17:59:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29e2bf9640 1 -- 172.21.15.31:0/724508602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29dc04e850 con 0x7f29c4003b80 2023-11-27T17:59:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29d97fa640 1 -- 172.21.15.31:0/724508602 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) v1 ==== 85991+0+0 (secure 0 0 0) 0x7f29d4006b60 con 0x7f29c4003b80 2023-11-27T17:59:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29d97fa640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f29c80667f0 0x7f29c8068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-27T17:59:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29d97fa640 1 -- 172.21.15.31:0/724508602 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29d411e2d0 con 0x7f29c4003b80 2023-11-27T17:59:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29dbfff640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f29c80667f0 0x7f29c8068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-27T17:59:16.268 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.260+0000 7f29dbfff640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f29c80667f0 0x7f29c8068cb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0b6280 tx=0x7f29d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-27T17:59:16.269 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.264+0000 7f29d97fa640 1 -- 172.21.15.31:0/724508602 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172655 (secure 0 0 0) 0x7f29d40eb3d0 con 0x7f29c4003b80 2023-11-27T17:59:16.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.476+0000 7f29e2bf9640 1 -- 172.21.15.31:0/724508602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f29dc0b7790 con 0x7f29c4003b80 2023-11-27T17:59:16.481 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.476+0000 7f29d97fa640 1 -- 172.21.15.31:0/724508602 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v9) v1 ==== 92+0+63 (secure 0 0 0) 0x7f29d40ee9f0 con 0x7f29c4003b80 2023-11-27T17:59:16.481 INFO:teuthology.orchestra.run.smithi031.stdout:[client.admin] 2023-11-27T17:59:16.482 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBS12RlWiRfKBAARLbvO/ZW3NBv6Trdj6bXGw== 2023-11-27T17:59:16.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.480+0000 7f29e2bf9640 1 -- 172.21.15.31:0/724508602 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f29c80667f0 msgr2=0x7f29c8068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:16.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.480+0000 7f29e2bf9640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f29c80667f0 0x7f29c8068cb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0b6280 tx=0x7f29d0009040 comp rx=0 tx=0).stop 2023-11-27T17:59:16.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.480+0000 7f29e2bf9640 1 -- 172.21.15.31:0/724508602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 msgr2=0x7f29dc142180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-27T17:59:16.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.480+0000 7f29e2bf9640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 0x7f29dc142180 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f29d401c640 tx=0x7f29c4005800 comp rx=0 tx=0).stop 2023-11-27T17:59:16.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.480+0000 7f29e2bf9640 1 -- 172.21.15.31:0/724508602 shutdown_connections 2023-11-27T17:59:16.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.480+0000 7f29e2bf9640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.31:6832/1886714170,v1:172.21.15.31:6833/1886714170] conn(0x7f29c80667f0 0x7f29c8068cb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.480+0000 7f29e2bf9640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.81:3301/0,v1:172.21.15.81:6790/0] conn(0x7f29dc0b57a0 0x7f29dc1e4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.480+0000 7f29e2bf9640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29dc0b5340 0x7f29dc1da060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.480+0000 7f29e2bf9640 1 --2- 172.21.15.31:0/724508602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f29c4003b80 0x7f29dc142180 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-27T17:59:16.484 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.480+0000 7f29e2bf9640 1 -- 172.21.15.31:0/724508602 >> 172.21.15.31:0/724508602 conn(0x7f29dc0b9dc0 msgr2=0x7f29dc0bb930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-27T17:59:16.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.480+0000 7f29e2bf9640 1 -- 172.21.15.31:0/724508602 shutdown_connections 2023-11-27T17:59:16.485 INFO:teuthology.orchestra.run.smithi031.stderr:2023-11-27T17:59:16.480+0000 7f29e2bf9640 1 -- 172.21.15.31:0/724508602 wait complete. 2023-11-27T17:59:16.499 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-27T17:59:16.499 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/tmp/tmp.jkmd5q6IvPxfstests-dev/local.config 2023-11-27T17:59:16.521 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.31:6789:/test export TEST_DIR=/tmp/tmp.DS4YhDEjUCtest export SCRATCH_DEV=172.21.15.31:6789:/scratch export SCRATCH_MNT=/tmp/tmp.6yd4yFmSwtscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQBS12RlWiRfKBAARLbvO/ZW3NBv6Trdj6bXGw==,test_dummy_encryption" 2023-11-27T17:59:16.521 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-11-27T17:59:16.521 DEBUG:teuthology.orchestra.run.smithi176:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.jkmd5q6IvPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-11-27T17:59:18.280 INFO:teuthology.orchestra.run.smithi176.stdout:FSTYP -- ceph 2023-11-27T17:59:18.290 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM -- Linux/x86_64 smithi176 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-27T17:59:18.292 INFO:teuthology.orchestra.run.smithi176.stdout:MKFS_OPTIONS -- 172.21.15.31:6789:/scratch 2023-11-27T17:59:18.294 INFO:teuthology.orchestra.run.smithi176.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQBS12RlWiRfKBAARLbvO/ZW3NBv6Trdj6bXGw==,test_dummy_encryption 172.21.15.31:6789:/scratch /tmp/tmp.6yd4yFmSwtscratch 2023-11-27T17:59:18.294 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-27T17:59:18.425 INFO:teuthology.orchestra.run.smithi176.stdout:ceph/001 [expunged] 2023-11-27T17:59:18.785 INFO:teuthology.orchestra.run.smithi176.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-27T17:59:19.129 INFO:teuthology.orchestra.run.smithi176.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-27T17:59:19.566 INFO:teuthology.orchestra.run.smithi176.stdout:ceph/004 0s 2023-11-27T17:59:19.881 INFO:teuthology.orchestra.run.smithi176.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-27T17:59:29.532 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:59:29.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:59:29.536 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:59:29.856 INFO:teuthology.orchestra.run.smithi176.stdout:generic/001 10s 2023-11-27T17:59:30.542 INFO:teuthology.orchestra.run.smithi176.stdout:generic/002 1s 2023-11-27T17:59:30.853 INFO:teuthology.orchestra.run.smithi176.stdout:generic/003 [not run] atime not maintained by ceph 2023-11-27T17:59:31.146 INFO:teuthology.orchestra.run.smithi176.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-11-27T17:59:31.884 INFO:teuthology.orchestra.run.smithi176.stdout:generic/005 0s 2023-11-27T17:59:59.851 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:59:59.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T17:59:59.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:00:13.257 INFO:teuthology.orchestra.run.smithi176.stdout:generic/006 42s 2023-11-27T18:00:30.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:00:30.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:00:30.186 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:01:00.540 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:01:00.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:01:00.546 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:01:30.612 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:01:30.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:01:30.618 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:01:40.620 INFO:teuthology.orchestra.run.smithi176.stdout:generic/007 87s 2023-11-27T18:01:42.499 INFO:teuthology.orchestra.run.smithi176.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-27T18:01:44.689 INFO:teuthology.orchestra.run.smithi176.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-27T18:02:00.675 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:02:00.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:02:00.681 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:02:30.928 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:02:30.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:02:30.934 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:02:38.466 INFO:teuthology.orchestra.run.smithi176.stdout:generic/011 54s 2023-11-27T18:02:46.187 INFO:teuthology.orchestra.run.smithi176.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:03:00.994 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:03:00.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:03:00.998 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:03:29.512 INFO:teuthology.orchestra.run.smithi176.stdout:generic/013 49s 2023-11-27T18:03:31.378 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:03:31.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:03:31.382 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:04:01.434 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:04:01.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:04:01.438 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:04:31.785 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:04:34.494 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:04:34.496 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:05:04.559 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:05:04.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:05:04.564 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:05:34.640 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:05:34.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:05:34.645 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:06:04.905 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:06:04.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:06:04.910 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:06:13.326 INFO:teuthology.orchestra.run.smithi176.stdout:generic/014 164s 2023-11-27T18:06:13.623 INFO:teuthology.orchestra.run.smithi176.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:06:21.143 INFO:teuthology.orchestra.run.smithi176.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:06:28.000 INFO:teuthology.orchestra.run.smithi176.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-11-27T18:06:28.000 INFO:teuthology.orchestra.run.smithi176.stdout:generic/020 6s 2023-11-27T18:06:31.886 INFO:teuthology.orchestra.run.smithi176.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:06:35.109 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:06:35.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:06:35.114 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:06:37.946 INFO:teuthology.orchestra.run.smithi176.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:06:40.010 INFO:teuthology.orchestra.run.smithi176.stdout:generic/023 2s 2023-11-27T18:06:40.370 INFO:teuthology.orchestra.run.smithi176.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-11-27T18:06:40.707 INFO:teuthology.orchestra.run.smithi176.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-11-27T18:06:41.060 INFO:teuthology.orchestra.run.smithi176.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-11-27T18:06:46.420 INFO:teuthology.orchestra.run.smithi176.stdout:generic/028 5s 2023-11-27T18:06:47.745 INFO:teuthology.orchestra.run.smithi176.stdout:generic/029 1s 2023-11-27T18:06:58.958 INFO:teuthology.orchestra.run.smithi176.stdout:generic/030 11s 2023-11-27T18:07:04.619 INFO:teuthology.orchestra.run.smithi176.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-27T18:07:04.936 INFO:teuthology.orchestra.run.smithi176.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:07:05.170 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:07:05.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:07:05.177 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:07:09.314 INFO:teuthology.orchestra.run.smithi176.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-27T18:07:09.622 INFO:teuthology.orchestra.run.smithi176.stdout:generic/034 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:07:10.052 INFO:teuthology.orchestra.run.smithi176.stdout:generic/035 1s 2023-11-27T18:07:17.431 INFO:teuthology.orchestra.run.smithi176.stdout:generic/037 7s 2023-11-27T18:07:17.814 INFO:teuthology.orchestra.run.smithi176.stdout:generic/039 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:07:18.178 INFO:teuthology.orchestra.run.smithi176.stdout:generic/040 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:07:18.526 INFO:teuthology.orchestra.run.smithi176.stdout:generic/041 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:07:18.936 INFO:teuthology.orchestra.run.smithi176.stdout:generic/042 [not run] ceph does not support shutdown 2023-11-27T18:07:19.365 INFO:teuthology.orchestra.run.smithi176.stdout:generic/050 [not run] ceph does not support shutdown 2023-11-27T18:07:19.770 INFO:teuthology.orchestra.run.smithi176.stdout:generic/052 [not run] ceph does not support shutdown 2023-11-27T18:07:20.773 INFO:teuthology.orchestra.run.smithi176.stdout:generic/053 1s 2023-11-27T18:07:21.151 INFO:teuthology.orchestra.run.smithi176.stdout:generic/056 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:07:21.503 INFO:teuthology.orchestra.run.smithi176.stdout:generic/057 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:07:26.402 INFO:teuthology.orchestra.run.smithi176.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:07:26.714 INFO:teuthology.orchestra.run.smithi176.stdout:generic/059 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:07:35.239 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:07:35.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:07:35.249 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:07:36.547 INFO:teuthology.orchestra.run.smithi176.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:07:43.896 INFO:teuthology.orchestra.run.smithi176.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:07:46.462 INFO:teuthology.orchestra.run.smithi176.stdout:generic/062 3s 2023-11-27T18:07:51.683 INFO:teuthology.orchestra.run.smithi176.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:07:52.038 INFO:teuthology.orchestra.run.smithi176.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T18:07:52.379 INFO:teuthology.orchestra.run.smithi176.stdout:generic/065 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:07:52.719 INFO:teuthology.orchestra.run.smithi176.stdout:generic/066 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:07:53.042 INFO:teuthology.orchestra.run.smithi176.stdout:generic/067 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:08:05.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:08:05.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:08:05.310 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:08:17.709 INFO:teuthology.orchestra.run.smithi176.stdout:generic/069 24s 2023-11-27T18:08:35.377 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:08:35.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:08:35.384 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:08:35.404 INFO:tasks.ceph.mds.c.smithi031.stderr:2023-11-27T18:08:35.399+0000 7fac59cc1640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48546) UID: 0 2023-11-27T18:08:35.404 INFO:tasks.ceph.mds.a.smithi031.stderr:2023-11-27T18:08:35.399+0000 7f8e5bf09640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48546) UID: 0 2023-11-27T18:08:46.516 INFO:teuthology.orchestra.run.smithi176.stdout:generic/070 29s 2023-11-27T18:08:46.824 INFO:teuthology.orchestra.run.smithi176.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T18:08:47.143 INFO:teuthology.orchestra.run.smithi176.stdout:generic/073 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:09:34.882 INFO:teuthology.orchestra.run.smithi176.stdout:generic/075 47s 2023-11-27T18:09:35.476 INFO:teuthology.orchestra.run.smithi176.stdout:generic/076 [not run] require 172.21.15.31:6789:/scratch to be local device 2023-11-27T18:09:35.508 INFO:teuthology.orchestra.run.smithi176.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-11-27T18:09:35.818 INFO:teuthology.orchestra.run.smithi176.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-11-27T18:09:38.220 INFO:teuthology.orchestra.run.smithi176.stdout:generic/080 3s 2023-11-27T18:09:38.603 INFO:teuthology.orchestra.run.smithi176.stdout:generic/081 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:09:38.908 INFO:teuthology.orchestra.run.smithi176.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:09:44.790 INFO:teuthology.orchestra.run.smithi176.stdout:generic/084 6s 2023-11-27T18:09:45.140 INFO:teuthology.orchestra.run.smithi176.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:09:45.560 INFO:teuthology.orchestra.run.smithi176.stdout:generic/087 0s 2023-11-27T18:09:45.901 INFO:teuthology.orchestra.run.smithi176.stdout:generic/088 0s 2023-11-27T18:09:46.235 INFO:teuthology.orchestra.run.smithi176.stdout:generic/090 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:11:12.444 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:11:12.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:11:12.449 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:11:42.519 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:11:42.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:11:42.527 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:12:12.582 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:12:12.590 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:12:12.593 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:12:26.311 INFO:teuthology.orchestra.run.smithi176.stdout:generic/091 160s 2023-11-27T18:12:26.610 INFO:teuthology.orchestra.run.smithi176.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:12:26.993 INFO:teuthology.orchestra.run.smithi176.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T18:12:33.526 INFO:teuthology.orchestra.run.smithi176.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-27T18:12:34.233 INFO:teuthology.orchestra.run.smithi176.stdout:generic/097 1s 2023-11-27T18:12:35.390 INFO:teuthology.orchestra.run.smithi176.stdout:generic/098 1s 2023-11-27T18:12:37.173 INFO:teuthology.orchestra.run.smithi176.stdout:generic/099 2s 2023-11-27T18:12:37.528 INFO:teuthology.orchestra.run.smithi176.stdout:generic/101 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:12:37.870 INFO:teuthology.orchestra.run.smithi176.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:12:38.219 INFO:teuthology.orchestra.run.smithi176.stdout:generic/104 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:12:39.120 INFO:teuthology.orchestra.run.smithi176.stdout:generic/105 1s 2023-11-27T18:12:39.535 INFO:teuthology.orchestra.run.smithi176.stdout:generic/106 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:12:39.864 INFO:teuthology.orchestra.run.smithi176.stdout:generic/107 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:12:40.428 INFO:teuthology.orchestra.run.smithi176.stdout:generic/108 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:12:40.775 INFO:teuthology.orchestra.run.smithi176.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:12:41.126 INFO:teuthology.orchestra.run.smithi176.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:12:42.657 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:12:42.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:12:42.662 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:12.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:12.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:12.719 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:42.924 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:42.927 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:42.930 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:13:49.062 INFO:teuthology.orchestra.run.smithi176.stdout:generic/112 68s 2023-11-27T18:14:13.093 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:14:13.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:14:13.099 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:14:43.158 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:14:43.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:14:43.162 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:13.280 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:13.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:13.286 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:43.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:43.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:43.599 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:15:57.356 INFO:teuthology.orchestra.run.smithi176.stdout:generic/113 128s 2023-11-27T18:15:57.782 INFO:teuthology.orchestra.run.smithi176.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-11-27T18:15:58.140 INFO:teuthology.orchestra.run.smithi176.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:15:58.474 INFO:teuthology.orchestra.run.smithi176.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:16:12.279 INFO:teuthology.orchestra.run.smithi176.stdout:generic/117 14s 2023-11-27T18:16:12.701 INFO:teuthology.orchestra.run.smithi176.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:16:13.047 INFO:teuthology.orchestra.run.smithi176.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:16:13.350 INFO:teuthology.orchestra.run.smithi176.stdout:generic/120 [not run] atime not maintained by ceph 2023-11-27T18:16:13.655 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:13.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:13.661 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:13.705 INFO:teuthology.orchestra.run.smithi176.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T18:16:14.074 INFO:teuthology.orchestra.run.smithi176.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T18:16:14.794 INFO:teuthology.orchestra.run.smithi176.stdout:generic/123 0s 2023-11-27T18:16:43.737 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:43.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:16:43.741 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:00.243 INFO:teuthology.orchestra.run.smithi176.stdout:generic/124 46s 2023-11-27T18:17:00.868 INFO:teuthology.orchestra.run.smithi176.stdout:generic/126 0s 2023-11-27T18:17:02.309 INFO:teuthology.orchestra.run.smithi176.stdout:generic/128 2s 2023-11-27T18:17:13.819 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:13.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:13.824 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:43.930 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:43.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:17:43.934 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:14.261 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:16.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:16.956 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:47.257 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:47.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:18:47.262 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:17.311 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:17.314 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:17.316 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:47.375 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:47.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:19:47.380 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:17.852 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:17.855 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:17.858 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:47.917 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:47.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:20:47.922 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:18.127 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:18.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:18.131 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:48.493 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:48.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:21:48.502 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:18.572 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:18.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:18.577 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:48.652 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:48.654 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:22:48.656 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:19.038 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:19.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:19.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:49.356 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:49.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:23:49.360 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:19.926 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:19.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:19.931 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:50.278 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:50.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:24:50.282 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:20.376 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:20.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:20.381 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:50.725 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:50.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:25:50.731 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:21.174 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:21.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:21.183 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:51.371 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:51.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:26:51.375 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:27:21.819 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:27:21.824 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:27:21.826 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:27:52.843 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:27:52.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:27:52.850 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:23.082 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:23.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:23.089 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:53.322 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:53.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:28:53.359 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:23.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:23.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:23.786 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:53.926 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:53.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:29:53.931 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:24.150 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:28.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:28.185 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:58.273 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:58.275 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:30:58.277 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:28.383 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:28.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:28.389 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:58.501 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:58.504 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:31:58.505 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:28.616 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:28.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:28.620 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:58.899 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:58.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:32:58.904 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:28.982 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:28.989 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:28.995 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:59.078 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:59.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:33:59.082 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:34:29.350 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:34:29.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:34:29.360 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:34:59.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:34:59.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:34:59.485 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:35:29.766 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:35:29.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:35:29.783 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:35:59.894 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:35:59.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:35:59.898 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:36:30.067 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:36:30.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:36:30.075 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:00.237 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:00.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:00.247 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:30.329 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:30.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:37:30.333 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:00.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:00.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:00.497 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:30.660 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:30.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:38:30.669 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:00.785 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:00.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:00.794 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:39:00.880 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-11-27T18:39:00.876+0000 7f38deaed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44795) UID: 0 2023-11-27T18:39:00.881 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-11-27T18:39:00.876+0000 7fbfa6f09640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44795) UID: 0 2023-11-27T18:39:00.881 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-11-27T18:39:00.876+0000 7f22c238f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44795) UID: 0 2023-11-27T18:39:00.883 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-11-27T18:39:00.876+0000 7f7f7fed0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44795) UID: 0 2023-11-27T18:40:01.666 INFO:teuthology.orchestra.run.smithi176.stdout:generic/129 1379s 2023-11-27T18:40:21.927 INFO:teuthology.orchestra.run.smithi176.stdout:generic/130 20s 2023-11-27T18:40:23.542 INFO:teuthology.orchestra.run.smithi176.stdout:generic/131 2s 2023-11-27T18:40:23.884 INFO:teuthology.orchestra.run.smithi176.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:25.674 INFO:teuthology.orchestra.run.smithi176.stdout:generic/135 2s 2023-11-27T18:40:26.091 INFO:teuthology.orchestra.run.smithi176.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T18:40:26.441 INFO:teuthology.orchestra.run.smithi176.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:26.795 INFO:teuthology.orchestra.run.smithi176.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:27.128 INFO:teuthology.orchestra.run.smithi176.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:29.366 INFO:teuthology.orchestra.run.smithi176.stdout:generic/141 2s 2023-11-27T18:40:29.780 INFO:teuthology.orchestra.run.smithi176.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:30.139 INFO:teuthology.orchestra.run.smithi176.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:30.493 INFO:teuthology.orchestra.run.smithi176.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:30.837 INFO:teuthology.orchestra.run.smithi176.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:31.177 INFO:teuthology.orchestra.run.smithi176.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:31.514 INFO:teuthology.orchestra.run.smithi176.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:31.872 INFO:teuthology.orchestra.run.smithi176.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:32.231 INFO:teuthology.orchestra.run.smithi176.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:32.606 INFO:teuthology.orchestra.run.smithi176.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:32.944 INFO:teuthology.orchestra.run.smithi176.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:33.301 INFO:teuthology.orchestra.run.smithi176.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:33.666 INFO:teuthology.orchestra.run.smithi176.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:33.998 INFO:teuthology.orchestra.run.smithi176.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:34.350 INFO:teuthology.orchestra.run.smithi176.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:34.724 INFO:teuthology.orchestra.run.smithi176.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:35.071 INFO:teuthology.orchestra.run.smithi176.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:35.454 INFO:teuthology.orchestra.run.smithi176.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T18:40:35.762 INFO:teuthology.orchestra.run.smithi176.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-11-27T18:40:36.100 INFO:teuthology.orchestra.run.smithi176.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-11-27T18:40:36.747 INFO:teuthology.orchestra.run.smithi176.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:40:37.234 INFO:teuthology.orchestra.run.smithi176.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-27T18:40:37.935 INFO:teuthology.orchestra.run.smithi176.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-27T18:40:39.277 INFO:teuthology.orchestra.run.smithi176.stdout:generic/169 1s 2023-11-27T18:40:40.022 INFO:teuthology.orchestra.run.smithi176.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:40:40.690 INFO:teuthology.orchestra.run.smithi176.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:40:41.284 INFO:teuthology.orchestra.run.smithi176.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:40:41.979 INFO:teuthology.orchestra.run.smithi176.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:40:52.428 INFO:teuthology.orchestra.run.smithi176.stdout:generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:40:52.809 INFO:teuthology.orchestra.run.smithi176.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:53.155 INFO:teuthology.orchestra.run.smithi176.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:53.504 INFO:teuthology.orchestra.run.smithi176.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:53.892 INFO:teuthology.orchestra.run.smithi176.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:40:54.224 INFO:teuthology.orchestra.run.smithi176.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T18:40:54.891 INFO:teuthology.orchestra.run.smithi176.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:40:55.221 INFO:teuthology.orchestra.run.smithi176.stdout:generic/184 1s 2023-11-27T18:40:55.960 INFO:teuthology.orchestra.run.smithi176.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:40:56.675 INFO:teuthology.orchestra.run.smithi176.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:40:57.331 INFO:teuthology.orchestra.run.smithi176.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:40:58.024 INFO:teuthology.orchestra.run.smithi176.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:40:58.719 INFO:teuthology.orchestra.run.smithi176.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:41:00.187 INFO:teuthology.orchestra.run.smithi176.stdout:generic/193 2s 2023-11-27T18:41:04.343 INFO:teuthology.orchestra.run.smithi176.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:41:04.343 INFO:teuthology.orchestra.run.smithi176.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:41:04.343 INFO:teuthology.orchestra.run.smithi176.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:41:04.343 INFO:teuthology.orchestra.run.smithi176.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:41:36.537 INFO:teuthology.orchestra.run.smithi176.stdout:generic/198 34s 2023-11-27T18:41:37.234 INFO:teuthology.orchestra.run.smithi176.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:41:37.857 INFO:teuthology.orchestra.run.smithi176.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:41:38.491 INFO:teuthology.orchestra.run.smithi176.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:41:39.184 INFO:teuthology.orchestra.run.smithi176.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:41:39.909 INFO:teuthology.orchestra.run.smithi176.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:41:40.618 INFO:teuthology.orchestra.run.smithi176.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:41:41.235 INFO:teuthology.orchestra.run.smithi176.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:42:20.423 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:42:20.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:42:20.429 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:42:20.449 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-11-27T18:42:20.445+0000 7f38deaed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44806) UID: 0 2023-11-27T18:42:20.449 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-11-27T18:42:20.445+0000 7fbfa6f09640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44806) UID: 0 2023-11-27T18:42:20.450 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-11-27T18:42:20.445+0000 7f22c238f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44806) UID: 0 2023-11-27T18:42:20.450 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-11-27T18:42:20.445+0000 7f7f7fed0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44806) UID: 0 2023-11-27T18:42:20.457 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-11-27T18:42:20.456+0000 7efc10321640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48745) UID: 0 2023-11-27T18:42:20.457 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-11-27T18:42:20.456+0000 7f62de24c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48745) UID: 0 2023-11-27T18:42:20.458 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-11-27T18:42:20.456+0000 7f021b928640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48745) UID: 0 2023-11-27T18:42:20.458 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-11-27T18:42:20.456+0000 7f984fdcf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48745) UID: 0 2023-11-27T18:42:20.957 INFO:teuthology.orchestra.run.smithi176.stdout:generic/207 39s 2023-11-27T18:42:21.517 INFO:teuthology.orchestra.run.smithi176.stdout:generic/210 1s 2023-11-27T18:42:22.404 INFO:teuthology.orchestra.run.smithi176.stdout:generic/211 1s 2023-11-27T18:42:22.907 INFO:teuthology.orchestra.run.smithi176.stdout:generic/212 0s 2023-11-27T18:42:23.231 INFO:teuthology.orchestra.run.smithi176.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:42:23.565 INFO:teuthology.orchestra.run.smithi176.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:42:25.942 INFO:teuthology.orchestra.run.smithi176.stdout:generic/215 2s 2023-11-27T18:42:26.615 INFO:teuthology.orchestra.run.smithi176.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:42:27.359 INFO:teuthology.orchestra.run.smithi176.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:42:28.034 INFO:teuthology.orchestra.run.smithi176.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:42:28.362 INFO:teuthology.orchestra.run.smithi176.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:42:28.997 INFO:teuthology.orchestra.run.smithi176.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:42:30.329 INFO:teuthology.orchestra.run.smithi176.stdout:generic/221 1s 2023-11-27T18:42:30.992 INFO:teuthology.orchestra.run.smithi176.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:42:31.284 INFO:teuthology.orchestra.run.smithi176.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:42:31.734 INFO:teuthology.orchestra.run.smithi176.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-27T18:42:32.361 INFO:teuthology.orchestra.run.smithi176.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:42:32.770 INFO:teuthology.orchestra.run.smithi176.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:42:33.399 INFO:teuthology.orchestra.run.smithi176.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:42:33.703 INFO:teuthology.orchestra.run.smithi176.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:42:34.007 INFO:teuthology.orchestra.run.smithi176.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:42:35.478 INFO:teuthology.orchestra.run.smithi176.stdout:generic/236 1s 2023-11-27T18:42:35.918 INFO:teuthology.orchestra.run.smithi176.stdout:generic/237 0s 2023-11-27T18:42:36.617 INFO:teuthology.orchestra.run.smithi176.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:42:56.587 INFO:teuthology.orchestra.run.smithi176.stdout:generic/240 20s 2023-11-27T18:42:56.865 INFO:teuthology.orchestra.run.smithi176.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:42:57.323 INFO:teuthology.orchestra.run.smithi176.stdout:generic/245 1s 2023-11-27T18:42:57.666 INFO:teuthology.orchestra.run.smithi176.stdout:generic/246 0s 2023-11-27T18:45:46.409 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:45:46.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:45:46.414 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:46:16.549 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:46:16.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:46:16.555 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:46:46.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:46:46.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:46:46.669 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:46:46.712 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-11-27T18:46:46.708+0000 7f62de24c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48765) UID: 0 2023-11-27T18:46:46.713 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-11-27T18:46:46.708+0000 7efc10321640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48765) UID: 0 2023-11-27T18:46:46.713 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-11-27T18:46:46.712+0000 7f021b928640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48765) UID: 0 2023-11-27T18:46:46.713 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-11-27T18:46:46.712+0000 7f984fdcf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48765) UID: 0 2023-11-27T18:46:46.763 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-11-27T18:46:46.760+0000 7f7f7fed0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44827) UID: 0 2023-11-27T18:46:46.763 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-11-27T18:46:46.760+0000 7f22c238f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44827) UID: 0 2023-11-27T18:46:46.764 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-11-27T18:46:46.760+0000 7fbfa6f09640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44827) UID: 0 2023-11-27T18:46:46.764 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-11-27T18:46:46.760+0000 7f38deaed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44827) UID: 0 2023-11-27T18:48:57.642 INFO:teuthology.orchestra.run.smithi176.stdout:generic/247 360s 2023-11-27T18:48:58.033 INFO:teuthology.orchestra.run.smithi176.stdout:generic/248 1s 2023-11-27T18:49:31.953 INFO:teuthology.orchestra.run.smithi176.stdout:generic/249 33s 2023-11-27T18:49:40.167 INFO:teuthology.orchestra.run.smithi176.stdout:generic/250 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:49:40.167 INFO:teuthology.orchestra.run.smithi176.stdout:generic/252 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:49:40.167 INFO:teuthology.orchestra.run.smithi176.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:40.168 INFO:teuthology.orchestra.run.smithi176.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:44.798 INFO:teuthology.orchestra.run.smithi176.stdout:generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:49:54.733 INFO:teuthology.orchestra.run.smithi176.stdout:generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:49:56.040 INFO:teuthology.orchestra.run.smithi176.stdout:generic/257 2s 2023-11-27T18:49:56.348 INFO:teuthology.orchestra.run.smithi176.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-11-27T18:49:57.065 INFO:teuthology.orchestra.run.smithi176.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:57.525 INFO:teuthology.orchestra.run.smithi176.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.6yd4yFmSwtscratch 2023-11-27T18:49:58.200 INFO:teuthology.orchestra.run.smithi176.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:49:58.798 INFO:teuthology.orchestra.run.smithi176.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:50:13.950 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:50:13.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:50:13.956 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:50:44.214 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:50:44.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:50:44.220 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:51:14.385 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:51:14.388 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:51:14.390 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:51:44.450 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:51:44.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:51:44.455 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:52:14.819 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:52:14.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:52:14.825 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:52:31.431 INFO:teuthology.orchestra.run.smithi176.stdout:generic/263 153s 2023-11-27T18:52:32.248 INFO:teuthology.orchestra.run.smithi176.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:32.975 INFO:teuthology.orchestra.run.smithi176.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:33.698 INFO:teuthology.orchestra.run.smithi176.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:34.408 INFO:teuthology.orchestra.run.smithi176.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:35.142 INFO:teuthology.orchestra.run.smithi176.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:35.819 INFO:teuthology.orchestra.run.smithi176.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:36.528 INFO:teuthology.orchestra.run.smithi176.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:37.243 INFO:teuthology.orchestra.run.smithi176.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:37.600 INFO:teuthology.orchestra.run.smithi176.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-11-27T18:52:38.310 INFO:teuthology.orchestra.run.smithi176.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:39.011 INFO:teuthology.orchestra.run.smithi176.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:39.668 INFO:teuthology.orchestra.run.smithi176.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:40.328 INFO:teuthology.orchestra.run.smithi176.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:40.987 INFO:teuthology.orchestra.run.smithi176.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:41.661 INFO:teuthology.orchestra.run.smithi176.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:41.994 INFO:teuthology.orchestra.run.smithi176.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:52:42.714 INFO:teuthology.orchestra.run.smithi176.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:43.127 INFO:teuthology.orchestra.run.smithi176.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.6yd4yFmSwtscratch 2023-11-27T18:52:43.852 INFO:teuthology.orchestra.run.smithi176.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:44.604 INFO:teuthology.orchestra.run.smithi176.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:45.100 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:52:45.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:52:45.105 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:52:45.212 INFO:teuthology.orchestra.run.smithi176.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:45.885 INFO:teuthology.orchestra.run.smithi176.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:46.532 INFO:teuthology.orchestra.run.smithi176.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:47.319 INFO:teuthology.orchestra.run.smithi176.stdout:generic/294 1s 2023-11-27T18:52:48.054 INFO:teuthology.orchestra.run.smithi176.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:48.746 INFO:teuthology.orchestra.run.smithi176.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:49.505 INFO:teuthology.orchestra.run.smithi176.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:50.231 INFO:teuthology.orchestra.run.smithi176.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:50.623 INFO:teuthology.orchestra.run.smithi176.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:52:50.978 INFO:teuthology.orchestra.run.smithi176.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T18:52:51.689 INFO:teuthology.orchestra.run.smithi176.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:52:52.427 INFO:teuthology.orchestra.run.smithi176.stdout:generic/306 1s 2023-11-27T18:52:54.572 INFO:teuthology.orchestra.run.smithi176.stdout:generic/307 2s 2023-11-27T18:52:54.974 INFO:teuthology.orchestra.run.smithi176.stdout:generic/308 0s 2023-11-27T18:52:56.383 INFO:teuthology.orchestra.run.smithi176.stdout:generic/309 2s 2023-11-27T18:52:56.689 INFO:teuthology.orchestra.run.smithi176.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:53:01.129 INFO:teuthology.orchestra.run.smithi176.stdout:generic/313 5s 2023-11-27T18:53:01.789 INFO:teuthology.orchestra.run.smithi176.stdout:generic/314 0s 2023-11-27T18:53:02.122 INFO:teuthology.orchestra.run.smithi176.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T18:53:12.387 INFO:teuthology.orchestra.run.smithi176.stdout:generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:53:13.652 INFO:teuthology.orchestra.run.smithi176.stdout:generic/317 1s 2023-11-27T18:53:14.528 INFO:teuthology.orchestra.run.smithi176.stdout:generic/318 1s 2023-11-27T18:53:15.158 INFO:teuthology.orchestra.run.smithi176.stdout:generic/319 1s 2023-11-27T18:53:15.164 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:53:15.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:53:15.169 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:53:15.540 INFO:teuthology.orchestra.run.smithi176.stdout:generic/321 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:53:15.839 INFO:teuthology.orchestra.run.smithi176.stdout:generic/322 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:53:16.136 INFO:teuthology.orchestra.run.smithi176.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-11-27T18:53:16.464 INFO:teuthology.orchestra.run.smithi176.stdout:generic/325 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:53:17.243 INFO:teuthology.orchestra.run.smithi176.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:53:17.851 INFO:teuthology.orchestra.run.smithi176.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:53:18.479 INFO:teuthology.orchestra.run.smithi176.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:53:19.192 INFO:teuthology.orchestra.run.smithi176.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:53:19.885 INFO:teuthology.orchestra.run.smithi176.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:53:20.513 INFO:teuthology.orchestra.run.smithi176.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:53:21.238 INFO:teuthology.orchestra.run.smithi176.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:53:21.558 INFO:teuthology.orchestra.run.smithi176.stdout:generic/335 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:53:21.914 INFO:teuthology.orchestra.run.smithi176.stdout:generic/336 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:53:22.796 INFO:teuthology.orchestra.run.smithi176.stdout:generic/337 1s 2023-11-27T18:53:23.177 INFO:teuthology.orchestra.run.smithi176.stdout:generic/338 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:53:23.522 INFO:teuthology.orchestra.run.smithi176.stdout:generic/341 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:53:23.866 INFO:teuthology.orchestra.run.smithi176.stdout:generic/342 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:53:24.234 INFO:teuthology.orchestra.run.smithi176.stdout:generic/343 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:53:45.316 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:53:45.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:53:45.320 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:54:15.438 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:54:15.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:54:15.443 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:54:45.537 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:54:45.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:54:45.542 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:55:15.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:55:15.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:55:15.702 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:55:46.162 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:55:46.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:55:46.166 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:56:16.334 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:56:16.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:56:16.340 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:56:46.529 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:56:46.531 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:56:46.533 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:57:07.609 INFO:teuthology.orchestra.run.smithi176.stdout:generic/346 223s 2023-11-27T18:57:08.043 INFO:teuthology.orchestra.run.smithi176.stdout:generic/347 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:57:08.410 INFO:teuthology.orchestra.run.smithi176.stdout:generic/348 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:57:09.073 INFO:teuthology.orchestra.run.smithi176.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:57:10.051 INFO:teuthology.orchestra.run.smithi176.stdout:generic/355 1s 2023-11-27T18:57:10.665 INFO:teuthology.orchestra.run.smithi176.stdout:generic/356 [not run] swapfiles are not supported 2023-11-27T18:57:11.256 INFO:teuthology.orchestra.run.smithi176.stdout:generic/357 [not run] swapfiles are not supported 2023-11-27T18:57:11.927 INFO:teuthology.orchestra.run.smithi176.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:57:12.546 INFO:teuthology.orchestra.run.smithi176.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:57:12.895 INFO:teuthology.orchestra.run.smithi176.stdout:generic/360 0s 2023-11-27T18:57:13.203 INFO:teuthology.orchestra.run.smithi176.stdout:generic/361 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:57:13.512 INFO:teuthology.orchestra.run.smithi176.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T18:57:13.847 INFO:teuthology.orchestra.run.smithi176.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T18:57:14.157 INFO:teuthology.orchestra.run.smithi176.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T18:57:14.462 INFO:teuthology.orchestra.run.smithi176.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T18:57:14.782 INFO:teuthology.orchestra.run.smithi176.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T18:57:15.087 INFO:teuthology.orchestra.run.smithi176.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T18:57:15.503 INFO:teuthology.orchestra.run.smithi176.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T18:57:15.778 INFO:teuthology.orchestra.run.smithi176.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T18:57:16.103 INFO:teuthology.orchestra.run.smithi176.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-27T18:57:16.398 INFO:teuthology.orchestra.run.smithi176.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:57:16.627 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:57:16.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:57:16.633 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:57:17.108 INFO:teuthology.orchestra.run.smithi176.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:57:17.728 INFO:teuthology.orchestra.run.smithi176.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:57:18.243 INFO:teuthology.orchestra.run.smithi176.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-27T18:57:18.872 INFO:teuthology.orchestra.run.smithi176.stdout:generic/375 0s 2023-11-27T18:57:19.202 INFO:teuthology.orchestra.run.smithi176.stdout:generic/376 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:57:20.049 INFO:teuthology.orchestra.run.smithi176.stdout:generic/377 1s 2023-11-27T18:57:20.735 INFO:teuthology.orchestra.run.smithi176.stdout:generic/378 0s 2023-11-27T18:57:21.072 INFO:teuthology.orchestra.run.smithi176.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:57:21.370 INFO:teuthology.orchestra.run.smithi176.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:57:21.664 INFO:teuthology.orchestra.run.smithi176.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:57:21.953 INFO:teuthology.orchestra.run.smithi176.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:57:22.243 INFO:teuthology.orchestra.run.smithi176.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:57:22.549 INFO:teuthology.orchestra.run.smithi176.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:57:22.847 INFO:teuthology.orchestra.run.smithi176.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:57:23.147 INFO:teuthology.orchestra.run.smithi176.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:57:23.471 INFO:teuthology.orchestra.run.smithi176.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-11-27T18:57:23.779 INFO:teuthology.orchestra.run.smithi176.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:57:24.217 INFO:teuthology.orchestra.run.smithi176.stdout:generic/392 [not run] ceph does not support shutdown 2023-11-27T18:57:25.653 INFO:teuthology.orchestra.run.smithi176.stdout:generic/393 1s 2023-11-27T18:57:26.075 INFO:teuthology.orchestra.run.smithi176.stdout:generic/394 1s 2023-11-27T18:57:26.470 INFO:teuthology.orchestra.run.smithi176.stdout:generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-27T18:57:26.874 INFO:teuthology.orchestra.run.smithi176.stdout:generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-27T18:57:27.289 INFO:teuthology.orchestra.run.smithi176.stdout:generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-27T18:57:27.695 INFO:teuthology.orchestra.run.smithi176.stdout:generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-27T18:57:27.991 INFO:teuthology.orchestra.run.smithi176.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T18:57:28.856 INFO:teuthology.orchestra.run.smithi176.stdout:generic/401 0s 2023-11-27T18:57:29.404 INFO:teuthology.orchestra.run.smithi176.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-11-27T18:57:30.605 INFO:teuthology.orchestra.run.smithi176.stdout:generic/403 1s 2023-11-27T18:57:31.001 INFO:teuthology.orchestra.run.smithi176.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:57:34.098 INFO:teuthology.orchestra.run.smithi176.stdout:generic/406 3s 2023-11-27T18:57:34.588 INFO:teuthology.orchestra.run.smithi176.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T18:57:34.958 INFO:teuthology.orchestra.run.smithi176.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T18:57:35.272 INFO:teuthology.orchestra.run.smithi176.stdout:generic/409 [not run] require 172.21.15.31:6789:/scratch to be local device 2023-11-27T18:57:35.580 INFO:teuthology.orchestra.run.smithi176.stdout:generic/410 [not run] require 172.21.15.31:6789:/scratch to be local device 2023-11-27T18:57:35.914 INFO:teuthology.orchestra.run.smithi176.stdout:generic/411 [not run] require 172.21.15.31:6789:/scratch to be local device 2023-11-27T18:57:37.099 INFO:teuthology.orchestra.run.smithi176.stdout:generic/412 2s 2023-11-27T18:57:37.575 INFO:teuthology.orchestra.run.smithi176.stdout:generic/413 [not run] mount 172.21.15.31:6789:/scratch with dax failed 2023-11-27T18:57:38.219 INFO:teuthology.orchestra.run.smithi176.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:57:38.660 INFO:teuthology.orchestra.run.smithi176.stdout:generic/417 [not run] ceph does not support shutdown 2023-11-27T18:57:39.051 INFO:teuthology.orchestra.run.smithi176.stdout:generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-27T18:57:46.009 INFO:teuthology.orchestra.run.smithi176.stdout:generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:57:46.399 INFO:teuthology.orchestra.run.smithi176.stdout:generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-27T18:57:46.707 INFO:teuthology.orchestra.run.smithi176.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T18:57:46.742 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:57:46.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:57:46.748 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:57:47.200 INFO:teuthology.orchestra.run.smithi176.stdout:generic/423 1s 2023-11-27T18:57:47.511 INFO:teuthology.orchestra.run.smithi176.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-11-27T18:57:47.886 INFO:teuthology.orchestra.run.smithi176.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-11-27T18:58:16.824 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:58:16.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:58:16.830 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:58:19.987 INFO:teuthology.orchestra.run.smithi176.stdout:generic/426 32s 2023-11-27T18:58:20.861 INFO:teuthology.orchestra.run.smithi176.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:58:21.213 INFO:teuthology.orchestra.run.smithi176.stdout:generic/428 1s 2023-11-27T18:58:21.700 INFO:teuthology.orchestra.run.smithi176.stdout:generic/430 0s 2023-11-27T18:58:22.141 INFO:teuthology.orchestra.run.smithi176.stdout:generic/431 1s 2023-11-27T18:58:22.591 INFO:teuthology.orchestra.run.smithi176.stdout:generic/432 0s 2023-11-27T18:58:23.005 INFO:teuthology.orchestra.run.smithi176.stdout:generic/433 0s 2023-11-27T18:58:23.443 INFO:teuthology.orchestra.run.smithi176.stdout:generic/434 0s 2023-11-27T18:58:24.223 INFO:teuthology.orchestra.run.smithi176.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:58:25.327 INFO:teuthology.orchestra.run.smithi176.stdout:generic/437 1s 2023-11-27T18:58:35.271 INFO:teuthology.orchestra.run.smithi176.stdout:generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:58:35.677 INFO:teuthology.orchestra.run.smithi176.stdout:generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-27T18:58:36.026 INFO:teuthology.orchestra.run.smithi176.stdout:generic/441 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T18:58:36.372 INFO:teuthology.orchestra.run.smithi176.stdout:generic/443 0s 2023-11-27T18:58:36.787 INFO:teuthology.orchestra.run.smithi176.stdout:generic/444 0s 2023-11-27T18:58:37.488 INFO:teuthology.orchestra.run.smithi176.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:58:47.547 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:58:47.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:58:47.555 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:58:48.144 INFO:teuthology.orchestra.run.smithi176.stdout:generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-27T18:58:49.286 INFO:teuthology.orchestra.run.smithi176.stdout:generic/448 1s 2023-11-27T18:58:49.653 INFO:teuthology.orchestra.run.smithi176.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T18:58:58.034 INFO:teuthology.orchestra.run.smithi176.stdout:generic/450 9s 2023-11-27T18:59:17.619 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:59:17.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:59:17.625 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:59:28.599 INFO:teuthology.orchestra.run.smithi176.stdout:generic/451 30s 2023-11-27T18:59:30.343 INFO:teuthology.orchestra.run.smithi176.stdout:generic/452 2s 2023-11-27T18:59:30.692 INFO:teuthology.orchestra.run.smithi176.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-11-27T18:59:31.015 INFO:teuthology.orchestra.run.smithi176.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-11-27T18:59:31.365 INFO:teuthology.orchestra.run.smithi176.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T18:59:32.039 INFO:teuthology.orchestra.run.smithi176.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T18:59:47.996 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:59:47.999 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T18:59:48.001 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:00:18.065 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:00:22.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:00:22.586 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:00:52.675 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:00:52.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:00:52.680 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:01:23.060 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:01:23.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:01:23.065 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:01:53.676 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:01:53.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:01:53.682 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:02:23.750 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:02:23.752 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:02:23.754 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:02:23.810 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-11-27T19:02:23.808+0000 7efc10321640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48862) UID: 0 2023-11-27T19:02:23.811 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-11-27T19:02:23.808+0000 7f62de24c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48862) UID: 0 2023-11-27T19:02:23.811 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-11-27T19:02:23.808+0000 7f021b928640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48862) UID: 0 2023-11-27T19:02:23.811 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-11-27T19:02:23.808+0000 7f984fdcf640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48862) UID: 0 2023-11-27T19:04:41.324 INFO:teuthology.orchestra.run.smithi176.stdout:generic/460 309s 2023-11-27T19:04:41.787 INFO:teuthology.orchestra.run.smithi176.stdout:generic/462 [not run] mount 172.21.15.31:6789:/scratch with dax failed 2023-11-27T19:04:42.195 INFO:teuthology.orchestra.run.smithi176.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-11-27T19:04:48.754 INFO:teuthology.orchestra.run.smithi176.stdout:generic/465 6s 2023-11-27T19:04:49.084 INFO:teuthology.orchestra.run.smithi176.stdout:generic/466 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:04:52.736 INFO:teuthology.orchestra.run.smithi176.stdout:generic/467 3s 2023-11-27T19:04:54.454 INFO:teuthology.orchestra.run.smithi176.stdout:generic/468 [not run] ceph does not support shutdown 2023-11-27T19:04:54.819 INFO:teuthology.orchestra.run.smithi176.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T19:04:55.177 INFO:teuthology.orchestra.run.smithi176.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-11-27T19:05:22.813 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:05:22.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:05:22.819 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:05:52.146 INFO:teuthology.orchestra.run.smithi176.stdout:generic/471 57s 2023-11-27T19:05:53.046 INFO:teuthology.orchestra.run.smithi176.stdout:generic/472 [not run] swapfiles are not supported 2023-11-27T19:05:53.117 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:05:53.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:05:53.123 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:05:53.488 INFO:teuthology.orchestra.run.smithi176.stdout:generic/474 [not run] ceph does not support shutdown 2023-11-27T19:06:00.528 INFO:teuthology.orchestra.run.smithi176.stdout:generic/477 7s 2023-11-27T19:06:12.067 INFO:teuthology.orchestra.run.smithi176.stdout:generic/478 12s 2023-11-27T19:06:12.458 INFO:teuthology.orchestra.run.smithi176.stdout:generic/479 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:06:12.825 INFO:teuthology.orchestra.run.smithi176.stdout:generic/480 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:06:13.165 INFO:teuthology.orchestra.run.smithi176.stdout:generic/481 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:06:13.496 INFO:teuthology.orchestra.run.smithi176.stdout:generic/483 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:06:13.828 INFO:teuthology.orchestra.run.smithi176.stdout:generic/484 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:06:14.141 INFO:teuthology.orchestra.run.smithi176.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T19:06:15.767 INFO:teuthology.orchestra.run.smithi176.stdout:generic/486 1s 2023-11-27T19:06:16.143 INFO:teuthology.orchestra.run.smithi176.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-11-27T19:06:16.465 INFO:teuthology.orchestra.run.smithi176.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-27T19:06:16.806 INFO:teuthology.orchestra.run.smithi176.stdout:generic/489 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:06:17.897 INFO:teuthology.orchestra.run.smithi176.stdout:generic/490 1s 2023-11-27T19:06:18.234 INFO:teuthology.orchestra.run.smithi176.stdout:generic/491 [not run] ceph does not support freezing 2023-11-27T19:06:18.554 INFO:teuthology.orchestra.run.smithi176.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-11-27T19:06:19.165 INFO:teuthology.orchestra.run.smithi176.stdout:generic/493 [not run] swapfiles are not supported 2023-11-27T19:06:19.730 INFO:teuthology.orchestra.run.smithi176.stdout:generic/494 [not run] swapfiles are not supported 2023-11-27T19:06:20.288 INFO:teuthology.orchestra.run.smithi176.stdout:generic/495 [not run] swapfiles are not supported 2023-11-27T19:06:20.848 INFO:teuthology.orchestra.run.smithi176.stdout:generic/496 [not run] swapfiles are not supported 2023-11-27T19:06:21.448 INFO:teuthology.orchestra.run.smithi176.stdout:generic/497 [not run] swapfiles are not supported 2023-11-27T19:06:21.776 INFO:teuthology.orchestra.run.smithi176.stdout:generic/498 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:06:22.096 INFO:teuthology.orchestra.run.smithi176.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T19:06:22.790 INFO:teuthology.orchestra.run.smithi176.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:06:23.134 INFO:teuthology.orchestra.run.smithi176.stdout:generic/502 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:06:23.464 INFO:teuthology.orchestra.run.smithi176.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T19:06:23.503 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:06:23.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:06:23.508 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:06:23.868 INFO:teuthology.orchestra.run.smithi176.stdout:generic/504 0s 2023-11-27T19:06:24.326 INFO:teuthology.orchestra.run.smithi176.stdout:generic/505 [not run] ceph does not support shutdown 2023-11-27T19:06:24.641 INFO:teuthology.orchestra.run.smithi176.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-27T19:06:24.965 INFO:teuthology.orchestra.run.smithi176.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-11-27T19:06:25.289 INFO:teuthology.orchestra.run.smithi176.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-11-27T19:06:25.624 INFO:teuthology.orchestra.run.smithi176.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-11-27T19:06:25.961 INFO:teuthology.orchestra.run.smithi176.stdout:generic/510 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:06:26.273 INFO:teuthology.orchestra.run.smithi176.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-27T19:06:26.587 INFO:teuthology.orchestra.run.smithi176.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-27T19:06:27.319 INFO:teuthology.orchestra.run.smithi176.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:06:27.963 INFO:teuthology.orchestra.run.smithi176.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:06:28.606 INFO:teuthology.orchestra.run.smithi176.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:06:28.945 INFO:teuthology.orchestra.run.smithi176.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-27T19:06:29.422 INFO:teuthology.orchestra.run.smithi176.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-27T19:06:30.185 INFO:teuthology.orchestra.run.smithi176.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-27T19:06:30.511 INFO:teuthology.orchestra.run.smithi176.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-11-27T19:06:30.857 INFO:teuthology.orchestra.run.smithi176.stdout:generic/520 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:06:31.755 INFO:teuthology.orchestra.run.smithi176.stdout:generic/523 1s 2023-11-27T19:06:53.949 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:06:53.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:06:53.953 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:07:24.306 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:07:24.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:07:24.312 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:07:54.382 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:07:54.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:07:54.388 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:08:24.554 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:08:24.557 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:08:24.559 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:08:54.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:08:54.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:08:54.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:09:24.725 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:09:24.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:09:24.733 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:09:54.849 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:09:54.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:09:54.854 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:10:19.575 INFO:teuthology.orchestra.run.smithi176.stdout:generic/524 228s 2023-11-27T19:10:20.117 INFO:teuthology.orchestra.run.smithi176.stdout:generic/525 [not run] filesystem does not support huge file size 2023-11-27T19:10:20.517 INFO:teuthology.orchestra.run.smithi176.stdout:generic/526 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:10:20.857 INFO:teuthology.orchestra.run.smithi176.stdout:generic/527 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:10:21.302 INFO:teuthology.orchestra.run.smithi176.stdout:generic/528 1s 2023-11-27T19:10:22.194 INFO:teuthology.orchestra.run.smithi176.stdout:generic/529 1s 2023-11-27T19:10:22.692 INFO:teuthology.orchestra.run.smithi176.stdout:generic/530 [not run] ceph does not support shutdown 2023-11-27T19:10:22.994 INFO:teuthology.orchestra.run.smithi176.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-11-27T19:10:23.402 INFO:teuthology.orchestra.run.smithi176.stdout:generic/532 0s 2023-11-27T19:10:24.347 INFO:teuthology.orchestra.run.smithi176.stdout:generic/533 1s 2023-11-27T19:10:24.677 INFO:teuthology.orchestra.run.smithi176.stdout:generic/534 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:10:25.006 INFO:teuthology.orchestra.run.smithi176.stdout:generic/535 [not run] require 172.21.15.31:6789:/scratch to be valid block disk 2023-11-27T19:10:25.204 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:10:25.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:10:25.209 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:10:25.435 INFO:teuthology.orchestra.run.smithi176.stdout:generic/536 [not run] ceph does not support shutdown 2023-11-27T19:10:25.875 INFO:teuthology.orchestra.run.smithi176.stdout:generic/537 [not run] FSTRIM not supported 2023-11-27T19:10:55.353 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:10:55.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:10:55.361 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:11:25.520 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:11:25.523 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:11:25.526 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:11:55.581 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:11:55.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:11:55.588 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:12:25.654 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:12:25.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:12:25.660 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:12:55.791 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:12:55.794 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:12:55.796 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:13:25.846 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:13:25.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:13:25.852 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:13:55.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:13:55.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:13:55.946 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:14:25.998 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:14:26.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:14:26.004 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:14:56.079 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:14:56.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:14:56.085 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:15:26.134 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:15:26.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:15:26.139 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:15:56.414 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:15:56.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:15:56.420 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:16:26.512 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:16:26.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:16:26.520 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:16:56.585 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:16:56.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:16:56.591 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:17:26.645 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:17:26.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:17:26.650 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:17:56.735 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:17:56.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:17:56.740 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:18:26.983 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:18:26.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:18:26.988 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:18:57.042 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:18:57.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:18:57.051 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:19:27.141 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:19:27.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:19:27.147 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:19:57.263 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:19:57.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:19:57.269 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:20:27.403 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:20:27.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:20:27.408 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:20:27.427 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-11-27T19:20:27.422+0000 7f38deaed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45028) UID: 0 2023-11-27T19:20:27.427 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-11-27T19:20:27.422+0000 7fbfa6f09640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45028) UID: 0 2023-11-27T19:20:27.428 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-11-27T19:20:27.422+0000 7f7f7fed0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45028) UID: 0 2023-11-27T19:20:27.428 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-11-27T19:20:27.422+0000 7f22c238f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45028) UID: 0 2023-11-27T19:22:47.349 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:22:47.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:22:47.355 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:23:17.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:23:17.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:23:17.599 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:23:47.659 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:23:47.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:23:47.669 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:24:17.750 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:24:17.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:24:17.755 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:24:47.847 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:24:47.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:24:47.853 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:25:17.910 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:25:17.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:25:17.916 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:25:47.974 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:25:47.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:25:47.979 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:26:18.296 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:26:18.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:26:18.302 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:26:48.369 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:26:48.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:26:48.374 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:27:18.615 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:27:18.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:27:18.621 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:27:48.682 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:27:48.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:27:48.687 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:28:18.768 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:28:18.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:28:18.773 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:28:48.864 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:28:48.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:28:48.869 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:29:18.978 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:29:18.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:29:18.984 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:29:49.125 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:29:49.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:29:49.130 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:30:19.290 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:30:19.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:30:19.296 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:30:49.363 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:30:50.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:30:50.927 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:31:21.068 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:31:21.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:31:21.074 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:31:51.175 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:31:51.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:31:51.180 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:32:21.280 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:32:21.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:32:21.286 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:32:51.420 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:32:51.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:32:51.426 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:33:21.543 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:33:21.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:33:21.549 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:33:51.641 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:33:51.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:33:51.646 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:34:21.763 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:34:21.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:34:21.768 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:34:51.878 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:34:51.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:34:51.883 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:35:21.992 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:35:21.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:35:21.998 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:35:52.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:35:52.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:35:52.049 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:36:22.120 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:36:22.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:36:22.126 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:36:52.202 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:36:52.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:36:52.207 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:37:22.325 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:37:22.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:37:22.331 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:37:52.440 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:37:52.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:37:52.446 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:38:22.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:38:22.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:38:22.823 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:38:52.888 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:38:52.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:38:52.907 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:39:22.970 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:39:22.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:39:22.975 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:39:53.318 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:39:53.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:39:53.324 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:40:23.431 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:40:23.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:40:23.436 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:40:53.494 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:40:53.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:40:53.500 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:41:23.691 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:41:23.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:41:23.697 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:41:53.746 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:41:53.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:41:53.752 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:42:24.062 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:42:24.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:42:24.068 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:42:54.281 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:42:54.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:42:54.287 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:43:24.365 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:43:24.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:43:24.372 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:43:54.454 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:43:54.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:43:54.460 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:44:24.585 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:44:24.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:44:24.591 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:44:54.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:44:54.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:44:54.705 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:45:25.031 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:45:25.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:45:25.037 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:45:55.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:45:55.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:45:55.097 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:46:25.259 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:46:25.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:46:25.265 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:46:55.660 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:46:55.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:46:55.666 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:47:25.724 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:47:25.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:47:25.730 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:47:55.830 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:47:55.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:47:55.835 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:48:25.898 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:48:26.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:48:26.193 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:48:56.243 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:48:56.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:48:56.248 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:49:26.588 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:49:26.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:49:26.595 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:49:57.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:49:57.014 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:49:57.017 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:50:27.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:50:27.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:50:27.100 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:50:57.198 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:50:57.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:50:57.204 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:51:27.331 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:51:27.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:51:27.336 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:51:57.599 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:51:57.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:51:57.605 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:52:27.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:52:27.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:52:27.670 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:52:57.757 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:52:58.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:52:58.320 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:53:28.367 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:53:28.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:53:28.373 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:53:58.469 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:53:58.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:53:58.477 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:54:28.576 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:54:28.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:54:28.583 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:54:58.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:54:58.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:54:58.671 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:55:28.906 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:55:28.909 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:55:28.911 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:55:59.044 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:55:59.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:55:59.072 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:56:29.217 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:56:29.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:56:29.223 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:56:59.306 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:56:59.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:56:59.312 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:57:29.419 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:57:29.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:57:29.425 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:57:59.484 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:57:59.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:57:59.489 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:58:29.567 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:58:29.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:58:29.572 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:58:59.656 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:58:59.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:58:59.662 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:59:29.770 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:59:29.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:59:29.776 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:59:59.878 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:59:59.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T19:59:59.883 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:00:29.991 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:00:29.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:00:29.997 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:01:00.106 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:01:00.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:01:00.111 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:01:30.214 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:01:30.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:01:30.219 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:02:00.359 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:02:00.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:02:00.368 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:02:30.449 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:02:30.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:02:30.454 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:03:00.547 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:03:00.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:03:00.552 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:03:30.668 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:03:33.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:03:33.782 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:04:03.967 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:04:03.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:04:03.973 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:04:34.028 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:04:34.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:04:34.035 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:05:04.601 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:05:04.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:05:04.606 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:05:34.741 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:05:34.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:05:34.869 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:06:04.918 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:06:04.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:06:04.923 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:06:35.047 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:06:35.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:06:35.053 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:07:05.106 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:07:05.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:07:05.112 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:07:35.254 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:07:35.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:07:35.259 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:08:05.335 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:08:05.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:08:05.341 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:08:35.440 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:08:35.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:08:35.445 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:09:05.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:09:07.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:09:07.009 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:09:37.120 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:09:37.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:09:37.125 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:10:07.174 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:10:07.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:10:07.181 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:10:37.545 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:10:37.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:10:37.551 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:11:07.625 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:11:07.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:11:07.631 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:11:37.778 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:11:37.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:11:37.783 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:12:07.900 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:12:07.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:12:07.905 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:12:38.025 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:12:38.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:12:38.032 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:13:08.129 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:13:08.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:13:08.135 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:13:38.186 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:13:38.189 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:13:38.191 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:14:08.325 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:14:08.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:14:08.331 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:14:38.431 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:14:38.434 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:14:38.437 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:15:08.562 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:15:08.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:15:08.567 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:15:38.668 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:15:38.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:15:38.673 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:16:08.730 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:16:08.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:16:08.735 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:16:38.805 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:16:38.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:16:38.810 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:17:08.941 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:17:08.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:17:08.946 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:17:39.077 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:17:39.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:17:39.082 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:18:09.160 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:18:13.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:18:13.368 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:18:43.488 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:18:43.492 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:18:43.495 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:19:13.543 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:19:13.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:19:13.549 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:19:43.659 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:19:43.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:19:43.664 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:20:13.725 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:20:13.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:20:13.731 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:20:43.863 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:20:43.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:20:43.869 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:21:13.985 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:21:13.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:21:13.993 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:21:44.133 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:21:44.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:21:44.140 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:22:14.289 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:22:14.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:22:14.295 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:22:44.602 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:22:44.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:22:44.608 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:23:14.676 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:23:14.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:23:14.682 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:23:44.780 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:23:44.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:23:44.790 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:24:14.918 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:24:14.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:24:14.924 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:24:45.040 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:24:45.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:24:45.046 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:25:15.137 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:25:15.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:25:15.143 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:25:45.273 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:25:45.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:25:45.279 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:26:15.323 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:26:15.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:26:15.328 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:26:45.478 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:26:45.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:26:45.484 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:27:15.535 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:27:15.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:27:15.540 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:27:45.698 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:27:45.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:27:45.704 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:28:15.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:28:15.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:28:15.777 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:28:45.869 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:28:45.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:28:45.875 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:29:15.983 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:29:15.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:29:15.989 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:29:46.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:29:46.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:29:46.128 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:30:16.308 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:30:16.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:30:16.313 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:30:46.839 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:30:46.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:30:46.845 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:31:16.898 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:31:16.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:31:16.904 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:31:47.098 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:31:47.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:31:47.103 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:32:17.164 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:32:17.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:32:17.170 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:32:47.267 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:32:47.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:32:47.273 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:33:17.374 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:33:17.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:33:17.380 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:33:47.481 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:33:47.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:33:47.487 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:34:17.603 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:34:17.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:34:17.608 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:34:47.726 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:34:47.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:34:47.732 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:35:17.855 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:35:17.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:35:17.861 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:35:48.121 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:35:48.124 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:35:48.126 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:36:18.184 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:36:18.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:36:18.190 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:36:48.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:36:53.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:36:53.934 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:37:24.002 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:37:24.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:37:24.008 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:37:54.132 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:37:54.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:37:54.137 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:38:24.271 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:38:24.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:38:24.277 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:38:54.343 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:38:54.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:38:54.348 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:39:24.456 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:39:24.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:39:24.462 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:39:54.562 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:39:54.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:39:54.568 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:24.676 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:24.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:24.682 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:54.799 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:54.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:40:54.805 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:41:24.906 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:41:24.909 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:41:24.911 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:41:55.070 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:41:55.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:41:55.076 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:42:25.193 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:42:30.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:42:30.427 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:00.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:00.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:00.502 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:30.605 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:30.608 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:43:30.610 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:44:00.840 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:44:00.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:44:00.845 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:44:31.195 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:44:31.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:44:31.200 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:45:01.266 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:45:01.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:45:01.272 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:45:31.362 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:45:31.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:45:31.368 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:01.477 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:01.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:01.482 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:31.532 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:31.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:46:31.598 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:47:01.731 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:47:01.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:47:01.737 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:47:31.846 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:47:31.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:47:31.852 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:48:01.961 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:48:01.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:48:01.967 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:48:32.075 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:48:32.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:48:32.081 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:49:02.122 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:49:02.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:49:02.128 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:49:32.284 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:49:32.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:49:32.290 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:50:02.334 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:50:04.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:50:04.916 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:50:35.024 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:50:35.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:50:35.030 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:51:05.074 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:51:05.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:51:05.080 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:51:35.188 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:51:35.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:51:35.193 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:05.327 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:05.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:05.332 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:35.415 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:35.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:52:35.422 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:53:05.505 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:53:05.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:53:05.510 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:53:35.626 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:53:35.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:53:35.632 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:05.743 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:05.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:05.748 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:35.803 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:35.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:54:35.809 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:05.871 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:05.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:05.877 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:36.056 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:36.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:55:36.062 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:06.119 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:06.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:06.125 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:36.207 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:36.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:56:36.213 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:06.290 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:06.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:06.295 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:36.344 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:36.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:57:36.349 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:58:06.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:58:06.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:58:06.447 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:58:36.606 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:58:36.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:58:36.611 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:59:06.784 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:59:06.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:59:06.790 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:59:16.709 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-11-27T20:59:36.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:59:36.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T20:59:36.848 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:00:06.942 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:00:06.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:00:06.947 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:00:37.039 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:00:37.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:00:37.045 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:01:07.171 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:01:07.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:01:07.176 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:01:37.285 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:01:37.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:01:37.291 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:02:07.668 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:02:07.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:02:07.674 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:02:37.733 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:02:37.737 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:02:37.740 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:07.815 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:07.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:07.820 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:37.893 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:37.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:03:37.899 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:08.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:08.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:08.023 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:38.106 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:38.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:04:38.111 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:08.236 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:08.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:08.241 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:38.351 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:38.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:05:38.357 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:08.410 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:08.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:08.416 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:38.522 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:38.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:06:38.527 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:08.593 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:08.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:08.599 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:38.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:38.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:07:38.706 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:08:08.807 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:08:08.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:08:08.813 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:08:38.921 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:08:38.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:08:38.926 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:09:09.045 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:09:09.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:09:09.051 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:09:39.184 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:09:39.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:09:39.190 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:09.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:09.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:09.320 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:39.446 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:39.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:10:39.452 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:09.493 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:09.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:09.499 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:39.617 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:39.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:11:39.623 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:12:09.689 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:12:09.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:12:09.694 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:12:39.734 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:12:39.737 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:12:39.740 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:09.844 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:09.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:09.850 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:39.966 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:39.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:13:39.972 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:14:10.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:14:10.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:14:10.078 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:14:40.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:14:40.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:14:40.185 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:15:10.276 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:15:10.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:15:10.282 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:15:40.374 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:15:40.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:15:40.380 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:10.438 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:10.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:10.444 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:40.646 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:40.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:16:40.651 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:10.743 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:10.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:10.748 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:40.814 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:40.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:17:40.820 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:10.903 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:10.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:10.909 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:41.145 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:41.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:18:41.150 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:11.259 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:11.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:11.265 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:41.375 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:41.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:19:41.380 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:11.458 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:11.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:11.464 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:41.536 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:41.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:20:41.542 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:21:11.634 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:21:11.637 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:21:11.639 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:21:41.765 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:21:41.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:21:41.772 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:22:12.013 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:22:12.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:22:12.018 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:22:42.085 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:22:42.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:22:42.090 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:23:12.250 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:23:12.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:23:12.256 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:23:42.312 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:23:42.315 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:23:42.317 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:24:12.413 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:24:12.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:24:12.418 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:24:42.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:24:42.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:24:42.512 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:25:12.880 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:25:12.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:25:12.886 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:25:43.182 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:25:43.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:25:43.187 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:26:13.246 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:26:13.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:26:13.252 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:26:43.344 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:26:43.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:26:43.351 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:13.427 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:13.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:13.433 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:43.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:43.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:27:43.485 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:13.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:13.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:13.570 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:43.662 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:43.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:28:43.667 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:13.768 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:13.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:13.774 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:43.908 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:43.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:29:43.914 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:30:14.022 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:30:14.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:30:14.028 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:30:44.080 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:30:44.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:30:44.085 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:31:14.202 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:31:14.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:31:14.207 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:31:44.324 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:31:44.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:31:44.329 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:32:14.404 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:32:14.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:32:14.409 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:32:44.542 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:32:44.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:32:44.548 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:33:14.673 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:33:14.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:33:14.678 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:33:44.787 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:33:44.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:33:44.793 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:34:14.897 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:34:14.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:34:14.902 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:34:45.020 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:34:45.023 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:34:45.026 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:35:15.142 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:35:15.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:35:15.148 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:35:45.258 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:35:45.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:35:45.264 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:36:15.380 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:36:15.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:36:15.386 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:36:45.529 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:36:45.531 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:36:45.534 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:37:15.674 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:37:15.677 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:37:15.680 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:37:15.703 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-11-27T21:37:15.701+0000 7f38deaed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45841) UID: 0 2023-11-27T21:37:15.703 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-11-27T21:37:15.701+0000 7fbfa6f09640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45841) UID: 0 2023-11-27T21:37:15.704 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-11-27T21:37:15.701+0000 7f22c238f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45841) UID: 0 2023-11-27T21:37:15.704 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-11-27T21:37:15.701+0000 7f7f7fed0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45841) UID: 0 2023-11-27T21:38:59.329 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:38:59.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:38:59.335 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:39:29.420 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:39:29.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:39:29.426 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:39:59.507 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:39:59.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:39:59.517 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:40:29.614 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:40:29.617 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:40:29.619 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:40:59.736 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:40:59.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:40:59.741 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:41:29.850 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:41:29.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:41:29.857 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:41:59.973 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:41:59.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:41:59.979 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:42:30.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:42:30.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:42:30.152 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:43:00.231 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:43:00.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:43:00.237 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:43:30.636 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:43:30.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:43:30.645 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:44:00.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:44:00.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:44:00.707 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:44:30.815 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:44:30.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:44:30.872 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:45:00.921 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:45:00.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:45:00.927 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:45:31.243 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:45:31.246 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:45:31.248 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:46:01.307 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:46:01.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:46:01.312 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:46:31.398 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:46:31.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:46:31.404 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:47:01.518 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:47:01.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:47:01.524 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:47:31.725 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:47:31.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:47:31.731 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:48:01.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:48:01.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:48:01.863 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:48:31.971 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:48:31.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:48:31.977 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:49:02.085 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:49:02.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:49:02.091 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:49:32.225 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:49:32.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:49:32.230 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:50:02.357 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:50:02.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:50:02.362 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:50:32.471 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:50:32.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:50:32.476 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:51:02.726 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:51:02.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:51:02.732 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:51:32.850 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:51:32.853 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:51:32.856 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:52:02.899 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:52:02.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:52:02.906 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:52:33.304 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:52:33.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:52:33.309 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:53:03.401 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:53:03.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:53:03.406 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:53:33.549 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:53:33.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:53:33.554 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:54:03.709 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:54:03.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:54:03.715 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:54:33.765 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:54:33.768 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:54:33.771 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:55:03.876 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:55:03.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:55:03.881 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:55:33.998 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:55:34.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:55:34.004 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:56:04.080 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:56:04.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:56:04.086 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:56:34.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:56:34.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:56:34.226 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:57:04.359 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:57:04.362 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:57:04.364 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:57:34.422 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:57:34.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:57:34.428 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:58:04.502 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:58:04.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:58:04.507 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:58:34.587 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:58:34.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:58:34.593 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:59:04.684 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:59:04.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:59:04.690 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:59:34.807 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:59:34.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T21:59:34.813 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:00:04.913 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:00:04.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:00:04.919 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:00:35.127 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:00:35.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:00:35.133 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:01:05.177 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:01:05.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:01:05.182 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:01:35.308 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:01:35.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:01:35.314 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:02:05.437 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:02:05.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:02:05.443 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:02:35.510 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:02:35.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:02:35.516 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:03:05.621 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:03:05.624 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:03:05.626 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:03:35.697 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:03:35.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:03:35.703 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:04:05.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:04:05.807 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:04:05.810 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:04:35.955 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:04:35.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:04:35.969 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:05:06.041 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:05:06.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:05:06.047 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:05:36.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:05:36.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:05:36.096 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:06:06.188 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:06:06.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:06:06.194 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:06:36.286 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:06:36.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:06:36.291 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:07:06.348 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:07:06.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:07:06.353 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:07:36.430 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:07:36.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:07:36.435 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:08:06.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:08:06.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:08:06.626 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:08:37.006 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:08:37.009 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:08:37.012 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:09:07.060 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:09:07.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:09:07.066 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:09:37.163 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:09:37.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:09:37.168 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:10:07.488 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:10:07.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:10:07.494 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:10:25.899 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-11-27T22:10:37.568 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:10:37.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:10:37.574 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:11:07.631 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:11:07.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:11:07.636 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:11:37.763 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:11:37.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:11:37.770 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:12:07.869 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:12:07.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:12:07.875 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:12:38.033 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:12:38.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:12:38.038 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:13:08.113 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:13:08.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:13:08.119 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:13:38.231 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:13:38.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:13:38.236 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:14:08.318 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:14:08.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:14:08.324 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:14:38.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:14:38.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:14:38.429 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:15:08.531 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:15:08.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:15:08.536 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:15:38.646 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:15:38.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:15:38.652 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:16:08.703 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:16:08.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:16:08.708 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:16:38.808 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:16:38.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:16:38.822 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:17:08.880 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:17:08.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:17:08.886 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:17:38.979 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:17:38.982 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:17:38.985 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:18:09.118 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:18:09.121 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:18:09.124 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:18:39.213 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:18:39.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:18:39.218 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:19:09.344 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:19:09.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:19:09.349 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:19:39.473 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:19:39.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:19:39.480 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:20:09.796 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:20:09.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:20:09.802 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:20:39.859 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:20:39.862 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:20:39.865 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:21:09.988 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:21:09.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:21:09.994 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:21:40.045 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:21:40.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:21:40.051 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:22:10.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:22:10.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:22:10.109 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:22:40.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:22:40.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:22:40.446 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:23:10.527 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:23:10.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:23:10.533 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:23:40.925 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:23:40.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:23:40.931 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:24:10.989 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:24:10.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:24:10.995 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:24:41.057 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:24:41.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:24:41.062 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:25:11.645 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:25:11.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:25:11.651 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:25:41.704 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:25:41.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:25:41.710 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:26:11.859 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:26:11.862 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:26:11.865 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:26:41.981 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:26:41.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:26:41.987 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:27:12.080 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:27:12.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:27:12.085 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:27:42.237 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:27:42.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:27:42.242 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:12.382 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:12.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:12.387 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:42.513 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:42.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:28:42.519 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:12.701 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:12.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:12.707 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:42.764 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:42.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:29:42.769 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:12.870 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:12.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:12.876 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:43.000 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:43.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:30:43.006 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:13.113 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:13.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:13.120 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:43.202 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:43.206 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:31:43.208 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:32:13.308 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:32:13.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:32:13.314 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:32:43.664 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:32:43.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:32:43.669 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:33:13.736 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:33:13.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:33:13.741 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:33:43.826 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:33:43.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:33:43.831 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:34:13.933 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:34:13.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:34:13.938 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:34:44.030 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:34:44.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:34:44.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:35:14.194 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:35:14.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:35:14.199 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:35:44.326 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:35:44.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:35:44.332 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:36:14.399 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:36:14.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:36:14.405 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:36:44.472 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:36:44.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:36:44.477 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:37:14.561 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:37:14.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:37:14.568 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:37:44.788 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:37:44.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:37:44.793 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:38:14.863 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:38:14.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:38:14.869 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:38:44.946 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:38:44.949 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:38:44.952 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:39:15.078 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:39:15.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:39:15.084 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:39:45.344 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:39:45.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:39:45.349 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:15.449 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:15.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:15.455 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:45.515 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:45.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:40:45.523 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:15.609 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:15.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:15.615 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:45.741 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:45.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:41:45.747 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:15.864 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:15.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:15.869 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:46.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:46.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:42:46.151 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:16.260 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:16.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:16.265 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:46.315 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:46.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:43:46.320 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:16.435 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:16.438 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:16.441 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:46.566 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:46.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:44:46.571 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:16.646 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:16.649 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:16.651 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:46.760 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:46.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:45:46.768 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:16.923 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:16.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:16.928 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:47.048 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:47.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:46:47.053 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:17.135 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:17.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:17.141 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:47.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:47.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:47:47.430 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:17.503 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:17.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:17.509 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:47.566 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:47.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:48:47.572 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:17.677 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:17.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:17.685 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:47.775 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:47.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:49:47.780 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:17.837 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:17.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:17.843 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:47.953 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:47.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:50:47.959 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:18.059 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:18.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:18.064 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:48.144 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:48.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:51:48.149 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:52:18.231 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:52:18.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:52:18.237 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:52:48.299 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:52:48.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:52:48.305 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:53:18.439 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:53:18.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:53:18.445 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:53:48.488 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:53:48.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:53:48.493 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:54:18.589 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:54:18.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:54:18.595 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:54:48.694 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:54:48.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:54:48.734 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:55:18.915 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:55:18.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:55:18.921 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:55:49.149 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:55:49.152 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:55:49.154 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:56:19.214 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:56:19.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:56:19.219 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:56:49.320 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:56:49.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:56:49.325 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:57:19.443 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:57:19.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:57:19.449 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:57:49.509 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:57:49.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:57:49.515 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:19.588 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:19.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:19.594 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:49.801 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:49.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:58:49.808 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:19.882 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:19.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:19.887 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:49.956 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:49.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T22:59:49.962 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:20.054 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:20.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:20.059 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:50.177 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:50.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:00:50.182 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:01:20.267 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:01:20.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:01:20.272 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:01:50.398 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:01:50.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:01:50.403 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:02:20.529 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:02:20.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:02:20.534 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:02:50.602 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:02:50.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:02:50.607 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:20.766 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:20.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:20.771 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:50.904 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:50.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:03:50.909 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:20.961 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:20.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:20.967 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:51.089 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:51.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:04:51.096 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:05:21.153 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:05:21.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:05:21.158 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:05:51.284 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:05:51.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:05:51.289 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:06:21.341 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:06:22.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:06:22.124 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:06:52.248 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:06:52.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:06:52.253 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:07:22.324 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:07:22.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:07:22.329 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:07:52.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:07:52.466 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:07:52.468 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:08:22.535 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:08:22.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:08:22.540 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:08:52.617 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:08:52.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:08:52.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:09:22.723 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:09:22.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:09:22.728 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:09:52.813 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:09:52.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:09:52.819 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:10:22.911 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:10:22.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:10:22.917 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:10:53.025 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:10:53.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:10:53.030 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:23.148 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:23.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:23.154 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:53.270 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:53.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:11:53.276 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:12:23.377 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:12:23.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:12:23.383 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:12:53.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:12:53.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:12:53.447 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:13:23.590 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:13:23.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:13:23.596 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:13:53.738 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:13:53.741 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:13:53.743 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:14:23.888 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:14:23.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:14:23.894 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:14:54.030 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:14:54.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:14:54.041 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:24.177 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:24.180 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:24.182 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:54.304 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:54.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:15:54.309 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:16:24.364 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:16:24.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:16:24.371 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:16:54.457 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:16:54.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:16:54.463 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:17:24.572 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:17:24.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:17:24.578 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:17:55.061 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:17:55.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:17:55.066 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:18:25.110 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:18:25.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:18:25.116 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:18:55.215 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:18:55.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:18:55.220 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:19:25.280 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:19:25.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:19:25.285 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:19:55.442 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:19:55.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:19:55.447 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:25.506 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:25.509 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:25.512 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:55.590 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:57.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:20:57.305 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:21:27.538 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:21:27.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:21:27.544 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:21:57.596 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:21:57.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:21:57.602 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:22:27.692 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:22:27.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:22:27.698 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:22:57.823 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:22:57.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:22:57.828 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:23:27.880 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:23:27.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:23:27.886 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:23:57.977 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:23:57.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:23:57.983 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:24:28.107 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:24:28.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:24:28.113 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:24:58.255 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:24:58.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:24:58.261 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:25:28.369 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:25:28.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:25:28.374 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:25:58.507 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:25:58.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:25:58.512 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:26:28.570 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:26:28.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:26:28.576 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:26:58.672 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:26:58.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:26:58.677 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:27:28.770 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:27:28.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:27:28.775 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:27:58.853 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:27:58.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:27:58.858 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:28:28.991 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:28:28.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:28:28.996 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:28:59.114 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:28:59.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:28:59.120 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:29:29.228 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:29:29.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:29:29.233 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:29:59.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:29:59.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:29:59.703 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:30:29.755 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:30:29.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:30:29.761 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:30:59.846 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:30:59.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:30:59.851 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:31:30.141 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:31:30.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:31:30.146 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:32:00.195 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:32:00.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:32:00.204 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:32:30.251 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:32:30.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:32:30.256 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:33:00.338 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:33:00.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:33:00.343 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:33:30.419 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:33:30.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:33:30.425 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:34:00.525 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:34:00.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:34:00.530 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:34:30.631 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:34:30.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:34:30.637 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:00.746 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:00.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:00.752 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:31.036 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:31.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:35:31.042 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:01.141 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:01.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:01.147 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:31.214 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:31.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:36:31.220 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:01.395 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:01.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:01.402 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:31.519 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:31.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:37:31.524 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:01.795 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:01.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:01.801 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:31.915 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:31.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:38:31.921 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:02.054 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:02.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:02.060 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:32.321 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:32.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:39:32.330 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:02.382 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:02.385 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:02.388 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:32.512 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:32.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:40:32.517 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:02.650 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:02.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:02.656 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:32.798 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:32.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:41:32.803 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:02.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:02.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:02.942 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:33.066 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:33.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:42:33.072 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:43:03.218 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:43:03.221 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:43:03.224 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:43:33.286 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:43:33.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:43:33.291 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:44:03.372 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:44:03.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:44:03.378 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:44:33.487 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:44:33.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:44:33.492 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:45:03.609 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:45:03.612 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:45:03.615 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:45:33.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:45:33.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:45:33.670 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:03.728 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:03.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:03.733 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:33.858 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:33.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:46:33.863 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:03.938 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:03.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:03.944 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:34.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:34.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:47:34.016 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:48:04.123 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:48:04.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:48:04.156 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:48:34.564 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:48:34.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:48:34.569 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:49:04.626 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:49:04.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:49:04.632 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:49:34.700 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:49:34.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:49:34.706 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:50:05.029 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:50:05.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:50:05.034 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:50:35.084 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:50:35.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:50:35.090 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:05.141 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:05.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:05.147 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:35.224 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:35.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:51:35.230 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:52:05.339 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:52:05.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:52:05.344 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:52:35.428 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:52:35.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:52:35.469 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:53:05.668 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:53:05.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:53:05.673 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:53:35.717 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:53:35.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:53:35.723 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:54:05.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:54:05.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:54:05.863 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:54:05.879 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-11-27T23:54:05.875+0000 7f38deaed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46678) UID: 0 2023-11-27T23:54:05.879 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-11-27T23:54:05.875+0000 7fbfa6f09640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46678) UID: 0 2023-11-27T23:54:05.880 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-11-27T23:54:05.875+0000 7f7f7fed0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46678) UID: 0 2023-11-27T23:54:05.880 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-11-27T23:54:05.875+0000 7f22c238f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46678) UID: 0 2023-11-27T23:55:49.125 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:55:49.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:55:49.131 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:19.191 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:19.194 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:19.196 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:49.253 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:49.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:56:49.259 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:19.368 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:19.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:19.373 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:49.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:49.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:57:49.472 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:19.546 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:19.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:19.552 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:49.669 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:49.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:58:49.675 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:59:19.733 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:59:19.737 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:59:19.739 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:59:49.799 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:59:49.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-27T23:59:49.805 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:00:20.115 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:00:20.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:00:20.120 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:00:29.611 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-11-28T00:00:29.606+0000 7f290c1c6640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 50622) UID: 0 2023-11-28T00:00:29.611 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-11-28T00:00:29.606+0000 7f290c1c6640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-11-28T00:00:29.611 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-28T00:00:29.606+0000 7fae4b3d7640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 50622) UID: 0 2023-11-28T00:00:29.612 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-11-28T00:00:29.606+0000 7f62de24c640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 50622) UID: 0 2023-11-28T00:00:29.612 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-11-28T00:00:29.606+0000 7efc10321640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 50622) UID: 0 2023-11-28T00:00:29.613 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-11-28T00:00:29.606+0000 7f021b928640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 50622) UID: 0 2023-11-28T00:00:29.613 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-11-28T00:00:29.606+0000 7f984fdcf640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 50622) UID: 0 2023-11-28T00:00:29.613 INFO:tasks.ceph.mds.c.smithi031.stderr:2023-11-28T00:00:29.610+0000 7fac59cc1640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 50622) UID: 0 2023-11-28T00:00:29.614 INFO:tasks.ceph.mds.a.smithi031.stderr:2023-11-28T00:00:29.610+0000 7f8e5bf09640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 50622) UID: 0 2023-11-28T00:00:29.631 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-11-28T00:00:29.630+0000 7f290c1c6640 -1 received signal: Hangup from (PID: 50623) UID: 0 2023-11-28T00:00:29.631 INFO:tasks.ceph.mon.a.smithi031.stderr:2023-11-28T00:00:29.630+0000 7f290c1c6640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-11-28T00:00:29.631 INFO:tasks.ceph.mgr.y.smithi031.stderr:2023-11-28T00:00:29.630+0000 7fae4b3d7640 -1 received signal: Hangup from (PID: 50623) UID: 0 2023-11-28T00:00:29.632 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-11-28T00:00:29.630+0000 7efc10321640 -1 received signal: Hangup from (PID: 50623) UID: 0 2023-11-28T00:00:29.632 INFO:tasks.ceph.osd.2.smithi031.stderr:2023-11-28T00:00:29.630+0000 7f62de24c640 -1 received signal: Hangup from (PID: 50623) UID: 0 2023-11-28T00:00:29.632 INFO:tasks.ceph.osd.3.smithi031.stderr:2023-11-28T00:00:29.630+0000 7f984fdcf640 -1 received signal: Hangup from (PID: 50623) UID: 0 2023-11-28T00:00:29.633 INFO:tasks.ceph.mds.c.smithi031.stderr:2023-11-28T00:00:29.630+0000 7fac59cc1640 -1 received signal: Hangup from (PID: 50623) UID: 0 2023-11-28T00:00:29.633 INFO:tasks.ceph.mds.a.smithi031.stderr:2023-11-28T00:00:29.630+0000 7f8e5bf09640 -1 received signal: Hangup from (PID: 50623) UID: 0 2023-11-28T00:00:29.633 INFO:tasks.ceph.osd.1.smithi031.stderr:2023-11-28T00:00:29.630+0000 7f021b928640 -1 received signal: Hangup from (PID: 50623) UID: 0 2023-11-28T00:00:43.188 INFO:tasks.ceph.mon.b.smithi081.stderr:2023-11-28T00:00:43.183+0000 7f2d14fc7640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46753) UID: 0 2023-11-28T00:00:43.188 INFO:tasks.ceph.mon.b.smithi081.stderr:2023-11-28T00:00:43.183+0000 7f2d14fc7640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-11-28T00:00:43.188 INFO:tasks.ceph.mon.c.smithi081.stderr:2023-11-28T00:00:43.183+0000 7f1a2fcb0640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46753) UID: 0 2023-11-28T00:00:43.188 INFO:tasks.ceph.mon.c.smithi081.stderr:2023-11-28T00:00:43.183+0000 7f1a2fcb0640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-11-28T00:00:43.189 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-11-28T00:00:43.183+0000 7f38deaed640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46753) UID: 0 2023-11-28T00:00:43.189 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-11-28T00:00:43.183+0000 7fbfa6f09640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46753) UID: 0 2023-11-28T00:00:43.189 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-11-28T00:00:43.183+0000 7f22c238f640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46753) UID: 0 2023-11-28T00:00:43.190 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-11-28T00:00:43.183+0000 7f7f7fed0640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46753) UID: 0 2023-11-28T00:00:43.190 INFO:tasks.ceph.mds.b.smithi081.stderr:2023-11-28T00:00:43.183+0000 7f414f4a3640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46753) UID: 0 2023-11-28T00:00:43.195 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-28T00:00:43.191+0000 7f88d53d9640 -1 Fail to open '/proc/46753/cmdline' error = (2) No such file or directory 2023-11-28T00:00:43.195 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-28T00:00:43.191+0000 7f88d53d9640 -1 received signal: Hangup from (PID: 46753) UID: 0 2023-11-28T00:00:43.222 INFO:tasks.ceph.mon.c.smithi081.stderr:2023-11-28T00:00:43.219+0000 7f1a2fcb0640 -1 received signal: Hangup from (PID: 46769) UID: 0 2023-11-28T00:00:43.223 INFO:tasks.ceph.mon.c.smithi081.stderr:2023-11-28T00:00:43.219+0000 7f1a2fcb0640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-11-28T00:00:43.223 INFO:tasks.ceph.mgr.x.smithi081.stderr:2023-11-28T00:00:43.219+0000 7f88d53d9640 -1 received signal: Hangup from (PID: 46769) UID: 0 2023-11-28T00:00:43.223 INFO:tasks.ceph.mon.b.smithi081.stderr:2023-11-28T00:00:43.219+0000 7f2d14fc7640 -1 received signal: Hangup from (PID: 46769) UID: 0 2023-11-28T00:00:43.223 INFO:tasks.ceph.mon.b.smithi081.stderr:2023-11-28T00:00:43.219+0000 7f2d14fc7640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-11-28T00:00:43.224 INFO:tasks.ceph.osd.4.smithi081.stderr:2023-11-28T00:00:43.219+0000 7f38deaed640 -1 received signal: Hangup from (PID: 46769) UID: 0 2023-11-28T00:00:43.224 INFO:tasks.ceph.osd.6.smithi081.stderr:2023-11-28T00:00:43.219+0000 7f22c238f640 -1 received signal: Hangup from (PID: 46769) UID: 0 2023-11-28T00:00:43.224 INFO:tasks.ceph.osd.7.smithi081.stderr:2023-11-28T00:00:43.219+0000 7f7f7fed0640 -1 received signal: Hangup from (PID: 46769) UID: 0 2023-11-28T00:00:43.224 INFO:tasks.ceph.mds.b.smithi081.stderr:2023-11-28T00:00:43.219+0000 7f414f4a3640 -1 received signal: Hangup from (PID: 46769) UID: 0 2023-11-28T00:00:43.225 INFO:tasks.ceph.osd.5.smithi081.stderr:2023-11-28T00:00:43.219+0000 7fbfa6f09640 -1 received signal: Hangup from (PID: 46769) UID: 0 2023-11-28T00:00:50.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:00:50.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:00:50.185 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T00:00:50.193 INFO:teuthology.orchestra.run.smithi031.stderr:error: state file /var/lib/logrotate/status is already locked 2023-11-28T00:00:50.194 INFO:teuthology.orchestra.run.smithi031.stderr:logrotate does not support parallel execution on the same set of logfiles. 2023-11-28T00:00:50.195 DEBUG:teuthology.orchestra.run:got remote process result: 3 2023-11-28T00:00:50.195 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph-c_369173db14b6995b2bd07c60ec5f63d01cf21631/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi031 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-11-28T00:00:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:error: state file /var/lib/logrotate/status is already locked 2023-11-28T00:00:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:logrotate does not support parallel execution on the same set of logfiles. 2023-11-28T05:25:57.651 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-11-28T05:25:57.682 DEBUG:teuthology.task.console_log:Killing console logger for smithi031 2023-11-28T05:25:57.683 DEBUG:teuthology.task.console_log:Killing console logger for smithi081 2023-11-28T05:25:57.683 DEBUG:teuthology.task.console_log:Killing console logger for smithi176 2023-11-28T05:25:57.683 DEBUG:teuthology.exit:Finished running handlers